• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

kubernetes-sigs / inference-perf / 43985176825
87%

Build:
DEFAULT BRANCH: main
Ran 17 Nov 2026 12:21AM UTC
Jobs 1
Files 144
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

17 Nov 2026 12:08AM UTC coverage: 86.747% (+0.02%) from 86.725%
43985176825

push

github

web-flow
Validate unary response bodies (#542)

Part of #531

A unary 200 whose body was not a completion was read through `.get()`
chains. A choice with no message or text, next to a valid usage, was
recorded as a zero-token success.

Unary chat and completion bodies are now validated against two small
local pydantic models. A body whose `choices` or `usage` is not shaped
like a completion's raises a `ValidationError` and the request is
recorded as failed under the label `validationerror`.

Changes:
* Add `inference_perf/apis/unary_response.py`. The models declare only
`choices`, `message.content`, `text` and `usage`. `finish_reason`,
`logprobs`, `metadata`, `service_tier` and the envelope pass through
unchecked, so TGI, vLLM, SGLang and gateway bodies are accepted.
* Validate in the unary branches of `chat.py` and `completion.py`, after
the in-band error check and before the empty check.
* Keep the `validationerror` label when the quoted body matches a
transport pattern such as "connect".
* Document the label in `docs/reports.md`.

Other changes:
* `test_chat_skips_chunks_without_choices_or_delta`: the unary tail now
expects a `ValidationError`. It pinned the zero-token success this PR
removes.

No new dependency. The streaming path is untouched. A bare `{}` is still
`emptyresponseerror` and a malformed tool call entry is still skipped
(#914).

ruff, `mypy --strict`, the type-escape check and `pytest tests` ran
clean.

36 of 36 new or added lines in 4 files covered. (100.0%)

14393 of 16592 relevant lines covered (86.75%)

0.87 hits per line

Jobs
ID Job ID Ran Files Coverage
1 43985176825.1 17 Nov 2026 12:21AM UTC 144
86.75
GitHub Action Run
Source Files on build 43985176825
  • Tree
  • List 144
  • Changed 4
  • Source Changed 3
  • Coverage Changed 4
Coverage ∆ File Lines Relevant Covered Missed Hits/Line
  • Back to Repo
  • Github Actions Build #43985176825
  • dbed2720 on github
  • Prev Build on main (#43980778874)
  • Next Build on main (#44014323210)
  • Delete
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE TRIAL · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2026 Coveralls, Inc