• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

kubernetes-sigs / inference-perf / 44187044576
87%

Build:
DEFAULT BRANCH: main
Ran 17 Nov 2026 10:23PM UTC
Jobs 1
Files 150
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

17 Nov 2026 10:08PM UTC coverage: 87.189% (+0.4%) from 86.752%
44187044576

push

github

web-flow
feat(tools): convert vllm bench and aiperf argv into configs (#814)

Part of #755.

Adds `inference-perf-convert`, which reads a `vllm bench serve` or
`aiperf profile` argument list at a caller-supplied peer version and
emits an inference-perf config. The comment block records the source
argv, assumptions, and dropped workload-neutral flags. Unsupported
conversions refuse with a named reason and exit 2 without creating or
overwriting the output file; invalid peer arguments exit 1.

Changes:

- Mirror the verified vLLM v0.10.0 and AIPerf v0.12.0 flag surfaces,
including aliases, declared boolean negations, multi-value arguments,
and sweep refusals. Unknown flags and unverified versions refuse.
- Emit streaming and ignore-EOS explicitly. Match the peers'
request-count and dataset-pool rules, and map vLLM's rescaled random
arrival gaps to `load.type: constant`.
- Refuse AIPerf chat/messages and media input flags because the emitted
random generator only supports text completions. Remove the unused
multimodal mappings. The former image/video success tests now expect
refusals because those configs silently discarded media.
- Refuse `--apply-chat-template`: AIPerf compensates synthetic lengths
for template overhead while sending bare completions text;
inference-perf's setting wraps the wire prompt instead. Explicitly
disabling the flag still converts.
- Correct the warmup entry-reuse and BOS explanations, remove the stale
claim that chat/messages convert, and update the comparability
documentation. API keys and credential headers remain omitted from
configs and redacted in recorded argv.
- Use the in-tree parity cases from #736 as the acceptance oracle. Merge
current main and replace the converter's `Any` annotations with typed
parser options and Pydantic-validated configuration dictionaries to pass
the new type-escape check.

Validation:

- Before the payload fixes, the regression selection reported `12
failed, 1 passed`; the CLI cases failed with `Asserti... (continued)

1036 of 1106 new or added lines in 6 files covered. (93.67%)

15476 of 17750 relevant lines covered (87.19%)

0.87 hits per line

Uncovered Changes

Lines Coverage ∆ File
51
91.39
inference_perf/tools/convert/aiperf_profile.py
13
95.86
inference_perf/tools/convert/vllm_bench.py
5
89.13
inference_perf/tools/convert/emit.py
1
97.87
inference_perf/tools/convert/cli.py
Jobs
ID Job ID Ran Files Coverage
1 44187044576.1 17 Nov 2026 10:23PM UTC 150
87.19
GitHub Action Run
Source Files on build 44187044576
  • Tree
  • List 150
  • Changed 1
  • Source Changed 0
  • Coverage Changed 1
Coverage ∆ File Lines Relevant Covered Missed Hits/Line
  • Back to Repo
  • Github Actions Build #44187044576
  • c34e9562 on github
  • Prev Build on main (#44168932103)
  • Delete
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE TRIAL · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2026 Coveralls, Inc