• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

kubernetes-sigs / inference-perf / 44014323210
87%

Build:
DEFAULT BRANCH: main
Ran 17 Nov 2026 04:17AM UTC
Jobs 1
Files 144
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

17 Nov 2026 04:02AM UTC coverage: 86.75% (+0.003%) from 86.747%
44014323210

push

github

web-flow
Re-tokenize the shared-prefix word-start candidates in one batched call (#1097)

Follow-up to #1094, for #1093.

`build_word_start_token_ids` called `count_tokens` once per
whitespace-prefixed id, so startup grew with the vocab. With a Hugging
Face tokenizer it now encodes all candidates in one call. Other
tokenizers (the test fakes) still count one text at a time. The pool
itself does not change.

Pool build time on my machine, main vs this branch, same pool on both:

| tokenizer | valid ids | pool | main | branch |
|---|---|---|---|---|
| gpt2 | 50256 | 33150 | 0.76s | 0.31s |
| SmolLM2-135M-Instruct | 49149 | 32078 | 0.74s | 0.28s |
| Qwen2.5-0.5B | 151651 | 54319 | 1.47s | 0.68s |

What is left is mostly the per-id `decode`; `batch_decode` in
transformers 5 loops over `decode` anyway, so I left it.

New test in `tests/required/datagen/test_datagen_utils.py`: with the
real gpt2 tokenizer and `count_tokens` patched to fail, the pool for the
first 3000 ids matches the old per-id round trip. It fails on main.

`pdm run validate` and `pdm run test tests/required/datagen` pass.

@Bslabe123

Signed-off-by: KVR Vishnu <46535652+VISHNU0906@users.noreply.github.com>

15 of 15 new or added lines in 1 file covered. (100.0%)

1 existing line in 1 file now uncovered.

14404 of 16604 relevant lines covered (86.75%)

0.87 hits per line

Coverage Regressions

Lines Coverage ∆ File
1
79.17
-1.04% inference_perf/datagen/base.py
Jobs
ID Job ID Ran Files Coverage
1 44014323210.1 17 Nov 2026 04:17AM UTC 144
86.75
GitHub Action Run
Source Files on build 44014323210
  • Tree
  • List 144
  • Changed 2
  • Source Changed 1
  • Coverage Changed 2
Coverage ∆ File Lines Relevant Covered Missed Hits/Line
  • Back to Repo
  • Github Actions Build #44014323210
  • d2c4987d on github
  • Prev Build on main (#43985176825)
  • Next Build on main (#44140647921)
  • Delete
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE TRIAL · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2026 Coveralls, Inc