• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

kubernetes-sigs / inference-perf / 43978425555
87%

Build:
DEFAULT BRANCH: main
Ran 16 Nov 2026 11:35PM UTC
Jobs 1
Files 143
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

16 Nov 2026 11:20PM UTC coverage: 86.719%. Remained the same
43978425555

push

github

web-flow
Keep only single-token ids in the shared-prefix word-start pool (#1094)

Fixes #1093

Hi @Bslabe123, this takes the fix you suggested in the issue.

A length-1 question is only the word-start token, and the convergence
loop never drops that first id, so a word-start id that does not come
back as one token can never converge. `build_word_start_token_ids` now
also requires the decoded text to re-tokenize to exactly one token
(`count_tokens(decoded, add_special_tokens=False) == 1`).

With gpt2 on main:

```
word-start ids: 33152, not re-tokenizing to one token: [20174, 34504]
ValueError: Could not generate a prompt of exactly 1 tokens after 20 attempts (got 2).
```

With this change the pool has 33150 ids and neither of those two.
Building the pool takes about 0.8 s instead of 0.1 s for gpt2, once per
generator.

Tests in `tests/required/datagen/test_datagen_utils.py`:
- a fake tokenizer where one word-start id decodes to two tokens: it is
left out of the pool
- the same tokenizer through `_sample_suffix_ids(1)`, seeded so the bad
id is drawn first: on main it raises the same `ValueError` as the CI
run, now it returns the good id
- real gpt2: 20174 and 34504 are excluded and `" the"` (262) stays

All three fail on main. `pdm run validate` passes (one existing
`**kwargs: Any` in the test file became `object` so the type-escape
count stays flat). `pdm run test`: 3339 passed, 17 skipped; the only 2
failures are the progress bar tests that fail the same way on main on my
machine.

Signed-off-by: KVR Vishnu <46535652+VISHNU0906@users.noreply.github.com>

1 of 1 new or added line in 1 file covered. (100.0%)

14365 of 16565 relevant lines covered (86.72%)

0.87 hits per line

Jobs
ID Job ID Ran Files Coverage
1 43978425555.1 16 Nov 2026 11:35PM UTC 143
86.72
GitHub Action Run
Source Files on build 43978425555
  • Tree
  • List 143
  • Changed 1
  • Source Changed 1
  • Coverage Changed 1
Coverage ∆ File Lines Relevant Covered Missed Hits/Line
  • Back to Repo
  • Github Actions Build #43978425555
  • 554aef73 on github
  • Prev Build on main (#43961807348)
  • Next Build on main (#43980778874)
  • Delete
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE TRIAL · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2026 Coveralls, Inc