28928391926
86%

Ran 08 Jul 2026 08:39AM UTC

Jobs 2

Files 79

Run time 1min

Badge

Embed ▾

Committed 08 Jul 2026 08:22AM UTC coverage: 86.505%. Remained the same

Build # 28928391926

Build Type

push

github

Committed by

web-flow

Commit Message

Do not record unrecognized verifier failures as passing (#1183)

classify() previously returned status "pass" whenever the verifier failed
but the diagnostic did not match a known limitation kind (including the
bare "verification failed"/empty case from a crash or a reworded message).
The writer then treated that "pass" like a genuine success and popped any
existing curated expected_failure/skip override, silently flipping the
fixture to a pass expectation and hiding a verifier regression. The bare
"verification failed" reason was additionally filtered out of the
unknown-diagnostics warning, so such cases produced exit 0 with no warning
at all.

Introduce a distinct "unknown" status for a fail result whose diagnostic
does not classify. In the writer, an "unknown" status preserves the
existing curated override untouched and records the program in the
unknown-diagnostics list; the "verification failed" reason is no longer
filtered out. --fail-on-unknown now defaults to failing (nonzero exit when
any unknown failure was seen); pass --no-fail-on-unknown to only warn.
Genuine passes (verifier succeeded) and recognized diagnostics are
unchanged.

Fixes #1170

Signed-off-by: Elazar Gershuni <elazarg@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

Coverage Stats

9160 of 10589 relevant lines covered (86.5%)

6466708.5 hits per line

Jobs

ID	Job ID	Ran	Files	Coverage
1	run-Debug - 28928391926.1	08 Jul 2026 09:27AM UTC	79	84.77	GitHub Action Run
2	run-Release - 28928391926.2	08 Jul 2026 08:39AM UTC	79	85.6	GitHub Action Run

vbpf / prevail / 28928391926
86%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 28928391926

vbpf / prevail / 28928391926 86%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 28928391926

vbpf / prevail / 28928391926
86%

README BADGES
x