source-academy / py-slang / 28831537578

81%

push

github

Add a script to report native Pynter parity pass/fail as a table (#220)

scripts/pynter-parity-report.ts (yarn pynter:report) runs the full test
suite and prints a Markdown table of pass/attempted counts, skipped
(complex-number) counts, and pass rate per test file — the same table
shape used by hand in PR descriptions so far, now generated from actual
`jest --json` output instead of manually running each suite and copying
numbers out of the summary line.

Deliberately doesn't use jest's own -t filter: it marks non-matching
tests as "pending" rather than excluding them, which would be
indistinguishable from a genuine complex-number skip. Filters by
ancestor title (["pvml/pynter"] describe block prefix) over the full,
unfiltered result set instead.

--failures additionally lists every failing test's full name, grouped
by suite, for finding concrete cases to work on rather than just counts.

The existing "filter by test-name tag" yarn jest -t instructions in
README.md are unchanged; this is documented as an additional option
alongside them, not a replacement.

Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>

2483 of 3481 branches covered (71.33%)

Branch coverage included in aggregate %.

5980 of 7431 relevant lines covered (80.47%)

13481.56 hits per line