pirl-unc / hitlist / 26994604019

Build # 26994604019

Build Type

push

github

Committed by web-flow

Commit Message

v1.30.63: cap integration-test workers in CI to avoid OOM (#272 follow-up) (#274)

Seeding the ci-corpus-v1 release exposed a bug in the corpus mechanism:
once the corpus is present, the 3.11 job ran the integration suite under
'pytest -n auto' (4 workers on a 16 GB runner) and got OOM-killed
('The operation was canceled' mid-run, ~48%). Each integration test
materializes the full ~4.4M-row observations table, and the #262 Arrow
xdist fixture only shares numeric/categorical columns zero-copy — string
columns materialize per worker, so 4 workers exceed RAM.

Fix: split the 3.11 test step — non-integration with -n auto (full
parallelism), integration capped at -n 2 (still exercises the cross-worker
mmap fixture, but the build peak + 2 workers fit in 16 GB). Coverage
accumulates via --cov-append. Add timeout-minutes: 25 so a future
hang/OOM fails fast instead of burning the 360-min default.

Verified: pytest -m integration -n 2 -> 20 passed, 1 skipped locally.

Coverage Stats

4843 of 6290 relevant lines covered (77.0%)

0.77 hits per line

Source File

Press 'n' to go to next uncovered line, 'b' for previous

Source Not Available