bootstrapworld / codemirror-blocks / 41153633032

95%

push

github

test(soak): add a soak runner that stress-tests with random sequences unattended

`npm run soak` (scripts/soak.js) runs the randomized-sequence spec batch after
batch on fresh seeds for as long as asked (--hours), in jsdom or, with --e2e, in
Chromium, and costs nothing while it runs. Every failing sequence is written to
soak-results/failures.jsonl with its shrunk steps and a replay command;
summary.md groups them by signature (the failing step and the problem, ids and
numbers ignored), most common first. A run that dies without a report is
classified (out of memory, timeout, killed, other), logged, and then re-run one
seed at a time to find the seed responsible; if none is, the batch simply ran
out of memory by adding up, and the batch size is halved. Progress is saved, so
it resumes where it stopped, and Ctrl-C stops after the current batch.

The parsing, signatures, crash classification and summary are in
scripts/soak-lib.js, with 11 tests. soak-results/ is ignored by git.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>

2211 of 2573 branches covered (85.93%)

3912 of 4156 relevant lines covered (94.13%)

6237.16 hits per line