aio-libs / multidict / 35608724460

87%

push

github

Run CodSpeed benchmarks on Python 3.14 and loop the smallest ones (#1498)

<!-- Thank you for your contribution! -->

## What do these changes do?

Moves the CodSpeed benchmark job to Python 3.14, and makes the `repr()`
and view inequality benchmarks repeat their operation 100 times, the way
the other benchmarks already loop. The benchmark job timeout goes from
10 to 15 minutes, since the job takes about 9.5 minutes.

The high "variability" figures on the CodSpeed dashboard (up to about
140%) come from benchmark redefinitions in #1494 and from the real
`add()` and `getall()` performance changes in #1466 and #1484, not from
run-to-run noise. A same-commit rerun on master (242e5bd) reported 266
of 266 benchmarks unchanged. The dashboard window will age out by
itself.

## Are there changes in behavior for the user?

No, only benchmarks and CI change. The reshaped benchmarks, and the move
to 3.14, will cause a one-time jump in their CodSpeed history.

## Is it a substantial burden for the maintainers to support this?

No.

## Related issue number

N/A

## Checklist

- [x] I think the code is well written
- [ ] Unit tests for the changes exist: N/A, this only changes
benchmarks and CI
- [ ] Documentation reflects the changes: N/A
- [ ] If you provide code modification, please add yourself to
`CONTRIBUTORS.txt`: N/A
- [x] Add a new news fragment into the `CHANGES/` folder
- [x] `make doc-spelling` passes and any new technical words are added
to `docs/spelling_wordlist.txt`

<details>
<summary>Agent run details (optional, for reviewers)</summary>

Measurement: valgrind is not available locally, so a small pytest plugin
emulated pytest-codspeed's simulation mode, including the
`gc.collect()`/`gc.disable()` and `random.seed(0)` that
`plugin._measure` does, followed by one warmup call and one measured
call. It recorded user-space retired instructions with
`perf_event_open`, pinned to P-cores. Each run allocated a different
number of dummy objects first, to mimi... (continued)

762 of 1524 branches covered (50.0%)

Branch coverage included in aggregate %.

12 of 12 new or added lines in 2 files covered. (100.0%)

6461 of 6733 relevant lines covered (95.96%)

1.92 hits per line