aio-libs / yarl / 36409475173

98%

push

github

Add a yarl vs RFC 3986 vs WHATWG conformance report (#1923)

* Add RFC conformance test suite

Cover RFC 3986 grammar, percent-encoding, normalization and reference
resolution, RFC 5952 IPv6 text forms, RFC 3987 IRI mapping, RFC 3492
punycode samples, IDNA2008 with UTS #46, legacy RFC 6874 zone IDs, and
the http, ws, file and mailto scheme RFCs. Known deviations are strict
xfails whose reason starts with 'yarl:'.

* Add a yarl vs RFC 3986 vs WHATWG conformance report

tools/conformance/compare.py runs the pinned web-platform-tests URL
corpus through yarl and a strict RFC 3986 oracle and writes
tools/conformance/REPORT.md. AGENTS.md now requires regenerating the
report with every behaviour change and rejects changes that make yarl
differ where RFC 3986 and WHATWG agree.

* ci: check that the conformance report is current

The new job installs the built wheel and runs
tools/conformance/compare.py --check, and gates the test summary.

* Vendor the WPT data and list every case in the conformance report

The check no longer downloads anything, so a network hiccup cannot
fail CI. Every disagreeing case is now listed, so a case moving
between sections always shows up in the report diff. compare.py
--fetch downloads the data when the pin moves.

* ci: temporarily disable the conformance report job

84 of 168 branches covered (50.0%)

Branch coverage included in aggregate %.

7841 of 7945 relevant lines covered (98.69%)

0.99 hits per line