ooni / probe-cli / 6460060263
84%

DEFAULT BRANCH: master
Ran
Jobs 1
Files 515
Run time 11s
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
coverage: 79.609% (-2.4%) from 81.999%
6460060263

push

github

web-flow 
refactor: go test -short does not use the host network (#1352)

This diff refactors the codebase so that we avoid using the host network
when running `go test -short`. This change is good in general, because
now coverage tells us the amount of code we're covering without
depending on interactions with an existing network, which means these
tests behave in the same way in ~any place.

I expect a coverage drop from this PR, because there's some coverage
made with integration testing (if we consider integration tests the
tests that require the host network interface with uncensored internet
access).

To make this happen, I needed to modify the `quictesting` package (now
moved to toplevel and renamed `testingquic`) such that it attempts to
get a known-to-work-well endpoint for QUIC _only_ when the developer
using the package really needs it, rather than on import. Before doing
this, there were several tests that panicked because `quictesting` could
not figure out which IP address to use when you disable the WiFi or run
inside another netns. Now we only figure this IP address out the first
time a test requires us to give it either the domain or the endpoint
that we should use.

To be sure we continue to honour the promise that `go test -short` does
not use the host network, I needed to refactor the CI such that we
measure coverage inside a new network namespace with only localhost
support. I think this compromise is acceptable, since the original ask
was to avoid flaky network tests (see
https://github.com/ooni/probe/issues/2426).

Because of this change in how we run the coverage checks, I am
tentatively enabling also running all tests for pull requests, otherwise
we don't know if a contribution breaks tests using the network.
Hopefully, we should be fine because we are caching previous runs, so a
bunch of tests should already be cached.

Closes https://github.com/ooni/probe/issues/2426.

While there, enable again some ... (continued)

0 of 26 new or added lines in 1 file covered. (0.0%)

686 existing lines in 39 files now uncovered.

23628 of 29680 relevant lines covered (79.61%)

37.26 hits per line

New Missed Lines in Diff

Lines Coverage ∆ File
26
0.0
 internal/testingquic/testingquic.go

Uncovered Existing Lines

Lines Coverage ∆ File
1
94.12
 -5.88% internal/enginelocate/ubuntu.go
1
98.75
 -1.25% internal/memoryless/memoryless.go
1
95.0
 -5.0% internal/probeservices/measurementmeta.go
2
80.0
 -20.0% internal/enginelocate/resolverlookup.go
2
99.01
 -0.99% internal/experiment/hhfm/hhfm.go
2
97.37
 -2.63% internal/experiment/tlstool/tlstool.go
2
91.89
 -2.7% internal/experiment/urlgetter/runner.go
2
95.83
 -4.17% internal/measurexlite/quic.go
2
83.33
 -16.67% internal/probeservices/checkin.go
3
88.57
 -8.57% internal/experiment/echcheck/handshake.go
3
87.5
 -12.5% internal/probeservices/register.go
4
71.43
 -28.57% internal/enginelocate/cloudflare.go
4
91.49
 -8.51% internal/enginelocate/iplookup.go
4
95.83
 -4.17% internal/experiment/urlgetter/getter.go
4
91.38
 -6.9% internal/probeservices/probeservices.go
5
73.26
 -5.81% internal/netxlite/utls.go
6
0.0
 -100.0% internal/enginelocate/mmdblookup.go
6
90.48
 -9.52% internal/probeservices/collector.go
9
79.1
 -13.43% internal/enginelocate/stun.go
9
0.0
 -100.0% internal/ptx/fake.go
11
86.0
 -11.0% internal/experiment/stunreachability/stunreachability.go
14
77.78
 -17.46% internal/oohelperd/tcptls.go
15
88.28
 -11.72% internal/oohelperd/handler.go
17
85.71
 -14.29% internal/mlablocatev2/mlablocatev2.go
19
72.06
 -27.94% internal/enginelocate/geolocate.go
24
39.08
 -13.79% internal/experiment/ndt7/ndt7.go
24
0.0
 -100.0% internal/experiment/tlstool/internal/internal.go
26
43.48
 -56.52% pkg/oonimkall/xoonirun.go
28
76.39
 -19.44% internal/oohelperd/http.go
30
60.71
 -9.74% internal/database/actions.go
31
83.68
 -16.32% internal/experiment/dnscheck/dnscheck.go
35
30.51
 -59.32% internal/experiment/echcheck/measure.go
36
66.91
 -25.9% internal/oohelperd/measure.go
39
0.0
 -100.0% internal/oohelperd/quic.go
39
65.18
 -34.82% internal/ptx/ptx.go
45
55.0
 -45.0% internal/experiment/signal/signal.go
55
16.32
 -28.95% internal/experiment/quicping/quicping.go
59
28.92
 -71.08% internal/cmd/oohelperd/main.go
67
63.4
 -17.77% internal/engine/session.go
Jobs
ID Job ID Ran Files Coverage
1 0 - 6460060263.1 515
79.61
 GitHub Action Run
Source Files on build 6460060263