ooni / probe-cli / 6325670960

72%

push

github

fix(enginenetx): periodically trim statistics (#1317)

If we're running the enginenetx code inside an environment that sprays
~random IP addresses during DNS lookup, we're going to end up using
quite a large amount of statistics. While this amount of statistics
could potentially be great in general, we need to be mindful of memory
and disk occupation as well as of the overhead of serializing and
deserializing.

To address these concerns, add the arbitrary rule that we don't want
more than ten domain-endpoint entries and implement code to zap old
and/or always-failing entries. The code will run when loading the
entries, when serializing them, and periodically while the `*Network` is
up and running.

See https://github.com/ooni/probe/issues/2531

147 of 148 new or added lines in 3 files covered. (99.32%)

24215 of 29557 relevant lines covered (81.93%)

27.91 hits per line