tueda / form / 28859272471

66%

Build Type

push

github

Committed by jodavies

Commit Message

refactor: reduce the size of the thread buckets at larger maxtermsize

Using "large" values of MaxTermSize (say, 5M, 10M, ...) results in
very large allocations for the thread buffers, since they historically
have been ThreadBucketCount(500)/4*MaxTermSize * 2 * workers, which
easily reaches 100GB or more.

Reduce the size of these allocations, such that with the default setup
nothing changes, and then the buffers grow as log(MaxTermSize), up to
the point where we enforce a BUCKETMINTERMS*MaxTermSize limit. Then
they grow linearly, but BUCKETMINTERMS is much smaller than the default
ThreadBucketCount.

Coverage Stats

6 of 6 new or added lines in 1 file covered. (100.0%)

1064 existing lines in 6 files now uncovered.

52341 of 82836 relevant lines covered (63.19%)

10526607.69 hits per line