umputun / tg-spam / 12678789799

83%

push

github

Optimize excluded tokens storage and lookup

This commit changes the storage of excluded tokens from a slice to a map
for faster lookup. It also updates related tests and benchmarks to reflect
this change. The tokenize function is modified to use the new map structure
for more efficient token exclusion checks.

5 of 5 new or added lines in 1 file covered. (100.0%)

3164 of 3987 relevant lines covered (79.36%)

85.43 hits per line