blevesearch / bleve
52%

DEFAULT BRANCH: master
Repo Added
Files 429
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

LAST BUILD ON BRANCH master
branch: SELECT
CHANGE BRANCH
x

coverage: 52.323% (+0.02%) from 52.304%
30118928861

push

github

web-flow 
MB-72489: fuzzy/regexp candidate-collection optimizations (#2382)

Split out from #2381 per review — the fuzzy/regexp candidate-collection
optimizations, as their own PR. No functional/API changes.

### Changes

- **Trim fuzzy candidate-collection overhead**
(`search/searcher/search_fuzzy.go`): skip the per-candidate dedup map
when the field has no synonyms (the dictionary iterator already yields
each term once; the map only exists to de-dup synonym terms), replace
the O(n²) `prefixTerm` rune-concat with a zero-alloc slice, and hoist
repeated `ctx.Value` lookups.
- **Omit postings-count read for fuzzy/regexp candidate collection**
(`index/scorch/snapshot_index*.go`): fuzzy/regexp collectors use only
the term + edit distance and discard `DictEntry.Count`, yet the segment
iterator read each candidate's postings list to compute it. A new opt-in
`AutomatonIteratorOmitCount` path skips that read, wired via a graceful
type-assertion fallback. `FieldDict`/`FieldDictPrefix`/`FieldDictRange`
still populate counts.

**Depends on** blevesearch/zapx#436 — the omit-count optimization
activates once the `zapx/v17` dependency is bumped to a release that
includes `AutomatonIteratorOmitCount`. Until then the wiring falls back
to the count-reading path (the wiring test skips), so this is safe to
merge independently.

### Benchmark

`BenchmarkFuzzyCandidateCollection` (scorch index, 1000 terms / 3000
docs, fuzziness-2 query matching 280 candidates), original → both
commits, Apple M4 Pro, count=12 via benchstat:

| | sec/op | B/op | allocs/op |
|---|---|---|---|
| micro-opts | −5.9% | −3.8% | −1.3% (988→975) |
| omit-count wiring | −9.7% | −1.1% | −29.1% (975→691) |
| **combined** | **−15.0%** | **−4.8%** | **−30.1%** (988→691) |

All p=0.000, n=12. Verified with the full fuzzy + synonym search suites
and `-race`.

---------

Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Thejas-bhat <thejas.orkombu@couchbase.com>

19 of 50 new or added lines in 3 files covered. (38.0%)

9 existing lines in 3 files now uncovered.

19877 of 37989 relevant lines covered (52.32%)

0.59 hits per line

Relevant lines Covered
37989 RELEVANT LINES 19877 COVERED LINES
0.59 HITS PER LINE
Source Files on master

Recent builds

Builds Branch Commit Type Ran Committer Via Coverage
30118928861 master MB-72489: fuzzy/regexp candidate-collection optimizations (#2382) Split out from #2381 per review — the fuzzy/regexp candidate-collection optimizations, as their own PR. No functional/API changes. ### Changes - **Trim fuzzy candidate-collection... push web-flow github
52.32
30033837132 perf-fuzzy-regexp-opts cleanup the code, fix license Pull #2382 Thejas-bhat github
52.28
30110258807 perf-fuzzy-regexp-opts go mod tidy Pull #2382 Thejas-bhat github
52.34
29896019522 master MB-72489: standalone query hot-path optimizations (#2381) Five standalone performance optimizations on query hot paths, each independently benchmarked (Apple M4 Pro, benchstat). No functional/API changes. ### Changes - **Fast-path `prepareDocum... push web-flow github
52.3
29893435053 perf-standalone-opts naming changes Pull #2381 Thejas-bhat github
52.29
29865583207 perf-standalone-opts code cleanup + review comments Pull #2381 Thejas-bhat github
52.3
29865339033 perf-standalone-opts code cleanup + review comments Pull #2381 Thejas-bhat github
52.3
29859678029 perf-standalone-opts code cleanup + review comments Pull #2381 Thejas-bhat github
52.29
29585093159 perf-fuzzy-regexp-opts perf: omit postings-count read for fuzzy/regexp candidate collection Fuzzy and regexp candidate collection iterate the field dictionary via the levenshtein/regexp automaton and use only the term and edit distance — DictEntry.Count is discarded. T... Pull #2382 capemox github
52.3
29585071608 perf-standalone-opts refactor: rename adjustDocumentMatch to adjustKNNDocumentMatch The method only adjusts a hit when a corresponding KNN hit exists (it is called solely from the knnHits != nil branches). Rename it to make that scope explicit, per review feedback. ... Pull #2381 capemox github
52.3
See All Builds (3220)