Alan-Jowett / LexonGraph / 30314158948

82%

Build Type

push

github

Committed by web-flow

Commit Message

Use Redb for v3 partition working state (#214)

* Use Redb for v3 partition working state

Requirements:
- Clarify that v3 uses the caller-provided working root for backend-private temporary partition-working database state.
- Add REQ-STREAM-INDEXER-132 for Redb-backed deterministic partition staging.

Design:
- Replace file-backed v3 working-store language with a run-scoped Redb database.
- Add DSG-STREAM-INDEXER-023B for deterministic partition membership storage.

Implementation:
- Replace per-partition temp-file staging in streaming-indexer v3 with a Redb-backed partition store.
- Update v3 spec-validation coverage for Redb staging and determinism.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* Address PR review feedback

- restore blocking isolation for async v3 partition ingestion
- drop the Redb partition store before cleaning the temp root
- tighten Redb partition key ranges to avoid prefix collisions

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* Batch v3 partition store writes

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* Address new PR review comments

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* Fix clippy lint in v3 key helper

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* Skip empty grouped v3 partition writes

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* Address remaining PR review feedback

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* Remove stale v3 partition rows on clear

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* Pre-size v3 grouping buffers

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* Guard v3 partition index arithmetic

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* Restore responsive v3 cancellation checks

Co-authored-by: Copilot <223556219+Copilot@users.noreply.gi... (continued)

Coverage Stats

394 of 937 new or added lines in 2 files covered. (42.05%)

9 existing lines in 1 file now uncovered.

32726 of 40677 relevant lines covered (80.45%)

379732.2 hits per line