Alan-Jowett / LexonGraph / 29821023096

82%

Build Type

push

github

Committed by web-flow

Commit Message

Add out-of-core planner state to streaming v2 (#182)

* Add out-of-core planner state to streaming v2

Requirements:
- require a caller-provided planner-state root for streaming v2
- allow planner-managed out-of-core planning state with bounded residency
- require cross-platform residency management semantics

Specification:
- update streaming-indexer and directional-PCA requirements, design, and validation docs
- document path ownership at the v2 surface and opaque backend usage in directional-PCA behavior

Implementation:
- require planner-state root at v2 run construction
- add opaque out-of-core planner hook to directional-PCA
- persist PlanCuts quantile replay into bounded windowed planner state and finish cut planning from local state
- add validation coverage for unusable roots and reduced public PlanCuts replays

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Signed-off-by: Alan Jowett <alan.jowett@microsoft.com>

* Guard planner-state mmap length math

Fix the two PR review findings on #182 by checking the total byte length used for mmap window calculations in both the writer and reader paths. Also tighten local range arithmetic so mapped value boundaries do not rely on unchecked addition.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Signed-off-by: Alan Jowett <alan.jowett@microsoft.com>

* Tighten planner-state cleanup and sizing

Address the remaining PR #182 review comments by eagerly deleting per-pass axis files once cut planning finishes and by replacing the remaining hard-coded value-width literals with the planner-state constant.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Signed-off-by: Alan Jowett <alan.jowett@microsoft.com>

* Harden DPCA pass initialization failures

Address the remaining PR #182 review findings by making directional-PCA pass activation transactional for out-of-core quantile setup. ensure_active_pass now commits the active pass only after plan... (continued)

Coverage Stats

686 of 911 new or added lines in 2 files covered. (75.3%)

1412 existing lines in 2 files now uncovered.

30056 of 36868 relevant lines covered (81.52%)

421282.53 hits per line