wegamekinglc / calc-flow / 35528946043

93%

Build Type

push

github

Committed by web-flow

Commit Message

perf: hoist ASOF admission work and skip idle checkpoint encodes (#309)

* perf: hoist ASOF admission work and skip idle checkpoint encodes

The ASOF admission hot path rebuilt a RowConverter and re-resolved schema
indexes per row, and each retained row was IPC-encoded twice (a measuring
pass then a bounded pass). Watermark ticks recloned and re-encoded state
even when nothing had changed, and every transition re-walked the full
state for limit accounting.

- Resolve event-time arrays and build row converters once per batch;
  extract per-row identity bytes from the shared conversion.
- Encode each admitted row once through a reusable growable scratch
  buffer, copying exact bytes so retained payloads keep len == capacity
  charge parity with checkpoint round-trips.
- Skip the clone/encode/inventory checkpoint transaction when a sweep
  stamp and a shared eviction predicate prove no admission, removal or
  eviction is pending; empty or fully late admissions return before
  cloning. Transactional clone-prepare-install semantics are unchanged.
- Maintain the state inventory as signed deltas applied to the committed
  gauges; the full walk stays for restore validation and as a debug-build
  cross-check of the delta arithmetic.
- Charge Utf8/LargeUtf8 identity columns aligned*33/32 + framing: Arrow's
  blocked string row encoding adds ~L/32 sentinel bytes, so the old
  aligned+16 charge under-bounded long string keys.
- Document the output workspace multiplier, drop take_if(|_| true) for
  take(), and share one null-identity validator between admission and
  restore.

* style: make unit closure pattern explicit for analyzers

Coverage Stats

373 of 386 new or added lines in 8 files covered. (96.63%)

1035 existing lines in 9 files now uncovered.

105773 of 113562 relevant lines covered (93.14%)

92351.11 hits per line