lsm / HyperNeo / 32406683312

80%

Build Type

push

github

Committed by web-flow

Commit Message

perf(daemon): cache prepared statements in the sqlite compat layer (#2617)

* perf(daemon): cache prepared statements in the sqlite compat layer

db.prepare() compiles SQL on every call (bun:sqlite does not cache
prepared statements internally), so per-message hot paths pay repeated
compilation on top of the wrapper allocation. Add a bounded SQL->statement
cache to both runtime paths: a CachedDatabase subclass of bun:sqlite under
Bun, and the node:sqlite Database wrapper under Node. Statements are
re-bound on every .run/.all/.get call, so reuse is safe across concurrent
queries; the cache is cleared on close and evicts FIFO past a 500-statement
capacity.

Bun 1.3.13 micro-benchmark (scripts/benchmark/statement-caching.ts) shows
fresh prepare vs reused statement on sdk_messages-shaped queries:
- INSERT: ~29us -> ~11us per op (~2.6x)
- SELECT (40 rows): ~47us -> ~36us per op (~1.3x)
- point GET: ~13us -> ~1.9us per op (~6.8x)

* refactor(daemon): benchmark the delivered cache path

The cached variants hoisted prepare() out of the measured loop, so they
compared fresh compilation against manual statement retention rather than
the implementation under review. Route them through the compat Database
(CachedDatabase under Bun), which exercises the StatementCache lookup on
every measured operation. Reuse win holds: INSERT ~18.4us -> ~7.5us, 40-row
SELECT ~40.5us -> ~27.7us, point GET ~11.7us -> ~1.6us under Bun 1.3.14.

* chore: bump bun to 1.3.14

Patch upgrade from the pinned 1.3.13: update the root packageManager
declaration, the setup-bun CI pins across main/release/real-api-tests, and
align @types/bun in ui/shared/messaging with the 1.3.14 already used by
web/cli/daemon. Verified lint/typecheck/no-comments and the sqlite suite
under an isolated bun 1.3.14 binary.

* chore: sync bun.lock with @types/bun 1.3.14

The messaging/shared/ui manifests were bumped to @types/bun 1.3.14 but
bun.lock still resolved them to 1.3.13, so bun install --frozen-lockfile
fa... (continued)

Coverage Stats

44197 of 59633 branches covered (74.12%)

Branch coverage included in aggregate %.

22 of 34 new or added lines in 3 files covered. (64.71%)

1 existing line in 1 file now uncovered.

60108 of 71907 relevant lines covered (83.59%)

3975.21 hits per line