medplum / medplum / 31202261515

92%

push

github

feat(agent): add "logical channels" for parallel processing within a channel (#9754)

* feat(agent): add logical channels

Partition a physical HL7 channel's durable queue into independent FIFO
sub-queues ("logical channels") so a bounded worker pool can process distinct
partitions concurrently while each partition stays strictly serial and in order.

- Schema v3: `logical_channel_key` column + `idx_inbound_vchannel_claim`.
- Partition-aware `CLAIM_NEXT`: only a partition's head is claimable, and only
  when no other row in that partition is claimed/inflight (serialization guard);
  a backing-off head blocks just its own partition. Default key `''` reduces
  exactly to the prior single-serial-worker behavior.
- Worker pool on `AgentHl7Channel` (`workers[]`/`maxWorkers`/`resizeWorkerPool`),
  sized by `maxWorkers` URL param / `channelMaxWorkers` agent setting (default 1).
- `logicalChannelKey` spec (URL param / `channelLogicalChannelKey` setting)
  computes each row's partition at intake; a spec change on reload recomputes
  only still-queued rows via `DurableQueue.recomputeLogicalChannelKeys`.
- `onServerResponse` split into `tryResolveInFlight`/`applyLateResponse` so the
  channel routes a response to the exact pool worker that owns the callback.

Rebased flat onto main (#9491 upstreamed the durable-queue/auto-retry base this
was built on); this commit is the net logical-channels overlay.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Derrick Farris <derrick@medplum.com>

* feat(agent): compute logical-channel partition key at claim time

Rework logical-channel partitioning so the partition key is derived at
CLAIM time from the channel's current spec instead of stored at intake.
This removes the recompute-on-change machinery whose stored keys went
stale across retries, requeues, restarts, and upgrade overlaps.

- CLAIM_NEXT is now partition-unaware (oldest queued, backoff-gated); a
  worker computes the claimed row's key and ... (continued)

23310 of 26428 branches covered (88.2%)

Branch coverage included in aggregate %.

365 of 387 new or added lines in 7 files covered. (94.32%)

41339 of 43762 relevant lines covered (94.46%)

12043.25 hits per line