2
78%
main: 78%

Ran 15 Dec 2025 03:43AM UTC

Files 2

Run time 0s

Badge

Embed ▾

Committed 15 Dec 2025 03:40AM UTC coverage: 86.26%. First build

Job # 20219704840.2

Build Type

push

github

Committed by

web-flow

Commit Message

fix: implement queue draining and improve duplicate error handling (#232)

- Fix queue consumption pattern: services now consume from event-type queues (archive.ingested, json.parsed, chunks.prepared, summary.complete) instead of service-specific queues
- Improve error handling in parsing service: DuplicateKeyError and DocumentValidationError are now caught and skipped instead of blocking entire archive processing
- Allow individual messages/threads with permanent errors to be skipped while continuing to process the rest of the archive
- Update schema validation to allow empty 'from.name' and 'subject' fields
- Verify full end-to-end pipeline: all queues drain properly when services are running

This fixes the issue where the archive.ingested queue was not draining because parsing service was consuming from the wrong queue (parsing-service instead of archive.ingested), and where duplicate key errors would cause the entire archive to fail and be requeued infinitely.

Co-authored-by: Alan Jowett <alan.jowett@microsoft.com>

Run Details

113 of 131 relevant lines covered (86.26%)

0.86 hits per line

Alan-Jowett / CoPilot-For-Consensus / 20219704840 / 2
78%
main: 78%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job chunking - 20219704840.2

Alan-Jowett / CoPilot-For-Consensus / 20219704840 / 2 78% main: 78%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job chunking - 20219704840.2

Alan-Jowett / CoPilot-For-Consensus / 20219704840 / 2
78%
main: 78%

README BADGES
x