hathitrust / index_search_monorepo / 39620001957

77%

Build Type

push

github

Committed by web-flow

Commit Message

ETT-1894: Tell Solr outages apart from bad messages in the indexer (#63)

* ETT-1894: classify indexing failures and handle each message individually in process_batch

* ETT-1894: bound retries per message and back off between failed batches

* ETT-1894: emit structured event logs for Solr failures, retries and dead-lettering

* ETT-1894: add replay_dlq command to move dead-lettered messages back to the indexer queue

* ETT-1894: don't count 429/502/503/504 against a message's retries, keep replay errors visible

* ETT-1894: use the document id as the message key and treat 404 as a config error

* ETT-1894: document that the backoff sleep assumes the heartbeat is 0

* ETT-1894: pass the heartbeat to ChannelCreator in replay_dlq and test main()

* ETT-1894: keep only the assertions that matter in the dead-letter replay tests

* ETT-1894: drop the message hash, a message without an id goes straight to the DLQ

Coverage Stats

229 of 241 new or added lines in 6 files covered. (95.02%)

1 existing line in 1 file now uncovered.

1972 of 2598 relevant lines covered (75.9%)

0.76 hits per line