DigitalTolk / ex / 40285916934

100%

push

github

search: split _bulk requests by size and retry 429s (#344)

* search: split _bulk requests to stay under the request size limit

Bulk sent every entry in one request. Indexing a channel with many or
large messages built a body over OpenSearch's request limit (10 MiB on
small AWS instance types) and failed with 413. Bulk now splits entries
into requests of at most 5 MiB; per-item errors are reported once all
requests have been sent, and a failed request stops the rest.

* search: retry _bulk requests OpenSearch answers with 429

OpenSearch returns 429 when it sheds load (write queue full or memory
pressure). Bulk failed the whole parent's indexing on the first one;
it now retries a throttled request with backoff (1s to 20s, five
retries) before giving up, and stops waiting when the context ends.

11782 of 11782 branches covered (100.0%)

Branch coverage included in aggregate %.

43 of 43 new or added lines in 1 file covered. (100.0%)

50229 of 50230 relevant lines covered (100.0%)

1796.49 hits per line