dcdpr / jp / 18020514990

58%

Build Type

push

github

Committed by web-flow

Commit Message

fix(llm, anthropic): Improve rate limit and error retry handling (#253)

Enhances the robustness of LLM interactions by implementing better retry
logic with attempt limits.

Rate limited requests now retry automatically up to 5 times with proper
backoff timing, while empty responses trigger up to 3 retry attempts.
The system provides structured logging for retry attempts, making it
easier to diagnose API issues during `jp query` operations.

Adds special handling for Anthropic's `overloaded_error` responses,
which are now treated as rate limits with a 3-second retry delay. This
addresses Anthropic's notoriously unreliable API behavior during high
load periods.

Signed-off-by: Jean Mertz <git@jeanmertz.com>

Run Details

2 of 47 new or added lines in 3 files covered. (4.26%)

2 existing lines in 1 file now uncovered.

6123 of 13441 relevant lines covered (45.55%)

5.83 hits per line