dcdpr / jp / 28717676749

69%

push

github

fix(llm): Retry proxy upstream failures as transient (#843)

Some proxy and gateway errors between the client and the provider report
failures in bodies that don't match any provider's error envelope, so
they land in the catch-all `StreamErrorKind::Other` bucket and were
treated as non-retryable. Retrying these usually succeeds since the
failure is on the network path, not the request itself.

`StreamError::is_retryable` now also checks `Other`-kind errors for
transient network patterns in the error message, such as "upstream
unreachable", "no healthy upstream", "upstream connect error"
(envoy-style proxies), and "network is unreachable" / "host unreachable"
(transport errors). Errors matching these patterns are now retried
automatically instead of surfacing as a hard failure.

---------

Signed-off-by: Jean Mertz <git@jeanmertz.com>

6 of 6 new or added lines in 1 file covered. (100.0%)

38625 of 56707 relevant lines covered (68.11%)

691.41 hits per line