kobotoolbox / kpi / 23748658159 / 5

82%

master: 76%

push

github

fix(qual): graceful timeout handling for automatic qualitative analysis DEV-1928 (#6894)

### 📣 Summary
This PR introduces strict timeout configurations for AWS Bedrock
requests to prevent unhandled 504 Gateway Timeout errors during
automatic qualitative analysis.

### 📖 Description
This PR addresses an issue where slow responses from the LLM via AWS
Bedrock were causing the web server to sever the connection, resulting
in a 504 Gateway Timeout for the client.
- A strict timeout of 50 seconds (read) and 5 seconds (connect) is now
enforced on the `boto3` client via `botocore.config.Config`.
- The `run_external_process` loop is updated to catch
`ReadTimeoutError`.
- If a timeout occurs on the primary model, this PR ensures the system
gracefully falls back to the backup model.
- If all models time out, a clean JSON response with a failed status is
returned to the frontend rather than crashing the request.
- Unit tests have been updated and added to verify the timeout fallback
behavior.

3987 of 11848 branches covered (33.65%)

19999 of 35962 relevant lines covered (55.61%)

0.56 hits per line