kobotoolbox / kpi / 23437958906 / 5

82%

master: 76%

push

github

fix(qual): allow empty answers to single-select questions DEV-1904 (#6850)

### 📣 Summary
Treat no response selected as a legitimate LLM answer to a select one
question.


### 📖 Description
Previously, if the LLM did not return a selection for a select one
question, it was treated as an error. This PR treats those responses as
legitimate.



### 👀 Preview steps

1. ℹ️ have an account and a project with an audio question and a
transcription
2. Add a select one QA question that cannot be reasonably answered by
the transcript
3. `Generate with AI`
4. Open the network console to view the response
5. 🔴 [on main] the response comes back with `'status': 'failed',
'error': ''LLM returned no answers for a single select`

- Note: because AI is AI, sometimes the error message ends up being `LLM
returned unexpected response NONE,NONE.` Try to tweak the question to
convince the LLM to return `FALSE,FALSE`, as it should. Anecdotally, it
seems like OSS is slightly smarter than Claude about this

6. 🟢 [on PR] the response comes back with `'status': 'complete',
'value':''`



<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

## Bug Fixes
* Improved handling of single-select questions when no options are
selected, returning an empty response instead of an error.
* Enhanced validation logic to gracefully handle edge cases in choice
selection, preventing potential failures during response processing.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

3503 of 11671 branches covered (30.01%)

18977 of 35601 relevant lines covered (53.3%)

0.53 hits per line