• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

kobotoolbox / kpi / 21875655700 / 1
82%
master: 76%

Build:
Build:
LAST BUILD BRANCH: main
DEFAULT BRANCH: master
Ran 10 Feb 2026 06:08PM UTC
Files 879
Run time 19s
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

10 Feb 2026 05:34PM UTC coverage: 79.675% (-2.2%) from 81.91%
21875655700.1

push

github

web-flow
feat(qual): enable LLMs to answer QA questions  (#6707)

### 📣 Summary
This PR allows users to use an LLM to answer QA questions via the API.


### 📖 Description
Users can use the API to request LLM responses to QA questions, using
OpenAI as the primary LLM and defaulting to Claude if the request to
OpenAI fails. LLM requests can be limited by subscription tier.


### 💭 Notes
This PR includes:
1. Creating the prompt for the LLM (separated into its own file for
easier tweaking)
2. Sending the prompt to the LLM and parsing the response
3. Using Claude if the request to OpenAI fails
4. Saving the answers to the submission 
5. Project history logs
6. Ensuring LLM usage is tracked for billing purposes

This PR does not include:
1. Any frontend work
2. Verification of LLM responses
3. Any indication in exports or the data table that a response was LLM
generated
4. The most up to date documentation/schemas

Risks:
1. The new project history action shows up funny in the history table
(`x did action modify-automatic-qa-data`) and causes the page to toast
`TypeError`
2. LLM responses are not labeled as such in the data table, so could end
up in data sets without people realizing they are LLM-generated
3. Columns for qual questions may be filled without showing up in the
analysis tab if a user uses the new functionality

These are not major risks to functionality, and since there is no
ability to request LLM answers via the UI, there is a very low chance
users will even use the new feature at all.

All PRs that were merged into this branch were reviewed and tested
independently, so the risk of major issues slipping through is also
mitigated.

7190 of 11466 branches covered (62.71%)

27612 of 34656 relevant lines covered (79.67%)

0.8 hits per line

Source Files on job 21875655700.1
  • Tree
  • List 879
  • Changed 40
  • Source Changed 0
  • Coverage Changed 40
Coverage ∆ File Lines Relevant Covered Missed Hits/Line Branch Hits Branch Misses
  • Back to Build 21875655700
  • 934ab3f8 on github
  • Prev Job for on main (#21869992480.2)
  • Next Job for on main (#21879693416.1)
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2026 Coveralls, Inc