• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

kobotoolbox / kpi / 23050028172
82%
master: 76%

Build:
Build:
LAST BUILD BRANCH: main
DEFAULT BRANCH: master
Ran 13 Mar 2026 12:09PM UTC
Jobs 10
Files 896
Run time 2min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

13 Mar 2026 12:05PM UTC coverage: 82.036% (-0.001%) from 82.037%
23050028172

push

github

web-flow
feat(qual): add question and choice hints DEV-714 (#6813)

### đŸ“Ŗ Summary
Allow users to add hints to QA questions and choices.


### 📖 Description
Question/choice hints will be sent to the LLM to assist with processing.


### 💭 Notes
What it says on the tin. The only extra change is putting some of the
manual_qual tests inside a class so we can use the `ddt` class
decorator. This PR handles updating the schemas and documentation
examples as well.

### 👀 Preview steps

1. â„šī¸ have an account and a project with an audio question and at least
one submission
2. Add a transcript 
3. Add either a multiple- or single-choice QA question (to make it
easier, have just one option)
4. Update the new question by PATCHing
`api/v2/assets/{asset_uid}/advanced-features/{manual_qual_uid}` with
```
{
  "params": [
     {
         "uuid": "<question uuid>",
         "type": "<question type>",
         "labels": {"_default": "<question text>"},
         "hint": {"labels": {"_default": "This is a question hint"}},
         "choices": [
             {
                 "labels": {"_default": "<choice text>"}
                 "uuid": "<choice uuid>"
                 "hint": {"labels": {"_default": "This is a choice hint"}}
             }
          ]
     }
  ]
}
```
5. Request an AI-generated answer
6. đŸŸĸ [on PR] In the kpi logs, it will show the prompt sent to the LLM.
The prompt should contain both the question and the choice hints

7540 of 11648 branches covered (64.73%)

3 of 19 new or added lines in 3 files covered. (15.79%)

405 existing lines in 20 files now uncovered.

28976 of 35321 relevant lines covered (82.04%)

5.81 hits per line

New Missed Lines in Diff

Lines Coverage ∆ File
1
46.0
-0.94% kpi/schema_extensions/v2/subsequences/extensions.py
7
39.58
-2.92% kobo/apps/subsequences/prompts.py
8
32.45
-1.07% kobo/apps/subsequences/actions/automatic_bedrock_qual.py

Uncovered Existing Lines

Lines Coverage ∆ File
1
40.85
-1.41% kobo/apps/organizations/admin/organization.py
1
39.58
-2.92% kobo/apps/subsequences/prompts.py
1
92.31
-7.69% kobo/apps/user_reports/utils/migrations.py
1
46.0
-0.94% kpi/schema_extensions/v2/subsequences/extensions.py
1
85.0
-5.0% kpi/urls/__init__.py
2
44.65
-0.38% kobo/apps/openrosa/libs/utils/logger_tools.py
3
61.21
-1.82% kobo/apps/organizations/models.py
3
60.53
-7.89% kobo/apps/organizations/utils.py
6
0.0
-37.5% kobo/apps/stripe/utils/view_utils.py
7
0.0
-100.0% kobo/apps/stripe/apps.py
8
0.0
-100.0% kobo/apps/stripe/urls.py
11
0.0
-44.0% kobo/apps/stripe/signals.py
12
35.0
-60.0% kobo/apps/stripe/utils/import_management.py
14
31.82
-31.82% kobo/apps/stripe/utils/limit_enforcement.py
19
0.0
-65.52% kobo/apps/stripe/admin.py
36
20.21
-38.3% kobo/apps/stripe/utils/billing_dates.py
60
26.05
-50.42% kobo/apps/stripe/utils/subscription_limits.py
63
0.0
-51.64% kobo/apps/stripe/models.py
75
0.0
-41.9% kobo/apps/stripe/views.py
81
0.0
-93.1% kobo/apps/stripe/serializers.py
Jobs
ID Job ID Ran Files Coverage
1 23050028172.1 13 Mar 2026 12:09PM UTC 892
53.19
2 23050028172.2 13 Mar 2026 12:09PM UTC 892
54.75
3 23050028172.3 13 Mar 2026 12:10PM UTC 894
54.44
4 23050028172.4 13 Mar 2026 12:11PM UTC 892
53.23
5 23050028172.5 13 Mar 2026 12:11PM UTC 894
56.02
6 23050028172.6 13 Mar 2026 12:12PM UTC 894
65.95
7 23050028172.7 13 Mar 2026 12:12PM UTC 892
60.33
8 23050028172.8 13 Mar 2026 12:13PM UTC 894
61.48
9 23050028172.9 13 Mar 2026 12:13PM UTC 896
68.24
10 23050028172.10 13 Mar 2026 12:13PM UTC 894
54.61
Source Files on build 23050028172
  • Tree
  • List 896
  • Changed 5
  • Source Changed 0
  • Coverage Changed 5
Coverage ∆ File Lines Relevant Covered Missed Hits/Line Branch Hits Branch Misses
  • Back to Repo
  • 17d778fb on github
  • Prev Build on main (#23009486282)
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2026 Coveralls, Inc