• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

kobotoolbox / kpi / 23757408200
82%
master: 76%

Build:
Build:
LAST BUILD BRANCH: main
DEFAULT BRANCH: master
Ran 30 Mar 2026 05:11PM UTC
Jobs 10
Files 909
Run time 2min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

30 Mar 2026 05:07PM UTC coverage: 82.197% (+0.001%) from 82.196%
23757408200

push

github

web-flow
feat(qual): get model id from settings DEV-1917 (#6877)

### Summary
Remove unnecessary information from audit logs and replace with bedrock
request id.


### 👷 Description for instance maintainers
The model id used for LLM requests is now configured via environment
variables.


### Notes
This is a combination of a few issues:
1. Model ids need to be configurable so we can use specific ARNs for
tracking purposes (DEV-1917)
2. LLM prompts and responses are no longer logged for privacy reasons. 
3. Project history logs should only show the request id and the model,
not the number of tokens. If we have the request id we can get the
number of tokens from bedrock logs, and it is not information we need
users to know (DEV-1936)

Model ids are still hardcoded to avoid having to make an extra AWS call
every time when the model id for a given ARN is unlikely to ever change.
This does open up the possibility that someone could change the ARN in
settings and the model id will no longer be correct, but that is highly
unlikely during the initial rollout. We are aware that we need to
rethink model configurations in general and make them more dynamic.

### 👀 Preview steps


1. â„šī¸ Update your local environment to set `AUTOQA_OSS120_MODEL_AIP_ARN`
to a specific ARN (internal: ask Becca)
4. have an account and a project with an audio question and at least one
submission
5. Add a transcript
6. Add a QA question
7. "Generate with AI"
8. Look at the project history logs for the asset
9. 🔴 [on main] notice that the log contains information about the number
of tokens
10. đŸŸĸ [on PR] the token information is no longer there, but there is a
bedrock request id. also note the model id has not changed

7784 of 11984 branches covered (64.95%)

3 of 4 new or added lines in 3 files covered. (75.0%)

3397 existing lines in 109 files now uncovered.

29622 of 36038 relevant lines covered (82.2%)

5.8 hits per line

Uncovered Changes

Lines Coverage ∆ File
1
66.67
-1.06% kobo/apps/audit_log/models.py

Coverage Regressions

Lines Coverage ∆ File
321
0.0
-90.68% kobo/apps/openrosa/apps/viewer/pandas_mongo_bridge.py
220
44.65
-41.28% kobo/apps/openrosa/libs/utils/logger_tools.py
215
18.97
-52.96% kobo/apps/openrosa/libs/utils/export_tools.py
206
0.0
-86.19% kobo/apps/openrosa/libs/utils/briefcase_client.py
93
33.96
-58.49% kobo/apps/openrosa/apps/api/permissions.py
93
42.11
-48.95% kobo/apps/openrosa/apps/api/viewsets/xform_list_api.py
87
0.0
-87.88% kobo/apps/openrosa/libs/utils/backup_tools.py
86
28.67
-60.14% kobo/apps/openrosa/apps/viewer/views.py
81
33.11
-53.64% kobo/apps/openrosa/apps/api/viewsets/briefcase_api.py
81
0.0
-93.1% kobo/apps/stripe/serializers.py
75
0.0
-41.9% kobo/apps/stripe/views.py
71
33.62
-61.21% kobo/apps/openrosa/libs/filters.py
66
32.23
-54.55% kobo/apps/openrosa/apps/api/viewsets/data_viewset.py
63
0.0
-51.64% kobo/apps/stripe/models.py
60
26.05
-50.42% kobo/apps/stripe/utils/subscription_limits.py
59
46.96
-51.3% kobo/apps/openrosa/apps/api/viewsets/xform_submission_api.py
58
0.0
-90.63% kobo/apps/openrosa/libs/data/query.py
52
34.81
-32.91% kobo/apps/openrosa/apps/api/viewsets/xform_viewset.py
52
61.29
-23.96% kpi/utils/xml.py
50
0.0
-47.17% kobo/apps/openrosa/apps/logger/tasks.py
49
28.57
-43.75% kobo/apps/openrosa/apps/logger/views.py
46
54.92
-37.7% kobo/apps/openrosa/libs/serializers/xform_serializer.py
43
46.1
-15.99% kobo/apps/openrosa/apps/viewer/models/data_dictionary.py
43
57.87
-16.93% kobo/apps/openrosa/apps/viewer/models/parsed_instance.py
41
23.29
-56.16% kobo/apps/openrosa/libs/utils/image_tools.py
40
0.0
-40.82% kobo/apps/openrosa/apps/viewer/xls_writer.py
39
23.08
-30.0% kobo/apps/openrosa/apps/viewer/tasks.py
37
59.54
-28.24% kobo/apps/openrosa/apps/logger/signals.py
37
32.97
-40.66% kobo/apps/openrosa/libs/serializers/metadata_serializer.py
36
24.49
-73.47% kobo/apps/openrosa/apps/logger/import_tools.py
36
55.29
-42.35% kobo/apps/openrosa/libs/renderers/renderers.py
36
20.21
-38.3% kobo/apps/stripe/utils/billing_dates.py
34
37.96
-31.48% kobo/apps/openrosa/apps/logger/utils/instance.py
33
49.51
-32.04% kobo/apps/openrosa/apps/viewer/models/export.py
30
0.0
-75.0% kobo/apps/openrosa/apps/django_digest_backends/cache.py
29
40.48
-17.26% kobo/apps/openrosa/apps/main/models/meta_data.py
29
30.14
-19.86% kobo/apps/openrosa/libs/utils/viewer_tools.py
28
41.27
-44.44% kobo/apps/openrosa/libs/serializers/data_serializer.py
27
34.0
-54.0% kobo/apps/data_collectors/authentication.py
27
49.06
-50.94% kobo/apps/openrosa/libs/serializers/attachment_serializer.py
26
35.71
-61.9% kobo/apps/openrosa/libs/mixins/labels_mixin.py
26
27.78
-72.22% kobo/apps/openrosa/libs/utils/decorators.py
23
55.46
-19.33% kobo/apps/openrosa/apps/logger/models/attachment.py
20
29.67
-21.98% kobo/apps/openrosa/libs/utils/user_auth.py
19
51.22
-23.17% kobo/apps/accounts/mfa/views.py
19
16.0
-76.0% kobo/apps/openrosa/apps/api/utils/xml.py
19
0.0
-65.52% kobo/apps/stripe/admin.py
19
38.24
-55.88% kpi/parsers.py
17
16.22
-45.95% kobo/apps/openrosa/apps/logger/utils/database_query.py
17
81.18
-6.67% kobo/apps/openrosa/apps/logger/xform_instance_parser.py
16
0.0
-43.24% kobo/apps/accounts/mfa/adapter.py
15
31.71
-36.59% kobo/apps/openrosa/apps/logger/xform_fs.py
15
41.94
-48.39% kobo/apps/openrosa/libs/authentication.py
15
34.78
-65.22% kobo/apps/openrosa/libs/models/signals.py
14
44.0
-56.0% kobo/apps/openrosa/libs/utils/model_tools.py
14
31.82
-31.82% kobo/apps/stripe/utils/limit_enforcement.py
13
75.39
-6.81% kobo/apps/openrosa/apps/logger/models/xform.py
13
62.82
-16.67% kpi/authentication.py
12
28.57
-28.57% kobo/apps/accounts/mfa/flows.py
12
76.02
-6.12% kobo/apps/openrosa/apps/logger/models/instance.py
12
44.9
-24.49% kobo/apps/openrosa/apps/logger/utils/counters.py
12
70.0
-30.0% kobo/apps/openrosa/libs/serializers/user_profile_serializer.py
12
35.0
-60.0% kobo/apps/stripe/utils/import_management.py
11
62.5
-34.38% kobo/apps/openrosa/apps/api/viewsets/attachment_viewset.py
11
0.0
-44.0% kobo/apps/stripe/signals.py
10
58.33
-41.67% kobo/apps/openrosa/apps/api/viewsets/note_viewset.py
10
30.12
-12.05% kpi/utils/storage.py
9
57.69
-11.54% kobo/apps/accounts/mfa/models.py
9
30.56
-8.33% kobo/apps/openrosa/apps/api/tools.py
9
62.07
-31.03% kobo/apps/openrosa/apps/api/viewsets/metadata_viewset.py
9
57.45
-9.57% kobo/apps/openrosa/libs/utils/middleware.py
8
0.0
-100.0% kobo/apps/stripe/urls.py
7
31.25
-43.75% kobo/apps/openrosa/libs/utils/string.py
7
0.0
-100.0% kobo/apps/stripe/apps.py
6
66.67
-28.57% kobo/apps/openrosa/apps/api/viewsets/connect_viewset.py
6
69.57
-26.09% kobo/apps/openrosa/libs/permissions.py
6
0.0
-37.5% kobo/apps/stripe/utils/view_utils.py
6
0.0
-100.0% kobo/conftest.py
5
66.67
-1.06% kobo/apps/audit_log/models.py
5
72.22
-27.78% kobo/apps/openrosa/apps/logger/models/daily_xform_submission_counter.py
5
75.0
-25.0% kobo/apps/openrosa/apps/logger/models/monthly_xform_submission_counter.py
5
0.0
-38.46% kobo/apps/openrosa/apps/main/context_processors.py
5
50.0
-50.0% kobo/apps/openrosa/libs/mixins/openrosa_headers_mixin.py
5
66.67
-33.33% kobo/apps/openrosa/libs/serializers/note_serializer.py
4
69.23
-30.77% kobo/apps/accounts/mfa/permissions.py
4
63.33
-6.67% kobo/apps/openrosa/apps/main/models/user_profile.py
4
45.45
-36.36% kobo/apps/openrosa/koboform/__init__.py
4
75.12
-1.95% kpi/utils/mongo_helper.py
3
85.71
-6.12% kobo/apps/openrosa/apps/logger/exceptions.py
3
80.0
-20.0% kobo/apps/openrosa/apps/viewer/signals.py
3
50.0
-37.5% kobo/apps/openrosa/libs/mixins/anonymous_user_public_forms_mixin.py
3
46.67
-20.0% kobo/apps/openrosa/libs/serializers/tag_list_serializer.py
3
61.21
-1.82% kobo/apps/organizations/models.py
3
60.53
-7.89% kobo/apps/organizations/utils.py
2
90.8
-2.3% kobo/apps/audit_log/signals.py
2
76.6
-4.26% kobo/apps/kobo_auth/models.py
2
61.54
-15.38% kobo/apps/openrosa/libs/utils/gravatar.py
2
82.14
-7.14% kobo/urls.py
2
80.0
-20.0% kpi/mixins/mfa.py
1
0.0
-100.0% kobo/apps/openrosa/apps/logger/constants.py
1
75.0
-25.0% kobo/apps/openrosa/libs/utils/storage.py
1
40.85
-1.41% kobo/apps/organizations/admin/organization.py
1
31.58
-0.56% kobo/apps/subsequences/actions/automatic_bedrock_qual.py
1
92.31
-7.69% kobo/apps/user_reports/utils/migrations.py
1
93.02
-2.33% kpi/backends.py
1
50.7
-0.47% kpi/renderers.py
1
85.0
-5.0% kpi/urls/__init__.py
1
75.0
-6.25% kpi/utils/drf_exceptions.py
1
86.67
-0.95% kpi/utils/object_permission.py
Jobs
ID Job ID Ran Files Coverage
1 23757408200.1 30 Mar 2026 05:11PM UTC 905
52.84
2 23757408200.2 30 Mar 2026 05:12PM UTC 905
54.37
3 23757408200.3 30 Mar 2026 05:13PM UTC 907
55.61
4 23757408200.4 30 Mar 2026 05:13PM UTC 905
53.07
5 23757408200.5 30 Mar 2026 05:13PM UTC 905
60.48
6 23757408200.6 30 Mar 2026 05:14PM UTC 907
66.01
7 23757408200.7 30 Mar 2026 05:15PM UTC 907
61.62
8 23757408200.8 30 Mar 2026 05:16PM UTC 907
54.42
9 23757408200.9 30 Mar 2026 05:18PM UTC 909
68.25
10 23757408200.10 30 Mar 2026 05:44PM UTC 907
54.06
Source Files on build 23757408200
  • Tree
  • List 909
  • Changed 4
  • Source Changed 0
  • Coverage Changed 4
Coverage ∆ File Lines Relevant Covered Missed Hits/Line Branch Hits Branch Misses
  • Back to Repo
  • b6617be5 on github
  • Prev Build on main (#23755938562)
  • Next Build on main (#23791305778)
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2026 Coveralls, Inc