source-academy / backend

87%

master: 87%

LAST BUILD ON BRANCH fix-flaky-submission-sort-test

branch: SELECT

CHANGE BRANCH

x

• No branch selected
• access-token-bugfix
• ai-tests-for-pr1238-1761885873
• assessment-finish-submit
• conductor-assessments
• copilot/fix-1285
• dependabot/hex/bamboo-2.4.0
• dependabot/hex/bamboo-2.5.0
• dependabot/hex/bamboo_ses-0.4.6
• dependabot/hex/bamboo_ses-0.4.7
• dependabot/hex/credo-1.7.13
• dependabot/hex/csv-3.2.2
• dependabot/hex/dialyxir-1.4.6
• dependabot/hex/dialyxir-1.4.7
• dependabot/hex/ex_aws-2.5.8
• dependabot/hex/ex_aws-2.5.9
• dependabot/hex/ex_aws_s3-2.5.2
• dependabot/hex/excoveralls-0.18.4
• dependabot/hex/excoveralls-0.18.5
• dependabot/hex/exvcr-0.16.0
• dependabot/hex/git_hooks-0.8.0
• dependabot/hex/git_hooks-0.8.1
• dependabot/hex/guardian-2.4.0
• dependabot/hex/hackney-1.22.0
• dependabot/hex/hackney-1.23.0
• dependabot/hex/hackney-1.25.0
• dependabot/hex/httpoison-2.3.0
• dependabot/hex/inch_ex-2.1.0
• dependabot/hex/mock-0.3.9
• dependabot/hex/openid_connect-1.0.0
• dependabot/hex/openid_connect-1.0.1
• dependabot/hex/phoenix-1.7.18
• dependabot/hex/phoenix-1.7.19
• dependabot/hex/phoenix-1.7.20
• dependabot/hex/phoenix-1.7.21
• dependabot/hex/phoenix-1.8.1
• dependabot/hex/phoenix-1.8.2
• dependabot/hex/phoenix-1.8.3
• dependabot/hex/phoenix_ecto-4.6.5
• dependabot/hex/phoenix_ecto-4.7.0
• dependabot/hex/phoenix_html-4.2.0
• dependabot/hex/phoenix_html-4.3.0
• dependabot/hex/plug_cowboy-2.7.3
• dependabot/hex/plug_cowboy-2.7.4
• dependabot/hex/plug_cowboy-2.7.5
• dependabot/hex/postgrex-0.20.0
• dependabot/hex/postgrex-0.21.0
• dependabot/hex/postgrex-0.21.1
• dependabot/hex/postgrex-0.22.0
• dependabot/hex/recase-0.9.0
• dependabot/hex/recase-0.9.1
• dependabot/hex/sentry-10.10.0
• dependabot/hex/sentry-10.8.1
• dependabot/hex/sentry-11.0.0
• dependabot/hex/sentry-11.0.1
• dependabot/hex/sentry-11.0.2
• dependabot/hex/sentry-11.0.4
• dependabot/hex/sweet_xml-0.7.5
• dependabot/hex/timex-3.7.13
• dependabot/hex/xml_builder-2.4.0
• deps-big-bang-2026
• elixir-119
• exam_mode
• feat/add-AI-generated-comments-grading
• feat/ai-comment-workflow
• feat/assessment-level-language-config
• feat/upgrade-logger
• feature/chatbot-one-conversation-per-user
• feature/louis
• feature/public-louis
• filter-team-formation-list
• fix-course-creation-500
• fix-flaky-submission-sort-test
• fix-idor
• fix-issues-with-bonus-xp
• fix-seeding
• fix/compile-env
• fix/logstream-creation
• hardened-mode
• isha
• language-options
• leaderboard
• leaderboard-fix
• leaderboard-fix2
• leaderboard-refactor
• logging-answer-deploy
• master
• notebooks
• nus-entra-id
• payload_size_limit
• remove-sourcecast-sourcereel
• renovate/actions-cache-5.x
• renovate/actions-cache-6.x
• renovate/actions-checkout-7.x
• renovate/aws-3.x-lockfile
• renovate/aws-6.x
• renovate/bamboo_ses-0.x
• renovate/elixir-1.x
• renovate/erlang-28.x
• renovate/erlang-29.x
• renovate/ex_json_schema-0.x
• renovate/meck-1.x
• renovate/openid_connect-1.x
• renovate/postgres-18.x
• renovate/random-3.x-lockfile
• renovate/rlespinasse-github-slug-action-3.x
• renovate/rlespinasse-github-slug-action-5.x
• renovate/sentry-12.x
• renovate/sentry-13.x
• revert-1271-master
• timer-feature
• upgrade-ci-version
• upgrade-version
• versions-feature
• vscode/auth
• warnings

Build # 7b04348c7a3ec3dc6cbc18510a9f96868c3fa796-PR-1378

Build Type

Pull #1378

github

Committed by RichDom2185

Commit Message

test(assessments): fix flaky title-sort tests via DB collation

The submissions_by_grader_for_index title-sort tests re-checked ordering
with Elixir's binary string comparison, but the query sorts by
`upper(title)` using PostgreSQL's locale collation. The two disagree on
how spaces and punctuation sort relative to letters, so the randomly
generated Hamlet-quote titles intermittently failed the assertion
(e.g. "I will speak daggers to her, but use none." vs "In my mind's eye.").

Assert the returned order against the database's own sort of the same
titles instead, comparing `upper(title)` on both sides so the check is
deterministic and consistent with the query under any collation.

Pull Request Pull Request #1378: test(assessments): fix flaky title-sort tests via DB collation

Coverage Stats

3997 of 4569 relevant lines covered (87.48%)

6891.53 hits per line