DemocracyClub / yournextrepresentative

72%

master: 72%

LAST BUILD ON BRANCH memory-fixes

branch: memory-fixes

CHANGE BRANCH

x

Reset

• memory-fixes
• 2022-leaderboard
• 2022-sopn-tracker
• 2023-leaderboard
• 2024-ge-sopn-dashboard
• 2026-resultsbot
• 20260112-memory
• 20260112-training
• 20260428-homepage-cta
• 20260605-fix-by-election-reasons
• 20261805-fix-by-election-reasons
• add-cloudfront
• add-missing-migrations
• add-previous-party-affiliation-to-api
• add-rekognition-region
• add-results-summary-to-ballot-page
• add-resultset-to-last-updated
• admin-exclude-user-in-photo-mod-list
• admin20260303
• ajax20260302
• api-voting-system-filter
• auto-update-leaderboards
• ballot-based-recently-updated
• ballot-endpoint
• ballot-history20251126
• basic-auth
• beefen20251014
• better-bot-protection
• better-observibility-in-aws
• better-user-signup
• bleach-nh3
• block20250527
• boi-last-update20251126
• bug/hurl_version
• bug/linting
• bug/shellcheck
• bug/task_selection
• bugfix/ballot-lock
• bugfix/ec-id-length
• bugfix/front-page-links
• bugfix/import-emblems
• bugfix/pdf-convert
• bugfix/previous-party-affiliations
• bugfix/results-2022
• bugfix/sopn-parsing
• bugfix/sopn-stats
• by-election-caused-by-new-election
• by-election-reason
• cachecontrol20260929
• cancelled20260505
• candidate-bot-twitter-usernames
• candidatebot-learns-twfy
• catch-bad-postcodes
• catch-base-pdf-exception
• cdn-images
• charismatic-election-dates-util
• ci/hurl-tests
• ci/linting
• ci/prune_old_task_definitions
• ci/test
• ci20250721
• cifail20250611
• clean-person-names
• completeness-per-election
• completeness-performance
• conditional-homepage-cta
• convert-image-from-url-to-png
• count-current-elections-after-check-current
• cron20251113
• csv-filter-on-nuts1
• csv-import-party-desc
• csv-interface-improvements
• csv-maker-updates
• csv_sopns
• cta20260528
• data_exporter
• data_exporter2
• de-duplicate-winners
• death-date-in-csv
• decomisioning20251016
• default-to-textract
• default-winner-count
• delete-google
• delete-orphan-posts
• delete-parsed-people
• dependabot-march
• dependabot/pip/moto-s3--5.0.23
• dependabot/pip/moto-s3--5.0.26
• dependencies-20251217
• deploy-after-tests
• descriptions20260224
• desired-count20251016
• dev20260812
• disable-cron-jobs
• django-q-20250929
• django5-20251105
• djhtml
• docs/env_creation
• docs/running_cdk_tests
• dos-20241113
• duplicates20260716
• duplicates20260805
• ecs-settings20250825
• election-dashboards
• election-ids20260603
• election-page-improvements
• election-sopn-match-indication-in-admin
• election-tts423
• election-view20251120
• email-config
• email-envs20260128
• email-notifiations-on-sopn-change
• embiggen20260330
• example-parl-elections
• exclude-edit-types-from-first-edits
• exclude-parties-from-name-search
• expose-tags-in-api
• faster-images
• favour-parsed-pdfs
• feat/joint-party-command
• feat/more-fields-for-bulk-add-by-party-form
• feat/record-non-fptp-results
• feat/update-party-importer
• feat/update-resultevent-admin
• feature/1373-remove-copyright-middleware
• feature/2024-candidate-ordering
• feature/add-party-nations
• feature/add-turnout-and-spoilt-ballots
• feature/alerting
• feature/aws_exec
• feature/better-number-inputs
• feature/bot-can-import-results
• feature/branch_tests
• feature/candidatebot_import_from_csv_export
• feature/cdk_resource_tagging
• feature/ci-triggers
• feature/container_alerting
• feature/create_staging_env
• feature/delete-results
• feature/django-q2
• feature/easier-for-reviewers
• feature/environment_prevalidation
• feature/handle_deploy_failures
• feature/improve-recent-changes-list
• feature/list-position
• feature/locked-name-edits
• feature/metric_alerting
• feature/parse-textract-results
• feature/person-name-changes
• feature/person-redirect-last-updated-filter
• feature/photo-uploader-updates
• feature/photo-uploader-updates-new
• feature/playwright-frontend-testing
• feature/previous-political-affiliation
• feature/redesign-sopn-models
• feature/remove-dead-person-links
• feature/validate-death-date
• feature/view-parsed-sopn-data
• feature/wikidata-mnis-ids
• filters20260211
• fix-aws-sopn-images
• fix-ballot-last-updated-field
• fix-bulk-add-dynamic-button
• fix-clean-person-identifier-regexes
• fix-container-ci-build
• fix-duplicate-pis-error
• fix-has-resultset-filter
• fix-importer-missing-parent
• fix-migration20250722
• fix-migrations20250721
• fix-moderation-error
• fix-num-forms-with-more-raw-people
• fix-party-importer
• fix-party-pages
• fix-person-name-cleanup-typo
• fix-person-redirect-filter
• fix-primary-image-data-migration
• fix-results-bot-election-ids
• fix-results-filter
• fix-rgba-emblems
• fix-shell-scripts
• fix-sopn-parsing-test
• fix-sopn-stats
• fix-sopn-upload
• fix-sopn-urls
• fix-sopn-viewer
• fix-spaces-in-file-names
• fix-territory
• fix-test-datetime
• fix-versions-error-in-csv-export
• fix-womble-pages
• fix/birth_date_validation
• fix/duplicate-ids-bug
• fix/edit-results
• fix/linkedin-urls
• fix/logged-action-description
• fix/markdown-lists
• fix/remove-add-winner-button-from-cancelled-election
• fix/results-bot-total-electorate
• fix/set_party_lists_in_use
• fix/sopn-uploader-doubled-input-on-click
• fix/stop-email-logging
• fix/sync-GSS-codes
• fix/turnout-percentage-field-type
• fix_build_script
• fixcompose20260304
• fixpdfs20251023
• forms-for-previous-party
• front-page-links
• ge-leaderboard
• gender-winners
• healthcheck20250825
• hide-extra-bulk-adding-rows
• hide-results-link-for-non-fptp
• highlight-withdrawal-cell
• hot-reloads20250827
• hotfix/allow-parliament-emails
• hotfix/anti-vandalism
• hotfix/biography-in-markdown
• hotfix/cronjob-deploy
• hotfix/date-format
• hotfix/deselected-source
• hotfix/disable-may-2024-leaderboard
• hotfix/django-vulnerability
• hotfix/dont-accept-blank-values
• hotfix/downsize-elements
• hotfix/ec-emblem-import
• hotfix/emblem-update
• hotfix/enable-2024-leaderboard
• hotfix/fix-ec-party-importer
• hotfix/fix-person-image-migration
• hotfix/fix-results-header
• hotfix/fix-sopn-dates
• hotfix/fix-surname-parsing
• hotfix/fix-updated-timestamp
• hotfix/image-key-error
• hotfix/import-next-ppcs
• hotfix/known-candidates
• hotfix/mansfield-indie-emblem
• hotfix/mark-elected-when-uncontested
• hotfix/mastodon-serializer
• hotfix/mod-queue-storage-backend
• hotfix/modgov-urls-2023
• hotfix/more-frequent-data-download
• hotfix/more-person-identifiers
• hotfix/more-results-columns
• hotfix/new-tab-for-image-search
• hotfix/new-user-count
• hotfix/next-person-versions-endpoint
• hotfix/notices-for-users
• hotfix/parl-results-progress
• hotfix/party-count
• hotfix/party-emblems
• hotfix/password-reset
• hotfix/person-image-timestamp
• hotfix/photo-key-error
• hotfix/photo-upload-exception
• hotfix/post-sopn-home-page
• hotfix/preserve-transparent-background
• hotfix/record-photo-upload
• hotfix/reduce-scrolling
• hotfix/remote-twitterbot
• hotfix/remove-sopn-tracker
• hotfix/remove-twitter-auth
• hotfix/replace-rotate-buttons
• hotfix/report-a-problem
• hotfix/reset-home-page
• hotfix/results-cta
• hotfix/results-form-audit
• hotfix/results-with-decimals
• hotfix/rotate-photo-form
• hotfix/rotate-photo-key-error
• hotfix/rotate-photos-mgmt-command
• hotfix/round-percentages
• hotfix/set-rank-with-migration
• hotfix/set_frontpage_sopn
• hotfix/slack-notifications
• hotfix/sopn-date-nation
• hotfix/special-character-search
• hotfix/src-files
• hotfix/strip-whitespace-for-name-search
• hotfix/typo
• hotfix/unsupported-lookup-officialdocument
• hotfix/upcase-ec-id
• hotfix/update-sopn-settings
• hotfix/update-sopn-source-url
• hotfix/validate-linkedin
• hotfix/validate-parliament-emails
• hotifx/prevent_duplicate_candidacies
• iain20260223
• ian20260218
• ignore-large-icc-profiles
• imagedelete20260806
• imagespeed20251029
• import-current-statuses
• import-historic-results-data
• issue2783
• jcm/add-local-dev-container-workflows
• jcm/hello-world
• jcm/move-gulp-outside-ynr-dir
• jcm/wip
• joint-parties
• labour-api-import
• last-updated-gte
• last-updated-in-csv
• latest-membership-in-search
• less-web20260217
• link-to-data-exporter
• linkfix20260128
• list-position-on-bulk-add
• locked-filter-on-csv
• locked20260402
• locked20260409
• locksuggest20260402
• login-CAPTCHA
• logs20250919
• long-statement20251125
• longer-auth-tokens
• m1_readme_update
• make-import-sopns
• markdownit20251027
• master
• matt/cdk
• matt/wip
• may-24-polls-close
• may-24-results
• may-25-sopn-day
• merge-and-revert-previous-affiliations
• mhl-dedication
• migrations20250917
• missing-auth20260409
• missing-commit
• missing-last-n-candidates
• missing-migration-dependencies
• mnis-ids-in-csv
• moar-notifications
• moar-web20260216
• moderation20251030
• modgov-results-2022
• modgov-urls
• mop-up-recent-elections
• more-cloudfront-config
• more-csv-fields
• more-modgov-fields
• name-fields-2022
• name-search-improvements
• non-default-honorific
• nplus1-20251029
• nullposition20260402
• numbers-rework
• oct2025fixes
• openai-httpx20260105
• openai20251015
• ordering20260402
• orphanimages20260806
• osa-text
• packages20260331
• page-duplicates
• page-results-atom
• papercuts20250826
• parse-welsh-sopns
• parsing-issue20260303
• parties20260223
• parties_import20260909
• party-description-on-sopn-review
• partydescription-admin
• partylists20260402
• partynames20260219
• partyopts20260219
• pause-new-account-creation
• person-splitting
• photo-upload-refactor
• pis-in-admin
• pmk01-patch-11
• pmk01-patch-12
• pmk01-patch-13
• pmk01-patch-14
• pmk01-patch-15
• pmk01-patch-16
• pmk01-patch-17
• pmk01-patch-18
• pmk01-patch-19
• pmk01-patch-5
• pmk01-patch-6
• pmk01-patch-8
• policy20250925
• post-sopn-refactor-fixes
• post-to-slack-again
• ppa20260505
• prevent-adding-single-candidte-when-sopn-uploaded
• prevent-photo-upload-of-locked-candidate
• prod-arn
• prodenv202508
• pypdf-upgrade20260603
• pytest20250826
• python-3.12
• raise-if-ee-import-fails
• rand20260409
• re-enable-account-creation
• reason-in-sopn-replacement
• remove-black
• remove-bot-workaround
• remove-camelot
• remove-celery
• remove-email-logger
• remove-existing-from-bulk-add-flow
• remove-hustings-cta
• remove-old-csv-from-cron
• remove-orphan-posts
• remove-page-not-found-log
• remove-pi-constraint
• remove-results-csv
• remove-submodules-from-instructions
• remove-twitter-names-for-gdpr
• remove-uk-results-entering-code
• remove-x-ray
• reparse-sopns
• replacements-frontpage20260604
• reports/include-cancelled
• reports/nuts1
• reports/undercontested
• req20260409
• restore-home-page
• result-nplu1-20251127
• result-on-person-serializer
• results-bot-extra-fields
• results-bot-import-by-election-id
• results-bot-skip-tied-votes
• results-button
• results-cta-2025-locals
• results-matching-25
• results-validation20240430
• resultsbot-2026
• rtfm
• ruff-0.15.22
• runserver20250825
• s320250901
• scaledown20251124
• scaledown20251202
• scaledown20260518
• scaleup20260408
• scheduler20250910
• scottish-descriptions20260326
• security-20260414
• security-updates-20260109
• security20251114
• security20260310
• security20260805
• session-length
• settings-from-env
• settings20251020
• shellcheck20250820
• show-all-actions-on-person-page
• silence-xray20251029
• skip-already-found-modgov-urls
• skip-infra-test
• slack-token20251002
• slacktokens20260810
• soft-lock-bulk-adding-flow
• softdelete20251111
• sopn-day-changes
• sopn-indication
• sopn-name1-20260108
• sopn-names-filter20260217
• sopn-names-form20260217
• sopn-names-form20260304
• sopn-pages20260312
• sopn-sheet-for-countries
• sort-name-fix
• sovereignty-party-emblem
• sp-2026-sopn-day
• spike/aws-textract
• stage-cert-arn
• staging
• staging20250922
• statement20260427
• store-other-name-from-bulk-add
• stv-results-link
• subbranch_of_aws_textract
• suggest-lock-improvements
• systempackages20251030
• test-dev-deploy
• test-training20260105
• textract-interface-improvements
• three-way-duplicate-fix
• training-cta20260211
• training-shutdown
• typo_fix
• uk-election-pkgs20241112
• uk-election-timetables-4.2.2
• uncancel20260303
• uncontested-ballot-report
• update-existing-candidates-in-ppc-sheet
• update-party-count-results-tracker
• upgrade-black
• use-db-cache
• username-filter-for-everyone
• users-since-last-election
• uv-9
• uv-cleanup20251113
• uv11-20260721
• uv20251103
• various-small-updates
• verify-bulk-add-delete
• vulns-20263009
• vulns20260203
• vulns20260220
• vulns20260505
• vulns20260702
• vulns20260805
• waf20270727
• wards-contested-per-ward
• watchmedo-ignore-static
• welsh-helpers
• wreq20260403
• zeronone20260519

Build # 1d8e382f-a37d-4055-aa5b-ae8112338520

Build Type

Pull #2802

circleci

Committed by symroe

Commit Message

Convert CSV to streaming response

Claude helped with this, but the CSV was being streamed from Postgres
into Python memory before being sent to the response. This change moves
to streaming each chunk from Postgres into the response, reducing memory
use in containers

Pull Request Pull Request #2802: Memory fixes

Coverage Stats

1483 of 2544 branches covered (58.29%)

Branch coverage included in aggregate %.

8183 of 10791 relevant lines covered (75.83%)

0.76 hits per line