kobotoolbox / kpi / 15594850539

81%

master: 76%

Build Type

push

github

Committed by web-flow

Commit Message

perf(long-running-migration): make `root_uuid` backfill lighter on memory usage DEV-570 (#5839)

### 📣 Summary
Reduces memory footprint of the root_uuid backfill migration by avoiding
full in-memory loading of submissions.

### 📖 Description
This optimization reduces memory usage during the long-running migration
that backfills the `root_uuid` field on old submissions.

Previously, the process relied on more_itertools.chunked, which forced
all matching submission objects to be loaded in memory before chunking.
This approach caused high memory consumption, especially on large
datasets.

This PR replaces that logic with an iterator-based batching mechanism,
allowing the system to process submissions in smaller, controlled
batches directly from the database without holding the entire queryset
in memory.

Run Details

6082 of 9698 branches covered (62.71%)

0 of 22 new or added lines in 1 file covered. (0.0%)

2 existing lines in 1 file now uncovered.

23080 of 28655 relevant lines covered (80.54%)

0.81 hits per line