kobotoolbox / kpi / 19918137817

81%

master: 76%

push

github

feat(exports): remove synchronous exports older than `EXPORT_CLEANUP_GRACE_PERIOD` DEV-1372 (#6515)

### 📣 Summary
Automatically removes old synchronous exports to prevent outdated files
from being accessible and to keep storage usage under control.


### 📖 Description
Synchronous exports are now cleaned up automatically after they expire.
A new recurring background task `cleanup_synchronous_exports` deletes
export files and their corresponding records once they are older than
the value defined in `EXPORT_CLEANUP_GRACE_PERIOD` (configured in
Constance, default: 30 minutes).

To ensure system stability, the cleanup runs in small batches of 200
exports per execution and uses a distributed lock to prevent multiple
workers from deleting the same exports simultaneously. This keeps
storage usage under control and prevents outdated export files from
remaining accessible.

7128 of 11185 branches covered (63.73%)

43 of 47 new or added lines in 3 files covered. (91.49%)

27542 of 33848 relevant lines covered (81.37%)

1.6 hits per line