kobotoolbox / kpi / 19918137817 / 1

81%

master: 76%

push

github

feat(exports): remove synchronous exports older than `EXPORT_CLEANUP_GRACE_PERIOD` DEV-1372 (#6515)

### 📣 Summary
Automatically removes old synchronous exports to prevent outdated files
from being accessible and to keep storage usage under control.


### 📖 Description
Synchronous exports are now cleaned up automatically after they expire.
A new recurring background task `cleanup_synchronous_exports` deletes
export files and their corresponding records once they are older than
the value defined in `EXPORT_CLEANUP_GRACE_PERIOD` (configured in
Constance, default: 30 minutes).

To ensure system stability, the cleanup runs in small batches of 200
exports per execution and uses a distributed lock to prevent multiple
workers from deleting the same exports simultaneously. This keeps
storage usage under control and prevents outdated export files from
remaining accessible.

6924 of 11235 branches covered (61.63%)

26730 of 33841 relevant lines covered (78.99%)

0.79 hits per line