kobotoolbox / kpi / 19824338077 / 1

81%

master: 76%

push

github

feat(exports): add celery task to delete old anonymous exports DEV-1358 (#6509)

### 📣 Summary
Automatically removes old anonymous exports to prevent outdated files
from being accessible and to keep storage usage under control.


### 📖 Description
Anonymous exports are now cleaned up automatically after they expire. A
new recurring background task deletes export files and their
corresponding records once they are older than the value defined in
`ANON_EXPORTS_CLEANUP_AGE` (configured in Constance, default: 30
minutes).

To ensure system stability, the cleanup runs in small batches of 50
exports per execution and uses a distributed lock to prevent multiple
workers from deleting the same exports simultaneously. This keeps
storage usage under control and prevents outdated anonymous export files
from remaining accessible.

Authenticated exports and other project data are not affected.

---------

Co-authored-by: Olivier Léger <olivierleger@gmail.com>

6913 of 11222 branches covered (61.6%)

26673 of 33786 relevant lines covered (78.95%)

0.79 hits per line