kobotoolbox / kpi / 19824338077

81%

master: 76%

push

github

feat(exports): add celery task to delete old anonymous exports DEV-1358 (#6509)

### 📣 Summary
Automatically removes old anonymous exports to prevent outdated files
from being accessible and to keep storage usage under control.


### 📖 Description
Anonymous exports are now cleaned up automatically after they expire. A
new recurring background task deletes export files and their
corresponding records once they are older than the value defined in
`ANON_EXPORTS_CLEANUP_AGE` (configured in Constance, default: 30
minutes).

To ensure system stability, the cleanup runs in small batches of 50
exports per execution and uses a distributed lock to prevent multiple
workers from deleting the same exports simultaneously. This keeps
storage usage under control and prevents outdated anonymous export files
from remaining accessible.

Authenticated exports and other project data are not affected.

---------

Co-authored-by: Olivier Léger <olivierleger@gmail.com>

7117 of 11172 branches covered (63.7%)

26 of 30 new or added lines in 1 file covered. (86.67%)

27485 of 33793 relevant lines covered (81.33%)

1.6 hits per line