NL-BioImaging / biomero / 20785332412

push

github

Fix database concurrency conflicts with retry mechanism and enhanced error handling

- Add retry_on_database_conflict decorator with exponential backoff for database operations
- Implement transaction-safe database_transaction context manager with proper rollback
- Apply @retry_on_database_conflict to all WorkflowTracker event sourcing operations
- Add retry protection to view update operations in JobAccounting, WorkflowProgress, and JobProgress
- Enhance EngineManager with robust commit/rollback error handling and safe_commit method
- Add support for EventSourcing-specific exceptions (IntegrityError, OperationalError)
- Implement defensive checks for unknown workflows/tasks in event handlers
- Upgrade error logging from ERROR to WARNING level for retryable conflicts
- Add comprehensive test coverage for retry mechanisms and concurrent access scenarios

This resolves production issues where database unique constraint violations and
deadlocks were causing thread failures and incomplete workflow tracking in
high-concurrency scenarios like batch processing workflows.

105 of 141 new or added lines in 3 files covered. (74.47%)

2896 of 3322 relevant lines covered (87.18%)

0.87 hits per line