NL-BioImaging / biomero

87%

Build Type

push

github

Committed by TorecLuik

Commit Message

Fix database concurrency conflicts with retry mechanism and enhanced error handling

- Add retry_on_database_conflict decorator with exponential backoff for database operations
- Implement transaction-safe database_transaction context manager with proper rollback
- Apply @retry_on_database_conflict to all WorkflowTracker event sourcing operations
- Add retry protection to view update operations in JobAccounting, WorkflowProgress, and JobProgress
- Enhance EngineManager with robust commit/rollback error handling and safe_commit method
- Add support for EventSourcing-specific exceptions (IntegrityError, OperationalError)
- Implement defensive checks for unknown workflows/tasks in event handlers
- Upgrade error logging from ERROR to WARNING level for retryable conflicts
- Add comprehensive test coverage for retry mechanisms and concurrent access scenarios

This resolves production issues where database unique constraint violations and
deadlocks were causing thread failures and incomplete workflow tracking in
high-concurrency scenarios like batch processing workflows.

Run Details

105 of 141 new or added lines in 3 files covered. (74.47%)

38 existing lines in 2 files now uncovered.

2896 of 3322 relevant lines covered (87.18%)

0.87 hits per line