Unleash / unleash / 32151132818

87%

master: 91%

Build Type

push

github

Committed by web-flow

Commit Message

feat: add resumable scheduled job buckets

## Purpose

Add a generic scheduled-job mode that processes missing time buckets
oldest-first while using the existing jobs table as both the distributed
lock and durable watermark.

This PR introduces and tests the reusable `singleInstanceWithBackfill`
capability, but does not wire it into a production job yet. The next PR
in the stack,
[#1554](https://github.com/bricks-software/unleash-enterprise/pull/1554),
uses it for the existing audit-log S3 uploader before the final PR adds
login-history uploads.

The running state remains `stage = started`. The `lease_expires_at`
column gives that state a recovery deadline, allowing another instance
to reclaim a bucket after an abandoned worker's lease expires.

A permanently failing bucket is retried up to a configurable limit of
five attempts by default. After that it becomes `exhausted`, an error
identifies the skipped job bucket, and catch-up continues so later
buckets are not blocked forever.

## Scope

- Add `singleInstanceWithBackfill` with bounded catch-up per scheduler
run.
- Resume after the latest completed or exhausted bucket.
- Retry failed buckets and expired started buckets.
- Persist attempt counts and stop retrying after `maxAttempts`.
- Log an error before skipping an exhausted bucket.
- Keep first-run behavior configurable through `getInitialDate`.
- Add the generic retry metadata migration and scheduler tests.

Linear: https://linear.app/unleash/issue/EG-4670

Coverage Stats

2012 of 2219 branches covered (90.67%)

65 of 73 new or added lines in 3 files covered. (89.04%)

1 existing line in 1 file now uncovered.

15843 of 18122 relevant lines covered (87.42%)

815.01 hits per line