savannahghi / sghi-etl-commons / 12876043604

100%

develop: 100%

push

github

feat(utils): add retrying support when running workflows

Enhance the `sghi.etl.commons.run_workflow` function to support retrying
ETL operations. The function now accepts an optional factory function that
supplies retry policy instances to apply to each of the following
operations:

- `prologue`
- `epilogue`
- `Source.draw`
- `Processor.apply`
- `Sink.drain`

The factory function(when provided) is invoked at *MOST ONCE* for each of
the above operations (and in the same order) to supply an `sghi.retry.Retry`
instance that wraps the operation.

24 of 24 branches covered (100.0%)

Branch coverage included in aggregate %.

14 of 14 new or added lines in 1 file covered. (100.0%)

836 of 836 relevant lines covered (100.0%)

1.0 hits per line