MITLibraries / transmogrifier-ab-diff / 11579438090

86%

push

github

Add utility function to parse details from S3 URIs and filenames (#42)

* Add utility function to parse details from S3 URIs and filenames

Why these changes are being introduced:
* Several core functions rely on information about the TIMDEX
"run" details, which appear in the names of files produced
by the "extract" and "transform" steps of the TIMDEX pipeline.
This new util function can be used by core functions as needed,
reducing duplicated code.

How this addresses that need:
* Add util function parse_timdex_filename
* Update run_ab_transforms and collate_ab_transforms to use util
* Use TIMDEX source slug in collated_dataset

Side effects of this change:
* None

Relevant ticket(s):
* https://mitlibraries.atlassian.net/browse/TIMX-380
* https://mitlibraries.atlassian.net/browse/TIMX-365

20 of 22 new or added lines in 3 files covered. (90.91%)

640 of 664 relevant lines covered (96.39%)

0.96 hits per line