MITLibraries / timdex-index-manager / 12932673476

96%

push

github

Add bulk-update command and support for TIMDEX parquet dataset (#359)

Why these changes are being introduced:
* The timdex-index-manager (TIM) app needs to support the v2 parquet dataset,
which now contains records for both indexing and deleting. The new CLI
command performs a "bulk update" given a subset of the dataset
(filtered by 'run_date' and 'run_id') and uses the timdex-dataset-api
library to read records from the TIMDEXDataset.

By introducing a new CLI command, it doesn't require the feature
flagging approach, allowing the existing CLI commands and helper functions
to remain untouched for v1 purposes.

How this addresses that need:
* Implement 'bulk-update' CLI command
* Add unit tests for 'bulk-update'
* Update README

Side effects of this change:
* TIM remains backwards v1 compatible but will now support v2 runs.

Relevant ticket(s):
* https://mitlibraries.atlassian.net/browse/TIMX-428

27 of 27 new or added lines in 1 file covered. (100.0%)

435 of 435 relevant lines covered (100.0%)

1.0 hits per line