MITLibraries / timdex-index-manager / 15448570430

push

github

Add new reindex-source CLI command

Why these changes are being introduced:

Now that the TDA library can yield only the current records for a source from
the parquet dataset, this opens up the opporunity for a fairly simple CLI command
that performs a full refresh of a source in Opensearch using only ETL dataset
data.

This command could be helpful for development, where it would be handy to see
the current state of a source in a local Opensearch instance.  Or, it could be
helpful for disaster recovery where we want to refresh a source in Opensearch
without performing the extract + transform stages again.

How this addresses that need:
* Adds new reindex-source CLI command
  * create new index
  * promote and alias the new index
  * read current records for a source from dataset and bulk index them

Side effects of this change:
* None

Relevant ticket(s):
* https://mitlibraries.atlassian.net/browse/TIMX-495

21 of 23 new or added lines in 1 file covered. (91.3%)

418 of 429 relevant lines covered (97.44%)

0.97 hits per line