• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

MITLibraries / timdex-index-manager
97%
main: 96%

Build:
Build:
LAST BUILD BRANCH: v2.7
DEFAULT BRANCH: main
Repo Added 19 Jul 2022 07:05PM UTC
Token 5qAg98sTDIQMJOXYyoMhMvsVbuhbR670B regen
Build 507 Last
Files 5
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

LAST BUILD ON BRANCH TIMX-495-full-reindex-cli-command
branch: TIMX-495-full-reindex-cli-command
CHANGE BRANCH
x
Reset
Sync Branches
  • TIMX-495-full-reindex-cli-command
  • 2025-09-04-update-tda-version
  • GDT-138-update-tim-mapping-to-enable-access-filter
  • GDT-209-add-provider-field
  • GDT-211-publishers-mapping
  • GDT-92-geo-sources
  • TIMX-181-multiple-date-range-fix
  • TIMX-187-index-shard-settings
  • TIMX-227-springshare-sources
  • TIMX-410-provenance-mappings
  • TIMX-428-add-bulk-update-cli-cmd
  • TIMX-459-update-logging
  • TIMX-468-update-tda-version
  • TIMX-491-remove-parquet-feature-flags
  • TIMX-496-update-tda
  • TIMX-536-537
  • USE-102-mitlibwebsite-valid-source
  • USE-122-remove-test-code
  • USE-122-scaffold-add-embeddings-to-existing-documents
  • USE-181-read-embeddings-with-tda
  • USE-257-fulltext
  • USE-273-bulk-update-embeddings-use-metadata
  • USE-306-bump-tda-version
  • add-alma-source
  • add-shard-info
  • add-shard-info-and-console
  • debug_console
  • dependabot-update
  • dependabot/docker/python-3.12-slim
  • dependabot/pip/bandit-1.7.5
  • dependabot/pip/black-22.10.0
  • dependabot/pip/black-22.12.0
  • dependabot/pip/black-22.8.0
  • dependabot/pip/black-23.1.0
  • dependabot/pip/black-23.3.0
  • dependabot/pip/black-24.3.0
  • dependabot/pip/black-24.4.0
  • dependabot/pip/black-24.4.2
  • dependabot/pip/boto3-1.24.55
  • dependabot/pip/boto3-1.24.56
  • dependabot/pip/boto3-1.24.57
  • dependabot/pip/boto3-1.24.58
  • dependabot/pip/boto3-1.24.61
  • dependabot/pip/boto3-1.24.62
  • dependabot/pip/boto3-1.24.64
  • dependabot/pip/boto3-1.24.65
  • dependabot/pip/boto3-1.24.66
  • dependabot/pip/boto3-1.24.67
  • dependabot/pip/boto3-1.24.68
  • dependabot/pip/boto3-1.24.69
  • dependabot/pip/boto3-1.24.70
  • dependabot/pip/boto3-1.24.71
  • dependabot/pip/boto3-1.24.72
  • dependabot/pip/boto3-1.24.73
  • dependabot/pip/boto3-1.24.74
  • dependabot/pip/boto3-1.24.75
  • dependabot/pip/boto3-1.24.76
  • dependabot/pip/boto3-1.24.77
  • dependabot/pip/boto3-1.24.78
  • dependabot/pip/boto3-1.24.79
  • dependabot/pip/boto3-1.24.81
  • dependabot/pip/boto3-1.24.82
  • dependabot/pip/boto3-1.24.83
  • dependabot/pip/boto3-1.24.84
  • dependabot/pip/boto3-1.24.85
  • dependabot/pip/boto3-1.24.86
  • dependabot/pip/boto3-1.24.87
  • dependabot/pip/boto3-1.24.88
  • dependabot/pip/boto3-1.24.89
  • dependabot/pip/boto3-1.24.91
  • dependabot/pip/boto3-1.24.92
  • dependabot/pip/boto3-1.24.94
  • dependabot/pip/boto3-1.24.95
  • dependabot/pip/boto3-1.25.0
  • dependabot/pip/boto3-1.25.2
  • dependabot/pip/boto3-1.25.3
  • dependabot/pip/boto3-1.25.4
  • dependabot/pip/boto3-1.25.5
  • dependabot/pip/boto3-1.26.0
  • dependabot/pip/boto3-1.26.1
  • dependabot/pip/boto3-1.26.10
  • dependabot/pip/boto3-1.26.101
  • dependabot/pip/boto3-1.26.102
  • dependabot/pip/boto3-1.26.104
  • dependabot/pip/boto3-1.26.105
  • dependabot/pip/boto3-1.26.106
  • dependabot/pip/boto3-1.26.107
  • dependabot/pip/boto3-1.26.108
  • dependabot/pip/boto3-1.26.109
  • dependabot/pip/boto3-1.26.11
  • dependabot/pip/boto3-1.26.110
  • dependabot/pip/boto3-1.26.114
  • dependabot/pip/boto3-1.26.118
  • dependabot/pip/boto3-1.26.12
  • dependabot/pip/boto3-1.26.123
  • dependabot/pip/boto3-1.26.129
  • dependabot/pip/boto3-1.26.13
  • dependabot/pip/boto3-1.26.133
  • dependabot/pip/boto3-1.26.137
  • dependabot/pip/boto3-1.26.142
  • dependabot/pip/boto3-1.26.146
  • dependabot/pip/boto3-1.26.15
  • dependabot/pip/boto3-1.26.151
  • dependabot/pip/boto3-1.26.155
  • dependabot/pip/boto3-1.26.16
  • dependabot/pip/boto3-1.26.160
  • dependabot/pip/boto3-1.26.165
  • dependabot/pip/boto3-1.26.17
  • dependabot/pip/boto3-1.26.18
  • dependabot/pip/boto3-1.26.19
  • dependabot/pip/boto3-1.26.20
  • dependabot/pip/boto3-1.26.21
  • dependabot/pip/boto3-1.26.22
  • dependabot/pip/boto3-1.26.23
  • dependabot/pip/boto3-1.26.24
  • dependabot/pip/boto3-1.26.25
  • dependabot/pip/boto3-1.26.26
  • dependabot/pip/boto3-1.26.27
  • dependabot/pip/boto3-1.26.28
  • dependabot/pip/boto3-1.26.29
  • dependabot/pip/boto3-1.26.30
  • dependabot/pip/boto3-1.26.31
  • dependabot/pip/boto3-1.26.32
  • dependabot/pip/boto3-1.26.34
  • dependabot/pip/boto3-1.26.35
  • dependabot/pip/boto3-1.26.36
  • dependabot/pip/boto3-1.26.37
  • dependabot/pip/boto3-1.26.38
  • dependabot/pip/boto3-1.26.39
  • dependabot/pip/boto3-1.26.4
  • dependabot/pip/boto3-1.26.40
  • dependabot/pip/boto3-1.26.41
  • dependabot/pip/boto3-1.26.42
  • dependabot/pip/boto3-1.26.43
  • dependabot/pip/boto3-1.26.44
  • dependabot/pip/boto3-1.26.45
  • dependabot/pip/boto3-1.26.46
  • dependabot/pip/boto3-1.26.47
  • dependabot/pip/boto3-1.26.49
  • dependabot/pip/boto3-1.26.5
  • dependabot/pip/boto3-1.26.50
  • dependabot/pip/boto3-1.26.51
  • dependabot/pip/boto3-1.26.52
  • dependabot/pip/boto3-1.26.53
  • dependabot/pip/boto3-1.26.54
  • dependabot/pip/boto3-1.26.55
  • dependabot/pip/boto3-1.26.56
  • dependabot/pip/boto3-1.26.57
  • dependabot/pip/boto3-1.26.58
  • dependabot/pip/boto3-1.26.59
  • dependabot/pip/boto3-1.26.6
  • dependabot/pip/boto3-1.26.60
  • dependabot/pip/boto3-1.26.61
  • dependabot/pip/boto3-1.26.62
  • dependabot/pip/boto3-1.26.63
  • dependabot/pip/boto3-1.26.64
  • dependabot/pip/boto3-1.26.65
  • dependabot/pip/boto3-1.26.66
  • dependabot/pip/boto3-1.26.67
  • dependabot/pip/boto3-1.26.68
  • dependabot/pip/boto3-1.26.69
  • dependabot/pip/boto3-1.26.7
  • dependabot/pip/boto3-1.26.70
  • dependabot/pip/boto3-1.26.71
  • dependabot/pip/boto3-1.26.72
  • dependabot/pip/boto3-1.26.73
  • dependabot/pip/boto3-1.26.74
  • dependabot/pip/boto3-1.26.75
  • dependabot/pip/boto3-1.26.77
  • dependabot/pip/boto3-1.26.78
  • dependabot/pip/boto3-1.26.79
  • dependabot/pip/boto3-1.26.8
  • dependabot/pip/boto3-1.26.80
  • dependabot/pip/boto3-1.26.81
  • dependabot/pip/boto3-1.26.82
  • dependabot/pip/boto3-1.26.83
  • dependabot/pip/boto3-1.26.84
  • dependabot/pip/boto3-1.26.85
  • dependabot/pip/boto3-1.26.86
  • dependabot/pip/boto3-1.26.88
  • dependabot/pip/boto3-1.26.89
  • dependabot/pip/boto3-1.26.9
  • dependabot/pip/boto3-1.26.90
  • dependabot/pip/boto3-1.26.91
  • dependabot/pip/boto3-1.26.92
  • dependabot/pip/boto3-1.26.93
  • dependabot/pip/boto3-1.26.94
  • dependabot/pip/boto3-1.26.95
  • dependabot/pip/boto3-1.26.96
  • dependabot/pip/boto3-1.26.97
  • dependabot/pip/boto3-1.26.98
  • dependabot/pip/boto3-1.26.99
  • dependabot/pip/boto3-1.28.1
  • dependabot/pip/boto3-stubs-1.26.101
  • dependabot/pip/boto3-stubs-1.26.102
  • dependabot/pip/boto3-stubs-1.26.103
  • dependabot/pip/boto3-stubs-1.26.103.post1
  • dependabot/pip/boto3-stubs-1.26.104
  • dependabot/pip/boto3-stubs-1.26.105
  • dependabot/pip/boto3-stubs-1.26.106
  • dependabot/pip/boto3-stubs-1.26.107
  • dependabot/pip/boto3-stubs-1.26.108
  • dependabot/pip/boto3-stubs-1.26.109
  • dependabot/pip/boto3-stubs-1.26.110
  • dependabot/pip/boto3-stubs-1.26.114
  • dependabot/pip/boto3-stubs-1.26.118
  • dependabot/pip/boto3-stubs-1.26.123
  • dependabot/pip/boto3-stubs-1.26.129
  • dependabot/pip/boto3-stubs-1.26.133
  • dependabot/pip/boto3-stubs-1.26.137
  • dependabot/pip/boto3-stubs-1.26.142
  • dependabot/pip/boto3-stubs-1.26.146
  • dependabot/pip/boto3-stubs-1.26.151
  • dependabot/pip/boto3-stubs-1.26.155
  • dependabot/pip/boto3-stubs-1.26.160
  • dependabot/pip/boto3-stubs-1.26.165
  • dependabot/pip/boto3-stubs-1.26.84
  • dependabot/pip/boto3-stubs-1.26.85
  • dependabot/pip/boto3-stubs-1.26.86
  • dependabot/pip/boto3-stubs-1.26.88
  • dependabot/pip/boto3-stubs-1.26.89
  • dependabot/pip/boto3-stubs-1.26.90
  • dependabot/pip/boto3-stubs-1.26.91
  • dependabot/pip/boto3-stubs-1.26.92
  • dependabot/pip/boto3-stubs-1.26.93
  • dependabot/pip/boto3-stubs-1.26.94
  • dependabot/pip/boto3-stubs-1.26.95
  • dependabot/pip/boto3-stubs-1.26.96
  • dependabot/pip/boto3-stubs-1.26.97.post1
  • dependabot/pip/boto3-stubs-1.26.98
  • dependabot/pip/boto3-stubs-1.26.99
  • dependabot/pip/boto3-stubs-1.28.1
  • dependabot/pip/boto3-stubs-1.34.103
  • dependabot/pip/boto3-stubs-1.34.108
  • dependabot/pip/boto3-stubs-1.34.113
  • dependabot/pip/boto3-stubs-1.34.117
  • dependabot/pip/boto3-stubs-1.34.122
  • dependabot/pip/boto3-stubs-1.34.64
  • dependabot/pip/boto3-stubs-1.34.69
  • dependabot/pip/boto3-stubs-1.34.74
  • dependabot/pip/boto3-stubs-1.34.79
  • dependabot/pip/boto3-stubs-1.34.84
  • dependabot/pip/boto3-stubs-1.34.88
  • dependabot/pip/boto3-stubs-1.34.93
  • dependabot/pip/boto3-stubs-1.34.98
  • dependabot/pip/coverage-6.5.0
  • dependabot/pip/idna-3.7
  • dependabot/pip/ijson-3.2.0.post0
  • dependabot/pip/markdown-it-py-2.2.0
  • dependabot/pip/mypy-0.981
  • dependabot/pip/mypy-0.982
  • dependabot/pip/mypy-0.990
  • dependabot/pip/mypy-0.991
  • dependabot/pip/mypy-1.0.0
  • dependabot/pip/mypy-1.0.1
  • dependabot/pip/mypy-1.1.1
  • dependabot/pip/mypy-1.2.0
  • dependabot/pip/mypy-1.3.0
  • dependabot/pip/mypy-1.4.1
  • dependabot/pip/opensearch-py-2.0.1
  • dependabot/pip/opensearch-py-2.1.1
  • dependabot/pip/pydocstyle-6.3.0
  • dependabot/pip/pylama-8.4.1
  • dependabot/pip/pytest-7.1.3
  • dependabot/pip/pytest-7.2.0
  • dependabot/pip/pytest-7.2.1
  • dependabot/pip/pytest-7.2.2
  • dependabot/pip/pytest-7.3.0
  • dependabot/pip/pytest-7.3.1
  • dependabot/pip/pytest-7.3.2
  • dependabot/pip/pytest-7.4.0
  • dependabot/pip/requests-2.31.0
  • dependabot/pip/requests-2.32.0
  • dependabot/pip/rich-click-1.6.0
  • dependabot/pip/rich-click-1.6.1
  • dependabot/pip/rich-click-1.7.4
  • dependabot/pip/rich-click-1.8.0
  • dependabot/pip/rich-click-1.8.1
  • dependabot/pip/rich-click-1.8.2
  • dependabot/pip/rich-click-1.8.3
  • dependabot/pip/ruff-0.3.3
  • dependabot/pip/ruff-0.3.4
  • dependabot/pip/ruff-0.3.5
  • dependabot/pip/ruff-0.3.7
  • dependabot/pip/ruff-0.4.1
  • dependabot/pip/ruff-0.4.2
  • dependabot/pip/ruff-0.4.3
  • dependabot/pip/ruff-0.4.4
  • dependabot/pip/ruff-0.4.5
  • dependabot/pip/ruff-0.4.7
  • dependabot/pip/ruff-0.4.8
  • dependabot/pip/sentry-sdk-1.10.0
  • dependabot/pip/sentry-sdk-1.10.1
  • dependabot/pip/sentry-sdk-1.11.0
  • dependabot/pip/sentry-sdk-1.11.1
  • dependabot/pip/sentry-sdk-1.12.0
  • dependabot/pip/sentry-sdk-1.12.1
  • dependabot/pip/sentry-sdk-1.13.0
  • dependabot/pip/sentry-sdk-1.14.0
  • dependabot/pip/sentry-sdk-1.16.0
  • dependabot/pip/sentry-sdk-1.17.0
  • dependabot/pip/sentry-sdk-1.18.0
  • dependabot/pip/sentry-sdk-1.19.0
  • dependabot/pip/sentry-sdk-1.19.1
  • dependabot/pip/sentry-sdk-1.20.0
  • dependabot/pip/sentry-sdk-1.21.1
  • dependabot/pip/sentry-sdk-1.22.2
  • dependabot/pip/sentry-sdk-1.23.0
  • dependabot/pip/sentry-sdk-1.23.1
  • dependabot/pip/sentry-sdk-1.24.0
  • dependabot/pip/sentry-sdk-1.25.0
  • dependabot/pip/sentry-sdk-1.25.1
  • dependabot/pip/sentry-sdk-1.26.0
  • dependabot/pip/sentry-sdk-1.28.0
  • dependabot/pip/sentry-sdk-1.42.0
  • dependabot/pip/sentry-sdk-1.43.0
  • dependabot/pip/sentry-sdk-1.44.0
  • dependabot/pip/sentry-sdk-1.44.1
  • dependabot/pip/sentry-sdk-1.45.0
  • dependabot/pip/sentry-sdk-1.8.0
  • dependabot/pip/sentry-sdk-1.9.0
  • dependabot/pip/sentry-sdk-1.9.10
  • dependabot/pip/sentry-sdk-1.9.7
  • dependabot/pip/sentry-sdk-1.9.8
  • dependabot/pip/sentry-sdk-1.9.9
  • dependabot/pip/sentry-sdk-2.0.1
  • dependabot/pip/sentry-sdk-2.1.1
  • dependabot/pip/sentry-sdk-2.2.0
  • dependabot/pip/sentry-sdk-2.3.1
  • dependabot/pip/sentry-sdk-2.5.1
  • dependabot/pip/smart-open-6.2.0
  • dependabot/pip/smart-open-6.3.0
  • dependabot/pip/vcrpy-4.2.1
  • dependency-updates
  • expand-local-hosts
  • gdt-116-update-location-field
  • increase-timeout
  • main
  • maintenance-10-2024
  • maintenance-updates
  • opensearch-dashboard
  • rdi-124-stub-cli-commands
  • rdi-211-initial-app-setup
  • rdi-217-deploy-workflows
  • rdi-217-initial-infrastructure
  • refactor-and-cleanup
  • refs/heads/dependabot/pip/boto3-1.26.142
  • refs/heads/dependabot/pip/boto3-stubs-1.26.142
  • refs/heads/dependabot/pip/sentry-sdk-1.24.0
  • refs/tags/v.1.4.0
  • refs/tags/v1.0
  • refs/tags/v1.0.1
  • refs/tags/v1.1.0
  • refs/tags/v1.1.1
  • refs/tags/v1.2.1
  • refs/tags/v1.3.0
  • stop-indexing-for-unexpected-errors
  • timx-110-split-ingest-command
  • timx-128-update-config
  • timx-137-update-timeout-config
  • timx-143-add-bulk-delete
  • timx-72-implement-ping-command
  • timx-74-implement-indexes-command
  • timx-75-implement-aliases-command
  • timx-76-implement-ingest-command
  • timx-77-implement-promote-command
  • timx-79-implement-delete-command
  • timx-80-add-demote-command
  • update-caller-workflows
  • update-dependencies-2025-10-22
  • update-env-variable-name
  • v.1.4.1
  • v2.0
  • v2.1
  • v2.2
  • v2.3
  • v2.4
  • v2.5
  • v2.6
  • v2.7

06 Jun 2025 12:53PM UTC coverage: 97.436% (-0.3%) from 97.783%
15491041464

Pull #365

github

ghukill
Add new reindex-source CLI command

Why these changes are being introduced:

Now that the TDA library can yield only the current records for a source from
the parquet dataset, this opens up the opporunity for a fairly simple CLI command
that performs a full refresh of a source in Opensearch using data already present
in the ETL dataset data, no extract or transform work is required.

This command could be helpful for development, where it would be handy to see
the current state of a source in a local Opensearch instance.  Or, it could be
helpful for disaster recovery where we want to refresh a source in Opensearch
without performing the extract + transform stages again.

How this addresses that need:
* Adds new reindex-source CLI command
  * create new index
  * promote and alias the new index
  * read current records for a source from dataset and bulk index them

Side effects of this change:
* None

Relevant ticket(s):
* https://mitlibraries.atlassian.net/browse/TIMX-495
Pull Request #365: TIMX 495 - add new reindex-source CLI command

21 of 23 new or added lines in 1 file covered. (91.3%)

418 of 429 relevant lines covered (97.44%)

0.97 hits per line

Relevant lines Covered
Build:
Build:
429 RELEVANT LINES 418 COVERED LINES
0.97 HITS PER LINE
Source Files on TIMX-495-full-reindex-cli-command
  • Tree
  • List 5
  • Changed 1
  • Source Changed 1
  • Coverage Changed 1
Coverage ∆ File Lines Relevant Covered Missed Hits/Line

Recent builds

Builds Branch Commit Type Ran Committer Via Coverage
15491041464 TIMX-495-full-reindex-cli-command Add new reindex-source CLI command Why these changes are being introduced: Now that the TDA library can yield only the current records for a source from the parquet dataset, this opens up the opporunity for a fairly simple CLI command that perfo... Pull #365 06 Jun 2025 12:56PM UTC ghukill github
97.44
15448570430 TIMX-495-full-reindex-cli-command Add new reindex-source CLI command Why these changes are being introduced: Now that the TDA library can yield only the current records for a source from the parquet dataset, this opens up the opporunity for a fairly simple CLI command that perfo... push 04 Jun 2025 05:19PM UTC ghukill github
97.44
See All Builds (400)

Badge your Repo: timdex-index-manager

We detected this repo isn’t badged! Grab the embed code to the right, add it to your repo to show off your code coverage, and when the badge is live hit the refresh button to remove this message.

Could not find badge in README.

Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

Refresh
  • Settings
  • Repo on GitHub
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2026 Coveralls, Inc