• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

MITLibraries / timdex-index-manager
89%

Build:
DEFAULT BRANCH: main
Repo Added 19 Jul 2022 07:05PM UTC
Token 5qAg98sTDIQMJOXYyoMhMvsVbuhbR670B regen
Build 490 Last
Files 5
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

LAST BUILD ON BRANCH main
branch: main
CHANGE BRANCH
x
Reset
Sync Branches
  • main
  • 2025-09-04-update-tda-version
  • GDT-138-update-tim-mapping-to-enable-access-filter
  • GDT-209-add-provider-field
  • GDT-211-publishers-mapping
  • GDT-92-geo-sources
  • TIMX-181-multiple-date-range-fix
  • TIMX-187-index-shard-settings
  • TIMX-227-springshare-sources
  • TIMX-410-provenance-mappings
  • TIMX-428-add-bulk-update-cli-cmd
  • TIMX-459-update-logging
  • TIMX-468-update-tda-version
  • TIMX-491-remove-parquet-feature-flags
  • TIMX-495-full-reindex-cli-command
  • TIMX-496-update-tda
  • TIMX-536-537
  • USE-102-mitlibwebsite-valid-source
  • USE-122-scaffold-add-embeddings-to-existing-documents
  • add-alma-source
  • add-shard-info
  • add-shard-info-and-console
  • debug_console
  • dependabot-update
  • dependabot/docker/python-3.12-slim
  • dependabot/pip/bandit-1.7.5
  • dependabot/pip/black-22.10.0
  • dependabot/pip/black-22.12.0
  • dependabot/pip/black-22.8.0
  • dependabot/pip/black-23.1.0
  • dependabot/pip/black-23.3.0
  • dependabot/pip/black-24.3.0
  • dependabot/pip/black-24.4.0
  • dependabot/pip/black-24.4.2
  • dependabot/pip/boto3-1.24.55
  • dependabot/pip/boto3-1.24.56
  • dependabot/pip/boto3-1.24.57
  • dependabot/pip/boto3-1.24.58
  • dependabot/pip/boto3-1.24.61
  • dependabot/pip/boto3-1.24.62
  • dependabot/pip/boto3-1.24.64
  • dependabot/pip/boto3-1.24.65
  • dependabot/pip/boto3-1.24.66
  • dependabot/pip/boto3-1.24.67
  • dependabot/pip/boto3-1.24.68
  • dependabot/pip/boto3-1.24.69
  • dependabot/pip/boto3-1.24.70
  • dependabot/pip/boto3-1.24.71
  • dependabot/pip/boto3-1.24.72
  • dependabot/pip/boto3-1.24.73
  • dependabot/pip/boto3-1.24.74
  • dependabot/pip/boto3-1.24.75
  • dependabot/pip/boto3-1.24.76
  • dependabot/pip/boto3-1.24.77
  • dependabot/pip/boto3-1.24.78
  • dependabot/pip/boto3-1.24.79
  • dependabot/pip/boto3-1.24.81
  • dependabot/pip/boto3-1.24.82
  • dependabot/pip/boto3-1.24.83
  • dependabot/pip/boto3-1.24.84
  • dependabot/pip/boto3-1.24.85
  • dependabot/pip/boto3-1.24.86
  • dependabot/pip/boto3-1.24.87
  • dependabot/pip/boto3-1.24.88
  • dependabot/pip/boto3-1.24.89
  • dependabot/pip/boto3-1.24.91
  • dependabot/pip/boto3-1.24.92
  • dependabot/pip/boto3-1.24.94
  • dependabot/pip/boto3-1.24.95
  • dependabot/pip/boto3-1.25.0
  • dependabot/pip/boto3-1.25.2
  • dependabot/pip/boto3-1.25.3
  • dependabot/pip/boto3-1.25.4
  • dependabot/pip/boto3-1.25.5
  • dependabot/pip/boto3-1.26.0
  • dependabot/pip/boto3-1.26.1
  • dependabot/pip/boto3-1.26.10
  • dependabot/pip/boto3-1.26.101
  • dependabot/pip/boto3-1.26.102
  • dependabot/pip/boto3-1.26.104
  • dependabot/pip/boto3-1.26.105
  • dependabot/pip/boto3-1.26.106
  • dependabot/pip/boto3-1.26.107
  • dependabot/pip/boto3-1.26.108
  • dependabot/pip/boto3-1.26.109
  • dependabot/pip/boto3-1.26.11
  • dependabot/pip/boto3-1.26.110
  • dependabot/pip/boto3-1.26.114
  • dependabot/pip/boto3-1.26.118
  • dependabot/pip/boto3-1.26.12
  • dependabot/pip/boto3-1.26.123
  • dependabot/pip/boto3-1.26.129
  • dependabot/pip/boto3-1.26.13
  • dependabot/pip/boto3-1.26.133
  • dependabot/pip/boto3-1.26.137
  • dependabot/pip/boto3-1.26.142
  • dependabot/pip/boto3-1.26.146
  • dependabot/pip/boto3-1.26.15
  • dependabot/pip/boto3-1.26.151
  • dependabot/pip/boto3-1.26.155
  • dependabot/pip/boto3-1.26.16
  • dependabot/pip/boto3-1.26.160
  • dependabot/pip/boto3-1.26.165
  • dependabot/pip/boto3-1.26.17
  • dependabot/pip/boto3-1.26.18
  • dependabot/pip/boto3-1.26.19
  • dependabot/pip/boto3-1.26.20
  • dependabot/pip/boto3-1.26.21
  • dependabot/pip/boto3-1.26.22
  • dependabot/pip/boto3-1.26.23
  • dependabot/pip/boto3-1.26.24
  • dependabot/pip/boto3-1.26.25
  • dependabot/pip/boto3-1.26.26
  • dependabot/pip/boto3-1.26.27
  • dependabot/pip/boto3-1.26.28
  • dependabot/pip/boto3-1.26.29
  • dependabot/pip/boto3-1.26.30
  • dependabot/pip/boto3-1.26.31
  • dependabot/pip/boto3-1.26.32
  • dependabot/pip/boto3-1.26.34
  • dependabot/pip/boto3-1.26.35
  • dependabot/pip/boto3-1.26.36
  • dependabot/pip/boto3-1.26.37
  • dependabot/pip/boto3-1.26.38
  • dependabot/pip/boto3-1.26.39
  • dependabot/pip/boto3-1.26.4
  • dependabot/pip/boto3-1.26.40
  • dependabot/pip/boto3-1.26.41
  • dependabot/pip/boto3-1.26.42
  • dependabot/pip/boto3-1.26.43
  • dependabot/pip/boto3-1.26.44
  • dependabot/pip/boto3-1.26.45
  • dependabot/pip/boto3-1.26.46
  • dependabot/pip/boto3-1.26.47
  • dependabot/pip/boto3-1.26.49
  • dependabot/pip/boto3-1.26.5
  • dependabot/pip/boto3-1.26.50
  • dependabot/pip/boto3-1.26.51
  • dependabot/pip/boto3-1.26.52
  • dependabot/pip/boto3-1.26.53
  • dependabot/pip/boto3-1.26.54
  • dependabot/pip/boto3-1.26.55
  • dependabot/pip/boto3-1.26.56
  • dependabot/pip/boto3-1.26.57
  • dependabot/pip/boto3-1.26.58
  • dependabot/pip/boto3-1.26.59
  • dependabot/pip/boto3-1.26.6
  • dependabot/pip/boto3-1.26.60
  • dependabot/pip/boto3-1.26.61
  • dependabot/pip/boto3-1.26.62
  • dependabot/pip/boto3-1.26.63
  • dependabot/pip/boto3-1.26.64
  • dependabot/pip/boto3-1.26.65
  • dependabot/pip/boto3-1.26.66
  • dependabot/pip/boto3-1.26.67
  • dependabot/pip/boto3-1.26.68
  • dependabot/pip/boto3-1.26.69
  • dependabot/pip/boto3-1.26.7
  • dependabot/pip/boto3-1.26.70
  • dependabot/pip/boto3-1.26.71
  • dependabot/pip/boto3-1.26.72
  • dependabot/pip/boto3-1.26.73
  • dependabot/pip/boto3-1.26.74
  • dependabot/pip/boto3-1.26.75
  • dependabot/pip/boto3-1.26.77
  • dependabot/pip/boto3-1.26.78
  • dependabot/pip/boto3-1.26.79
  • dependabot/pip/boto3-1.26.8
  • dependabot/pip/boto3-1.26.80
  • dependabot/pip/boto3-1.26.81
  • dependabot/pip/boto3-1.26.82
  • dependabot/pip/boto3-1.26.83
  • dependabot/pip/boto3-1.26.84
  • dependabot/pip/boto3-1.26.85
  • dependabot/pip/boto3-1.26.86
  • dependabot/pip/boto3-1.26.88
  • dependabot/pip/boto3-1.26.89
  • dependabot/pip/boto3-1.26.9
  • dependabot/pip/boto3-1.26.90
  • dependabot/pip/boto3-1.26.91
  • dependabot/pip/boto3-1.26.92
  • dependabot/pip/boto3-1.26.93
  • dependabot/pip/boto3-1.26.94
  • dependabot/pip/boto3-1.26.95
  • dependabot/pip/boto3-1.26.96
  • dependabot/pip/boto3-1.26.97
  • dependabot/pip/boto3-1.26.98
  • dependabot/pip/boto3-1.26.99
  • dependabot/pip/boto3-1.28.1
  • dependabot/pip/boto3-stubs-1.26.101
  • dependabot/pip/boto3-stubs-1.26.102
  • dependabot/pip/boto3-stubs-1.26.103
  • dependabot/pip/boto3-stubs-1.26.103.post1
  • dependabot/pip/boto3-stubs-1.26.104
  • dependabot/pip/boto3-stubs-1.26.105
  • dependabot/pip/boto3-stubs-1.26.106
  • dependabot/pip/boto3-stubs-1.26.107
  • dependabot/pip/boto3-stubs-1.26.108
  • dependabot/pip/boto3-stubs-1.26.109
  • dependabot/pip/boto3-stubs-1.26.110
  • dependabot/pip/boto3-stubs-1.26.114
  • dependabot/pip/boto3-stubs-1.26.118
  • dependabot/pip/boto3-stubs-1.26.123
  • dependabot/pip/boto3-stubs-1.26.129
  • dependabot/pip/boto3-stubs-1.26.133
  • dependabot/pip/boto3-stubs-1.26.137
  • dependabot/pip/boto3-stubs-1.26.142
  • dependabot/pip/boto3-stubs-1.26.146
  • dependabot/pip/boto3-stubs-1.26.151
  • dependabot/pip/boto3-stubs-1.26.155
  • dependabot/pip/boto3-stubs-1.26.160
  • dependabot/pip/boto3-stubs-1.26.165
  • dependabot/pip/boto3-stubs-1.26.84
  • dependabot/pip/boto3-stubs-1.26.85
  • dependabot/pip/boto3-stubs-1.26.86
  • dependabot/pip/boto3-stubs-1.26.88
  • dependabot/pip/boto3-stubs-1.26.89
  • dependabot/pip/boto3-stubs-1.26.90
  • dependabot/pip/boto3-stubs-1.26.91
  • dependabot/pip/boto3-stubs-1.26.92
  • dependabot/pip/boto3-stubs-1.26.93
  • dependabot/pip/boto3-stubs-1.26.94
  • dependabot/pip/boto3-stubs-1.26.95
  • dependabot/pip/boto3-stubs-1.26.96
  • dependabot/pip/boto3-stubs-1.26.97.post1
  • dependabot/pip/boto3-stubs-1.26.98
  • dependabot/pip/boto3-stubs-1.26.99
  • dependabot/pip/boto3-stubs-1.28.1
  • dependabot/pip/boto3-stubs-1.34.103
  • dependabot/pip/boto3-stubs-1.34.108
  • dependabot/pip/boto3-stubs-1.34.113
  • dependabot/pip/boto3-stubs-1.34.117
  • dependabot/pip/boto3-stubs-1.34.122
  • dependabot/pip/boto3-stubs-1.34.64
  • dependabot/pip/boto3-stubs-1.34.69
  • dependabot/pip/boto3-stubs-1.34.74
  • dependabot/pip/boto3-stubs-1.34.79
  • dependabot/pip/boto3-stubs-1.34.84
  • dependabot/pip/boto3-stubs-1.34.88
  • dependabot/pip/boto3-stubs-1.34.93
  • dependabot/pip/boto3-stubs-1.34.98
  • dependabot/pip/coverage-6.5.0
  • dependabot/pip/idna-3.7
  • dependabot/pip/ijson-3.2.0.post0
  • dependabot/pip/markdown-it-py-2.2.0
  • dependabot/pip/mypy-0.981
  • dependabot/pip/mypy-0.982
  • dependabot/pip/mypy-0.990
  • dependabot/pip/mypy-0.991
  • dependabot/pip/mypy-1.0.0
  • dependabot/pip/mypy-1.0.1
  • dependabot/pip/mypy-1.1.1
  • dependabot/pip/mypy-1.2.0
  • dependabot/pip/mypy-1.3.0
  • dependabot/pip/mypy-1.4.1
  • dependabot/pip/opensearch-py-2.0.1
  • dependabot/pip/opensearch-py-2.1.1
  • dependabot/pip/pydocstyle-6.3.0
  • dependabot/pip/pylama-8.4.1
  • dependabot/pip/pytest-7.1.3
  • dependabot/pip/pytest-7.2.0
  • dependabot/pip/pytest-7.2.1
  • dependabot/pip/pytest-7.2.2
  • dependabot/pip/pytest-7.3.0
  • dependabot/pip/pytest-7.3.1
  • dependabot/pip/pytest-7.3.2
  • dependabot/pip/pytest-7.4.0
  • dependabot/pip/requests-2.31.0
  • dependabot/pip/requests-2.32.0
  • dependabot/pip/rich-click-1.6.0
  • dependabot/pip/rich-click-1.6.1
  • dependabot/pip/rich-click-1.7.4
  • dependabot/pip/rich-click-1.8.0
  • dependabot/pip/rich-click-1.8.1
  • dependabot/pip/rich-click-1.8.2
  • dependabot/pip/rich-click-1.8.3
  • dependabot/pip/ruff-0.3.3
  • dependabot/pip/ruff-0.3.4
  • dependabot/pip/ruff-0.3.5
  • dependabot/pip/ruff-0.3.7
  • dependabot/pip/ruff-0.4.1
  • dependabot/pip/ruff-0.4.2
  • dependabot/pip/ruff-0.4.3
  • dependabot/pip/ruff-0.4.4
  • dependabot/pip/ruff-0.4.5
  • dependabot/pip/ruff-0.4.7
  • dependabot/pip/ruff-0.4.8
  • dependabot/pip/sentry-sdk-1.10.0
  • dependabot/pip/sentry-sdk-1.10.1
  • dependabot/pip/sentry-sdk-1.11.0
  • dependabot/pip/sentry-sdk-1.11.1
  • dependabot/pip/sentry-sdk-1.12.0
  • dependabot/pip/sentry-sdk-1.12.1
  • dependabot/pip/sentry-sdk-1.13.0
  • dependabot/pip/sentry-sdk-1.14.0
  • dependabot/pip/sentry-sdk-1.16.0
  • dependabot/pip/sentry-sdk-1.17.0
  • dependabot/pip/sentry-sdk-1.18.0
  • dependabot/pip/sentry-sdk-1.19.0
  • dependabot/pip/sentry-sdk-1.19.1
  • dependabot/pip/sentry-sdk-1.20.0
  • dependabot/pip/sentry-sdk-1.21.1
  • dependabot/pip/sentry-sdk-1.22.2
  • dependabot/pip/sentry-sdk-1.23.0
  • dependabot/pip/sentry-sdk-1.23.1
  • dependabot/pip/sentry-sdk-1.24.0
  • dependabot/pip/sentry-sdk-1.25.0
  • dependabot/pip/sentry-sdk-1.25.1
  • dependabot/pip/sentry-sdk-1.26.0
  • dependabot/pip/sentry-sdk-1.28.0
  • dependabot/pip/sentry-sdk-1.42.0
  • dependabot/pip/sentry-sdk-1.43.0
  • dependabot/pip/sentry-sdk-1.44.0
  • dependabot/pip/sentry-sdk-1.44.1
  • dependabot/pip/sentry-sdk-1.45.0
  • dependabot/pip/sentry-sdk-1.8.0
  • dependabot/pip/sentry-sdk-1.9.0
  • dependabot/pip/sentry-sdk-1.9.10
  • dependabot/pip/sentry-sdk-1.9.7
  • dependabot/pip/sentry-sdk-1.9.8
  • dependabot/pip/sentry-sdk-1.9.9
  • dependabot/pip/sentry-sdk-2.0.1
  • dependabot/pip/sentry-sdk-2.1.1
  • dependabot/pip/sentry-sdk-2.2.0
  • dependabot/pip/sentry-sdk-2.3.1
  • dependabot/pip/sentry-sdk-2.5.1
  • dependabot/pip/smart-open-6.2.0
  • dependabot/pip/smart-open-6.3.0
  • dependabot/pip/vcrpy-4.2.1
  • dependency-updates
  • expand-local-hosts
  • gdt-116-update-location-field
  • increase-timeout
  • maintenance-10-2024
  • maintenance-updates
  • opensearch-dashboard
  • rdi-124-stub-cli-commands
  • rdi-211-initial-app-setup
  • rdi-217-deploy-workflows
  • rdi-217-initial-infrastructure
  • refactor-and-cleanup
  • refs/heads/dependabot/pip/boto3-1.26.142
  • refs/heads/dependabot/pip/boto3-stubs-1.26.142
  • refs/heads/dependabot/pip/sentry-sdk-1.24.0
  • refs/tags/v.1.4.0
  • refs/tags/v1.0
  • refs/tags/v1.0.1
  • refs/tags/v1.1.0
  • refs/tags/v1.1.1
  • refs/tags/v1.2.1
  • refs/tags/v1.3.0
  • stop-indexing-for-unexpected-errors
  • timx-110-split-ingest-command
  • timx-128-update-config
  • timx-137-update-timeout-config
  • timx-143-add-bulk-delete
  • timx-72-implement-ping-command
  • timx-74-implement-indexes-command
  • timx-75-implement-aliases-command
  • timx-76-implement-ingest-command
  • timx-77-implement-promote-command
  • timx-79-implement-delete-command
  • timx-80-add-demote-command
  • update-caller-workflows
  • update-dependencies-2025-10-22
  • update-env-variable-name
  • v.1.4.1
  • v2.0
  • v2.1
  • v2.2
  • v2.3
  • v2.4
  • v2.5

17 Nov 2025 07:14PM UTC coverage: 89.397% (-8.0%) from 97.424%
19441567561

push

github

web-flow
Stub CLI command for updating existing docs with embeddings (#370)

Why these changes are being introduced:
* TIM requires a CLI command to update existing docs with
embeddings. Currently, TIM uses the OpenSearch
'index' action to create/update docs using *full* records,
which performs a full replacement of existing docs. To update docs
using *partial* records (e.g., only a subset of TIMDEX fields
[i.e., embeddings]), the OpenSearch 'update' action must be used.

How this addresses that need:
* Add 'bulk_update_embeddings' CLI command
* Create BulkOperationError exception
* Update tim.helpers.generate_bulk_actions to format inputs for
OpenSearch 'update' action

Side effects of this change:
* TIMDEX Pipeline Lambdas will require updates to generate
the 'bulk-update-embeddings' CLI command.

Relevant ticket(s):
* https://mitlibraries.atlassian.net/browse/USE-122

17 of 57 new or added lines in 4 files covered. (29.82%)

430 of 481 relevant lines covered (89.4%)

0.89 hits per line

Relevant lines Covered
Build:
Build:
481 RELEVANT LINES 430 COVERED LINES
0.89 HITS PER LINE
Source Files on main
  • Tree
  • List 5
  • Changed 4
  • Source Changed 4
  • Coverage Changed 4
Coverage ∆ File Lines Relevant Covered Missed Hits/Line

Recent builds

Builds Branch Commit Type Ran Committer Via Coverage
19441567561 main Stub CLI command for updating existing docs with embeddings (#370) Why these changes are being introduced: * TIM requires a CLI command to update existing docs with embeddings. Currently, TIM uses the OpenSearch 'index' action to create/update do... push 17 Nov 2025 07:15PM UTC web-flow github
89.4
18719983394 main Merge pull request #369 from MITLibraries/update-dependencies-2025-10-22 update dependencies 2025-10-22 push 22 Oct 2025 02:42PM UTC web-flow github
97.42
18539449160 main Merge pull request #368 from MITLibraries/USE-102-mitlibwebsite-valid-source USE 102 - Add mitlibwebsite as a valid source push 15 Oct 2025 06:54PM UTC web-flow github
97.42
17499766179 main Merge pull request #367 from MITLibraries/2025-09-04-update-tda-version update TDA version push 05 Sep 2025 05:11PM UTC web-flow github
97.42
16998583164 main Merge pull request #366 from MITLibraries/TIMX-536-537 TIMX 536 537 - Update TIM for TDA v3 push 15 Aug 2025 08:19PM UTC web-flow github
97.42
15496025586 main Merge pull request #365 from MITLibraries/TIMX-495-full-reindex-cli-command TIMX 495 - add new reindex-source CLI command push 06 Jun 2025 05:16PM UTC web-flow github
97.44
15427147015 main Merge pull request #364 from MITLibraries/TIMX-496-update-tda TIMX 496- Update TDA library push 03 Jun 2025 08:27PM UTC web-flow github
97.78
14934229728 main Merge pull request #363 from MITLibraries/TIMX-491-remove-parquet-feature-flags TIMX 491 - remove parquet feature flags push 09 May 2025 05:21PM UTC web-flow github
97.78
13315645537 main Merge pull request #362 from MITLibraries/TIMX-459-update-logging TIMX 459 - update logging push 13 Feb 2025 07:35PM UTC web-flow github
99.55
13207972226 main Merge pull request #361 from MITLibraries/TIMX-468-update-tda-version TIMX 468 - Update dependencies, get TDA version v0.10.0 push 07 Feb 2025 09:02PM UTC web-flow github
100.0
See All Builds (383)

Badge your Repo: timdex-index-manager

We detected this repo isn’t badged! Grab the embed code to the right, add it to your repo to show off your code coverage, and when the badge is live hit the refresh button to remove this message.

Could not find badge in README.

Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

Refresh
  • Settings
  • Repo on GitHub
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2025 Coveralls, Inc