• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

MITLibraries / timdex-index-manager
89%
main: 97%

Build:
Build:
LAST BUILD BRANCH: USE-122-scaffold-add-embeddings-to-existing-documents
DEFAULT BRANCH: main
Repo Added 19 Jul 2022 07:05PM UTC
Token 5qAg98sTDIQMJOXYyoMhMvsVbuhbR670B regen
Build 488 Last
Files 5
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

LAST BUILD ON BRANCH USE-122-scaffold-add-embeddings-to-existing-documents
branch: SELECT
CHANGE BRANCH
x
Sync Branches
  • No branch selected
  • 2025-09-04-update-tda-version
  • GDT-138-update-tim-mapping-to-enable-access-filter
  • GDT-209-add-provider-field
  • GDT-211-publishers-mapping
  • GDT-92-geo-sources
  • TIMX-181-multiple-date-range-fix
  • TIMX-187-index-shard-settings
  • TIMX-227-springshare-sources
  • TIMX-410-provenance-mappings
  • TIMX-428-add-bulk-update-cli-cmd
  • TIMX-459-update-logging
  • TIMX-468-update-tda-version
  • TIMX-491-remove-parquet-feature-flags
  • TIMX-495-full-reindex-cli-command
  • TIMX-496-update-tda
  • TIMX-536-537
  • USE-102-mitlibwebsite-valid-source
  • USE-122-scaffold-add-embeddings-to-existing-documents
  • add-alma-source
  • add-shard-info
  • add-shard-info-and-console
  • debug_console
  • dependabot-update
  • dependabot/docker/python-3.12-slim
  • dependabot/pip/bandit-1.7.5
  • dependabot/pip/black-22.10.0
  • dependabot/pip/black-22.12.0
  • dependabot/pip/black-22.8.0
  • dependabot/pip/black-23.1.0
  • dependabot/pip/black-23.3.0
  • dependabot/pip/black-24.3.0
  • dependabot/pip/black-24.4.0
  • dependabot/pip/black-24.4.2
  • dependabot/pip/boto3-1.24.55
  • dependabot/pip/boto3-1.24.56
  • dependabot/pip/boto3-1.24.57
  • dependabot/pip/boto3-1.24.58
  • dependabot/pip/boto3-1.24.61
  • dependabot/pip/boto3-1.24.62
  • dependabot/pip/boto3-1.24.64
  • dependabot/pip/boto3-1.24.65
  • dependabot/pip/boto3-1.24.66
  • dependabot/pip/boto3-1.24.67
  • dependabot/pip/boto3-1.24.68
  • dependabot/pip/boto3-1.24.69
  • dependabot/pip/boto3-1.24.70
  • dependabot/pip/boto3-1.24.71
  • dependabot/pip/boto3-1.24.72
  • dependabot/pip/boto3-1.24.73
  • dependabot/pip/boto3-1.24.74
  • dependabot/pip/boto3-1.24.75
  • dependabot/pip/boto3-1.24.76
  • dependabot/pip/boto3-1.24.77
  • dependabot/pip/boto3-1.24.78
  • dependabot/pip/boto3-1.24.79
  • dependabot/pip/boto3-1.24.81
  • dependabot/pip/boto3-1.24.82
  • dependabot/pip/boto3-1.24.83
  • dependabot/pip/boto3-1.24.84
  • dependabot/pip/boto3-1.24.85
  • dependabot/pip/boto3-1.24.86
  • dependabot/pip/boto3-1.24.87
  • dependabot/pip/boto3-1.24.88
  • dependabot/pip/boto3-1.24.89
  • dependabot/pip/boto3-1.24.91
  • dependabot/pip/boto3-1.24.92
  • dependabot/pip/boto3-1.24.94
  • dependabot/pip/boto3-1.24.95
  • dependabot/pip/boto3-1.25.0
  • dependabot/pip/boto3-1.25.2
  • dependabot/pip/boto3-1.25.3
  • dependabot/pip/boto3-1.25.4
  • dependabot/pip/boto3-1.25.5
  • dependabot/pip/boto3-1.26.0
  • dependabot/pip/boto3-1.26.1
  • dependabot/pip/boto3-1.26.10
  • dependabot/pip/boto3-1.26.101
  • dependabot/pip/boto3-1.26.102
  • dependabot/pip/boto3-1.26.104
  • dependabot/pip/boto3-1.26.105
  • dependabot/pip/boto3-1.26.106
  • dependabot/pip/boto3-1.26.107
  • dependabot/pip/boto3-1.26.108
  • dependabot/pip/boto3-1.26.109
  • dependabot/pip/boto3-1.26.11
  • dependabot/pip/boto3-1.26.110
  • dependabot/pip/boto3-1.26.114
  • dependabot/pip/boto3-1.26.118
  • dependabot/pip/boto3-1.26.12
  • dependabot/pip/boto3-1.26.123
  • dependabot/pip/boto3-1.26.129
  • dependabot/pip/boto3-1.26.13
  • dependabot/pip/boto3-1.26.133
  • dependabot/pip/boto3-1.26.137
  • dependabot/pip/boto3-1.26.142
  • dependabot/pip/boto3-1.26.146
  • dependabot/pip/boto3-1.26.15
  • dependabot/pip/boto3-1.26.151
  • dependabot/pip/boto3-1.26.155
  • dependabot/pip/boto3-1.26.16
  • dependabot/pip/boto3-1.26.160
  • dependabot/pip/boto3-1.26.165
  • dependabot/pip/boto3-1.26.17
  • dependabot/pip/boto3-1.26.18
  • dependabot/pip/boto3-1.26.19
  • dependabot/pip/boto3-1.26.20
  • dependabot/pip/boto3-1.26.21
  • dependabot/pip/boto3-1.26.22
  • dependabot/pip/boto3-1.26.23
  • dependabot/pip/boto3-1.26.24
  • dependabot/pip/boto3-1.26.25
  • dependabot/pip/boto3-1.26.26
  • dependabot/pip/boto3-1.26.27
  • dependabot/pip/boto3-1.26.28
  • dependabot/pip/boto3-1.26.29
  • dependabot/pip/boto3-1.26.30
  • dependabot/pip/boto3-1.26.31
  • dependabot/pip/boto3-1.26.32
  • dependabot/pip/boto3-1.26.34
  • dependabot/pip/boto3-1.26.35
  • dependabot/pip/boto3-1.26.36
  • dependabot/pip/boto3-1.26.37
  • dependabot/pip/boto3-1.26.38
  • dependabot/pip/boto3-1.26.39
  • dependabot/pip/boto3-1.26.4
  • dependabot/pip/boto3-1.26.40
  • dependabot/pip/boto3-1.26.41
  • dependabot/pip/boto3-1.26.42
  • dependabot/pip/boto3-1.26.43
  • dependabot/pip/boto3-1.26.44
  • dependabot/pip/boto3-1.26.45
  • dependabot/pip/boto3-1.26.46
  • dependabot/pip/boto3-1.26.47
  • dependabot/pip/boto3-1.26.49
  • dependabot/pip/boto3-1.26.5
  • dependabot/pip/boto3-1.26.50
  • dependabot/pip/boto3-1.26.51
  • dependabot/pip/boto3-1.26.52
  • dependabot/pip/boto3-1.26.53
  • dependabot/pip/boto3-1.26.54
  • dependabot/pip/boto3-1.26.55
  • dependabot/pip/boto3-1.26.56
  • dependabot/pip/boto3-1.26.57
  • dependabot/pip/boto3-1.26.58
  • dependabot/pip/boto3-1.26.59
  • dependabot/pip/boto3-1.26.6
  • dependabot/pip/boto3-1.26.60
  • dependabot/pip/boto3-1.26.61
  • dependabot/pip/boto3-1.26.62
  • dependabot/pip/boto3-1.26.63
  • dependabot/pip/boto3-1.26.64
  • dependabot/pip/boto3-1.26.65
  • dependabot/pip/boto3-1.26.66
  • dependabot/pip/boto3-1.26.67
  • dependabot/pip/boto3-1.26.68
  • dependabot/pip/boto3-1.26.69
  • dependabot/pip/boto3-1.26.7
  • dependabot/pip/boto3-1.26.70
  • dependabot/pip/boto3-1.26.71
  • dependabot/pip/boto3-1.26.72
  • dependabot/pip/boto3-1.26.73
  • dependabot/pip/boto3-1.26.74
  • dependabot/pip/boto3-1.26.75
  • dependabot/pip/boto3-1.26.77
  • dependabot/pip/boto3-1.26.78
  • dependabot/pip/boto3-1.26.79
  • dependabot/pip/boto3-1.26.8
  • dependabot/pip/boto3-1.26.80
  • dependabot/pip/boto3-1.26.81
  • dependabot/pip/boto3-1.26.82
  • dependabot/pip/boto3-1.26.83
  • dependabot/pip/boto3-1.26.84
  • dependabot/pip/boto3-1.26.85
  • dependabot/pip/boto3-1.26.86
  • dependabot/pip/boto3-1.26.88
  • dependabot/pip/boto3-1.26.89
  • dependabot/pip/boto3-1.26.9
  • dependabot/pip/boto3-1.26.90
  • dependabot/pip/boto3-1.26.91
  • dependabot/pip/boto3-1.26.92
  • dependabot/pip/boto3-1.26.93
  • dependabot/pip/boto3-1.26.94
  • dependabot/pip/boto3-1.26.95
  • dependabot/pip/boto3-1.26.96
  • dependabot/pip/boto3-1.26.97
  • dependabot/pip/boto3-1.26.98
  • dependabot/pip/boto3-1.26.99
  • dependabot/pip/boto3-1.28.1
  • dependabot/pip/boto3-stubs-1.26.101
  • dependabot/pip/boto3-stubs-1.26.102
  • dependabot/pip/boto3-stubs-1.26.103
  • dependabot/pip/boto3-stubs-1.26.103.post1
  • dependabot/pip/boto3-stubs-1.26.104
  • dependabot/pip/boto3-stubs-1.26.105
  • dependabot/pip/boto3-stubs-1.26.106
  • dependabot/pip/boto3-stubs-1.26.107
  • dependabot/pip/boto3-stubs-1.26.108
  • dependabot/pip/boto3-stubs-1.26.109
  • dependabot/pip/boto3-stubs-1.26.110
  • dependabot/pip/boto3-stubs-1.26.114
  • dependabot/pip/boto3-stubs-1.26.118
  • dependabot/pip/boto3-stubs-1.26.123
  • dependabot/pip/boto3-stubs-1.26.129
  • dependabot/pip/boto3-stubs-1.26.133
  • dependabot/pip/boto3-stubs-1.26.137
  • dependabot/pip/boto3-stubs-1.26.142
  • dependabot/pip/boto3-stubs-1.26.146
  • dependabot/pip/boto3-stubs-1.26.151
  • dependabot/pip/boto3-stubs-1.26.155
  • dependabot/pip/boto3-stubs-1.26.160
  • dependabot/pip/boto3-stubs-1.26.165
  • dependabot/pip/boto3-stubs-1.26.84
  • dependabot/pip/boto3-stubs-1.26.85
  • dependabot/pip/boto3-stubs-1.26.86
  • dependabot/pip/boto3-stubs-1.26.88
  • dependabot/pip/boto3-stubs-1.26.89
  • dependabot/pip/boto3-stubs-1.26.90
  • dependabot/pip/boto3-stubs-1.26.91
  • dependabot/pip/boto3-stubs-1.26.92
  • dependabot/pip/boto3-stubs-1.26.93
  • dependabot/pip/boto3-stubs-1.26.94
  • dependabot/pip/boto3-stubs-1.26.95
  • dependabot/pip/boto3-stubs-1.26.96
  • dependabot/pip/boto3-stubs-1.26.97.post1
  • dependabot/pip/boto3-stubs-1.26.98
  • dependabot/pip/boto3-stubs-1.26.99
  • dependabot/pip/boto3-stubs-1.28.1
  • dependabot/pip/boto3-stubs-1.34.103
  • dependabot/pip/boto3-stubs-1.34.108
  • dependabot/pip/boto3-stubs-1.34.113
  • dependabot/pip/boto3-stubs-1.34.117
  • dependabot/pip/boto3-stubs-1.34.122
  • dependabot/pip/boto3-stubs-1.34.64
  • dependabot/pip/boto3-stubs-1.34.69
  • dependabot/pip/boto3-stubs-1.34.74
  • dependabot/pip/boto3-stubs-1.34.79
  • dependabot/pip/boto3-stubs-1.34.84
  • dependabot/pip/boto3-stubs-1.34.88
  • dependabot/pip/boto3-stubs-1.34.93
  • dependabot/pip/boto3-stubs-1.34.98
  • dependabot/pip/coverage-6.5.0
  • dependabot/pip/idna-3.7
  • dependabot/pip/ijson-3.2.0.post0
  • dependabot/pip/markdown-it-py-2.2.0
  • dependabot/pip/mypy-0.981
  • dependabot/pip/mypy-0.982
  • dependabot/pip/mypy-0.990
  • dependabot/pip/mypy-0.991
  • dependabot/pip/mypy-1.0.0
  • dependabot/pip/mypy-1.0.1
  • dependabot/pip/mypy-1.1.1
  • dependabot/pip/mypy-1.2.0
  • dependabot/pip/mypy-1.3.0
  • dependabot/pip/mypy-1.4.1
  • dependabot/pip/opensearch-py-2.0.1
  • dependabot/pip/opensearch-py-2.1.1
  • dependabot/pip/pydocstyle-6.3.0
  • dependabot/pip/pylama-8.4.1
  • dependabot/pip/pytest-7.1.3
  • dependabot/pip/pytest-7.2.0
  • dependabot/pip/pytest-7.2.1
  • dependabot/pip/pytest-7.2.2
  • dependabot/pip/pytest-7.3.0
  • dependabot/pip/pytest-7.3.1
  • dependabot/pip/pytest-7.3.2
  • dependabot/pip/pytest-7.4.0
  • dependabot/pip/requests-2.31.0
  • dependabot/pip/requests-2.32.0
  • dependabot/pip/rich-click-1.6.0
  • dependabot/pip/rich-click-1.6.1
  • dependabot/pip/rich-click-1.7.4
  • dependabot/pip/rich-click-1.8.0
  • dependabot/pip/rich-click-1.8.1
  • dependabot/pip/rich-click-1.8.2
  • dependabot/pip/rich-click-1.8.3
  • dependabot/pip/ruff-0.3.3
  • dependabot/pip/ruff-0.3.4
  • dependabot/pip/ruff-0.3.5
  • dependabot/pip/ruff-0.3.7
  • dependabot/pip/ruff-0.4.1
  • dependabot/pip/ruff-0.4.2
  • dependabot/pip/ruff-0.4.3
  • dependabot/pip/ruff-0.4.4
  • dependabot/pip/ruff-0.4.5
  • dependabot/pip/ruff-0.4.7
  • dependabot/pip/ruff-0.4.8
  • dependabot/pip/sentry-sdk-1.10.0
  • dependabot/pip/sentry-sdk-1.10.1
  • dependabot/pip/sentry-sdk-1.11.0
  • dependabot/pip/sentry-sdk-1.11.1
  • dependabot/pip/sentry-sdk-1.12.0
  • dependabot/pip/sentry-sdk-1.12.1
  • dependabot/pip/sentry-sdk-1.13.0
  • dependabot/pip/sentry-sdk-1.14.0
  • dependabot/pip/sentry-sdk-1.16.0
  • dependabot/pip/sentry-sdk-1.17.0
  • dependabot/pip/sentry-sdk-1.18.0
  • dependabot/pip/sentry-sdk-1.19.0
  • dependabot/pip/sentry-sdk-1.19.1
  • dependabot/pip/sentry-sdk-1.20.0
  • dependabot/pip/sentry-sdk-1.21.1
  • dependabot/pip/sentry-sdk-1.22.2
  • dependabot/pip/sentry-sdk-1.23.0
  • dependabot/pip/sentry-sdk-1.23.1
  • dependabot/pip/sentry-sdk-1.24.0
  • dependabot/pip/sentry-sdk-1.25.0
  • dependabot/pip/sentry-sdk-1.25.1
  • dependabot/pip/sentry-sdk-1.26.0
  • dependabot/pip/sentry-sdk-1.28.0
  • dependabot/pip/sentry-sdk-1.42.0
  • dependabot/pip/sentry-sdk-1.43.0
  • dependabot/pip/sentry-sdk-1.44.0
  • dependabot/pip/sentry-sdk-1.44.1
  • dependabot/pip/sentry-sdk-1.45.0
  • dependabot/pip/sentry-sdk-1.8.0
  • dependabot/pip/sentry-sdk-1.9.0
  • dependabot/pip/sentry-sdk-1.9.10
  • dependabot/pip/sentry-sdk-1.9.7
  • dependabot/pip/sentry-sdk-1.9.8
  • dependabot/pip/sentry-sdk-1.9.9
  • dependabot/pip/sentry-sdk-2.0.1
  • dependabot/pip/sentry-sdk-2.1.1
  • dependabot/pip/sentry-sdk-2.2.0
  • dependabot/pip/sentry-sdk-2.3.1
  • dependabot/pip/sentry-sdk-2.5.1
  • dependabot/pip/smart-open-6.2.0
  • dependabot/pip/smart-open-6.3.0
  • dependabot/pip/vcrpy-4.2.1
  • dependency-updates
  • expand-local-hosts
  • gdt-116-update-location-field
  • increase-timeout
  • main
  • maintenance-10-2024
  • maintenance-updates
  • opensearch-dashboard
  • rdi-124-stub-cli-commands
  • rdi-211-initial-app-setup
  • rdi-217-deploy-workflows
  • rdi-217-initial-infrastructure
  • refactor-and-cleanup
  • refs/heads/dependabot/pip/boto3-1.26.142
  • refs/heads/dependabot/pip/boto3-stubs-1.26.142
  • refs/heads/dependabot/pip/sentry-sdk-1.24.0
  • refs/tags/v.1.4.0
  • refs/tags/v1.0
  • refs/tags/v1.0.1
  • refs/tags/v1.1.0
  • refs/tags/v1.1.1
  • refs/tags/v1.2.1
  • refs/tags/v1.3.0
  • stop-indexing-for-unexpected-errors
  • timx-110-split-ingest-command
  • timx-128-update-config
  • timx-137-update-timeout-config
  • timx-143-add-bulk-delete
  • timx-72-implement-ping-command
  • timx-74-implement-indexes-command
  • timx-75-implement-aliases-command
  • timx-76-implement-ingest-command
  • timx-77-implement-promote-command
  • timx-79-implement-delete-command
  • timx-80-add-demote-command
  • update-caller-workflows
  • update-dependencies-2025-10-22
  • update-env-variable-name
  • v.1.4.1
  • v2.0
  • v2.1
  • v2.2
  • v2.3
  • v2.4
  • v2.5

12 Nov 2025 05:06PM UTC coverage: 89.397% (-8.0%) from 97.424%
19306495163

push

github

jonavellecuerdo
Stub CLI command for updating existing docs with embeddings

Why these changes are being introduced:
* TIM requires a CLI command to update existing docs with
embeddings. Currently, TIM uses the OpenSearch
'index' action to create/update docs using *full* records,
which performs a full replacement of existing docs. To update docs
using *partial* records (e.g., only a subset of TIMDEX fields
[i.e., embeddings]), the OpenSearch 'update' action must be used.

How this addresses that need:
* Add 'bulk_update_embeddings' CLI command
* Create BulkOperationError exception
* Update tim.helpers.generate_bulk_actions to format inputs for
OpenSearch 'update' action

Side effects of this change:
* TIMDEX Pipeline Lambdas will require updates to generate
the 'bulk-update-embeddings' CLI command.

Relevant ticket(s):
* https://mitlibraries.atlassian.net/browse/USE-122

17 of 57 new or added lines in 4 files covered. (29.82%)

430 of 481 relevant lines covered (89.4%)

0.89 hits per line

Relevant lines Covered
Build:
Build:
481 RELEVANT LINES 430 COVERED LINES
0.89 HITS PER LINE
Source Files on main
  • Tree
  • List 5
  • Changed 4
  • Source Changed 4
  • Coverage Changed 4
Coverage ∆ File Lines Relevant Covered Missed Hits/Line

Recent builds

Builds Branch Commit Type Ran Committer Via Coverage
19306495163 USE-122-scaffold-add-embeddings-to-existing-documents Stub CLI command for updating existing docs with embeddings Why these changes are being introduced: * TIM requires a CLI command to update existing docs with embeddings. Currently, TIM uses the OpenSearch 'index' action to create/update docs usin... push 12 Nov 2025 05:41PM UTC jonavellecuerdo github
89.4
19305490504 USE-122-scaffold-add-embeddings-to-existing-documents [wip] push 12 Nov 2025 05:05PM UTC jonavellecuerdo github
89.4
19247191117 USE-122-scaffold-add-embeddings-to-existing-documents [wip] push 10 Nov 2025 09:49PM UTC jonavellecuerdo github
94.47
19241326971 USE-122-scaffold-add-embeddings-to-existing-documents [wip] push 10 Nov 2025 06:06PM UTC jonavellecuerdo github
94.47
19241318201 USE-122-scaffold-add-embeddings-to-existing-documents [wip] push 10 Nov 2025 06:06PM UTC jonavellecuerdo github
94.47
19241298634 USE-122-scaffold-add-embeddings-to-existing-documents [wip] push 10 Nov 2025 06:05PM UTC jonavellecuerdo github
94.47
19148651064 USE-122-scaffold-add-embeddings-to-existing-documents [wip] push 06 Nov 2025 08:18PM UTC jonavellecuerdo github
93.6
19148222609 USE-122-scaffold-add-embeddings-to-existing-documents [wip] push 06 Nov 2025 08:02PM UTC jonavellecuerdo github
95.49
18727014293 v2.5 Merge pull request #369 from MITLibraries/update-dependencies-2025-10-22 update dependencies 2025-10-22 push 22 Oct 2025 07:08PM UTC web-flow github
97.42
18719983394 main Merge pull request #369 from MITLibraries/update-dependencies-2025-10-22 update dependencies 2025-10-22 push 22 Oct 2025 02:42PM UTC web-flow github
97.42
See All Builds (381)

Badge your Repo: timdex-index-manager

We detected this repo isn’t badged! Grab the embed code to the right, add it to your repo to show off your code coverage, and when the badge is live hit the refresh button to remove this message.

Could not find badge in README.

Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

Refresh
  • Settings
  • Repo on GitHub
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2025 Coveralls, Inc