rero / rero-mef
87%
staging: 87%

LAST BUILD BRANCH: mef-test
DEFAULT BRANCH: staging
Repo Added
Files 203
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

LAST BUILD ON BRANCH mef-test
branch: SELECT
CHANGE BRANCH
x

coverage: 87.128% (-0.5%) from 87.584%
34474589567

push

github

rerowep 
feat(concepts): rebuild the association and stop storing nameless records

* move the rebuild out of alembic into `invenio utils
  rebuild-concept-association`, which commits each record on its own and
  resumes with `--from-pid`. Alembic holds one transaction open for the
  whole run and loses every committed record when the connection dies.
  Revision `dcdc05a29568` now only checks the concept index mappings.
* discard a record the source deleted before we held it, and delete one
  that loses its heading together with the MEF record it empties. A
  record stating a `relation_pid` is kept, and keeps its stored heading:
  `get_latest` reads it to forward the old pid to the new record.
* keep the stored `deleted` stamp on a re-delivered tombstone, so
  `--md5` skips it instead of rewriting it on every harvest.
* stop inventing `TAG: <tag> NOT FOUND` for a record with no heading
  field, so the schema refuses it. Only the missing field is tolerated,
  and a transformation that broke no longer looks like one the source
  stopped naming.
* guard the transformation in `marc_to_json`: one unreadable record is
  counted and written to the error file instead of aborting the file.
* block IdRef, GND and VIAF in the tests; `@pytest.mark.online(...)`
  opens one, `--allow-online` opens all.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

59 of 108 new or added lines in 10 files covered. (54.63%)

5645 of 6479 relevant lines covered (87.13%)

0.87 hits per line

Relevant lines Covered
6479 RELEVANT LINES 5645 COVERED LINES
0.87 HITS PER LINE
Source Files on staging

Recent builds

Builds Branch Commit Type Ran Committer Via Coverage
34474589567 mef-test feat(concepts): rebuild the association and stop storing nameless records * move the rebuild out of alembic into `invenio utils rebuild-concept-association`, which commits each record on its own and resumes with `--from-pid`. Alembic holds on... push rerowep github
87.13
34474475245 wep-better-concepts-linking Merge 32053d815 into c80be9cad Pull #242 web-flow github
87.13
34472243466 wep-better-concepts-linking Merge 697f0273f into c80be9cad Pull #242 web-flow github
87.11
34472291150 mef-test feat(concepts): rebuild the association and stop storing nameless records * move the rebuild out of alembic into `invenio utils rebuild-concept-association`, which commits each record on its own and resumes with `--from-pid`. Alembic holds on... push rerowep github
87.11
34366759487 mef-test feat(concepts): migrate the association identifier with alembic The association identifiers live in the search index, so the concept records have to be reindexed before their MEF records can be rebuilt on the normalised BNF number. Nothing change... push rerowep github
87.05
34366718716 wep-better-concepts-linking Merge 11d817758 into c80be9cad Pull #242 web-flow github
87.05
34353128200 mef-test feat(concepts): migrate the association identifier with alembic The association identifiers live in the search index, so the concept records have to be reindexed before their MEF records can be rebuilt on the normalised BNF number. Nothing change... push rerowep github
87.58
34348322820 wep-better-concepts-linking Merge f8cc0c046 into c80be9cad Pull #242 web-flow github
87.58
34334196048 mef-test feat(concepts): link on the normalised BNF number IdRef and GND write the same BNF number in incompatible ways, with or without the trailing check character, and the identifier was compared as stored. Several records can also claim one number, wh... push rerowep github
87.58
34334091196 wep-better-concepts-linking Merge 833dc8945 into c80be9cad Pull #242 web-flow github
87.58
See All Builds (825)