rero / rero-ils / 26504638268

91%

staging: 91%

Build Type

push

github

Committed by rerowep

Commit Message

feat(harvester): add Memovs audiovisual archives API

Add new API harvester for Médiathèque Valais audiovisual archives
(archives.memovs.ch) enabling automatic ingestion of Film, Photo,
and Audio metadata from the Memovs digital archives into RERO-ILS.

Harvester (api_harvester/memovs/):
* ApiMemovs class with pagination, date filtering, and orphan deletion
* Celery tasks for scheduled harvest and cleanup of removed records
* Configuration as VS-MEMO in apisources.yml with location/item_type PIDs
* Alembic migration for default location and item_type PID settings

BIBFRAME-to-RERO-ILS transformation (dojson/json/model.py):
* Document type detection from bf:content/bf:media/bf:carrier (Film, Audio, Photo, Other)
* Provision activity from bf:provisionActivity with date normalisation
* Electronic locators for landing page and thumbnail
* MEF entity resolution for contributions, subjects, genre/form and places
* Fallback to identifiedBy when MEF ref cannot be resolved
* Physical description from bf:extent split into extent, otherPhysicalDetails and colorContent
* Warning logged when bf:contribution agent carries a URL as rdfs:label

Document and item creation (api.py):
* Holdings created per document with electronic locations
* Items created per bf:hasPart call number, stale items deleted on update
* Local fields synced from bf:note annotations (vsavmat, vsavgeo, vsavfonds...)

Other changes:
* feat(documents): add rpt (Reporter) to contribution roles schema
* refactor(documents): load _CONTRIBUTION_ROLE dynamically from JSON schema

Co-authored-by: Peter Weber <peter.weber@rero.ch>

Coverage Stats

701 of 796 new or added lines in 12 files covered. (88.07%)

31 existing lines in 7 files now uncovered.

24764 of 27147 relevant lines covered (91.22%)

0.91 hits per line