MITLibraries / dspace-submission-composer / 12601110470

96%

push

github

IN 1095 SimpleCSV workflow (#49)

Why these changes are being introduced:
* DSC needs to support a workflow where metadata is provided
via a CSV file and bitstreams are uploaded to an S3 bucket
by stakeholders.

How this addresses that need:
* Define SimpleCSV 'base' workflow class
* Update S3Client to support filtering when retrieving files
* Replace 's3_prefix' attr with 'batch_id' in BaseWorkflow
* Define 'batch_path' property to construct prefix using 'workflow_name'
and 'batch_id' attrs in BaseWorkflow
* Update unit tests and fixtures to use 'dsc/workflow/batch' folder structure
* Add 'smart_open' as a dependency
* Support testing with local MinIO server

Side effects of this change:
* None

Relevant ticket(s):
* https://mitlibraries.atlassian.net/browse/IN-1095

39 of 41 new or added lines in 4 files covered. (95.12%)

289 of 299 relevant lines covered (96.66%)

0.97 hits per line