• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

MITLibraries / dspace-submission-composer
94%
main: 95%

Build:
Build:
LAST BUILD BRANCH: ocw-mapping-fix
DEFAULT BRANCH: main
Repo Added 02 Dec 2024 08:56PM UTC
Token Is1ouZ3Mu7H6XOLn5MQ3NKDGwcSUnnTxZ regen
Build 511 Last
Files 18
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

LAST BUILD ON BRANCH IN-1186-simplecsv-fix-item-identifiers
branch: IN-1186-simplecsv-fix-item-identifiers
CHANGE BRANCH
x
Reset
Sync Branches
  • IN-1186-simplecsv-fix-item-identifiers
  • 1319-create-separate-folder-for-dspace-metadata
  • IN-1095-simplecsv-workflow
  • IN-1096-ocw-workflow
  • IN-1097-wiley-workflow
  • IN-1098-sccs-workflow
  • IN-1099-aws-clients
  • IN-1099-ses-and-sqs-clients
  • IN-1099-ses-sqs-clients
  • IN-1100-archivesspace-workflow
  • IN-1101-base-workflow
  • IN-1101-sqs-refactor
  • IN-1103-reconcile-cli-command
  • IN-1104-deposit-command
  • IN-1105-finalize-command
  • IN-1106-add-docs
  • IN-1108-setup-app
  • IN-1157-build-report-system
  • IN-1158-revise-reconcile-method
  • IN-1167-remove-demo-workflow
  • IN-1172-improve-logging-for-submit-and-finalize-methods
  • IN-1172-logging-for-finalize-methods
  • IN-1173-create-reconcile-report
  • IN-1174-create-submit-report
  • IN-1176-opencourseware-subjects-field
  • IN-1227-update-dsc-to-use-s3-bucket
  • IN-1235-set-sqs-output-queues
  • IN-1236-rename-s3-bucket-env
  • IN-1315-create-item-db-model
  • IN-1316-update-reconcile-command-to-use-dynamodb
  • IN-1317-submit-dynamodb
  • IN-1318-update-finalize-command-to-use-dynamodb
  • IN-1319-create-separate-folder-for-dspace-metadata
  • IN-1320-consolidate-results-in-finalize-report
  • IN-1323-improve-methods-for-processing-result-messages
  • IN-1324-workflows-use-single-output-queue
  • IN-1341-rename-env-var-for-item-submissions-table
  • IN-1344-finalize-fix-args-when-getting-record-from-dynamodb
  • IN-1352-add-sync-cli-command
  • IN-1354-itemsubmission-class-update
  • IN-1355-refactor-reconcile-for-itemsubmission
  • IN-1356-update-submit
  • IN-1357-finalize-refactor
  • IN-1394-opencourseware-use-metadata-transformer
  • IN-1408-reconcile-by-record
  • IN-1409-repo-alignment
  • IN-1428-opencourseware-contrib-department-field-method
  • IN-1431-align-methods-for-retrieving-source-metadata
  • IN-1432-cache-bitstreams-to-workflow
  • IN-1433-define-record-level-reconcile-item-methods
  • IN-1455-create-batch-for-base-workflow
  • IN-1455-create-batch-for-base-workflow-update
  • IN-1456-add-create-cli-command
  • IN-1460-add-batch-creation-report
  • IN-1460-refactor-reporting-modules
  • IN-1511-ocw-prepare-batch-method-and-review
  • IN-1512-report-on-failures-during-batch-creation
  • INFRA-509-sccs-deposit-request
  • dependabot/pip/boto3-1.35.76
  • dependabot/pip/boto3-1.35.77
  • dependabot/pip/boto3-1.35.78
  • dependabot/pip/boto3-1.35.79
  • dependabot/pip/boto3-1.35.80
  • dependabot/pip/boto3-1.35.81
  • dependabot/pip/boto3-1.35.82
  • dependabot/pip/boto3-1.35.83
  • dependabot/pip/boto3-1.35.84
  • dependabot/pip/boto3-1.35.85
  • dependabot/pip/boto3-1.35.86
  • dependabot/pip/boto3-1.35.87
  • dependabot/pip/boto3-1.35.88
  • dependabot/pip/boto3-1.35.89
  • dependabot/pip/boto3-1.35.90
  • dependabot/pip/boto3-1.35.91
  • dependabot/pip/boto3-1.35.92
  • dependabot/pip/boto3-1.35.93
  • dependabot/pip/boto3-1.35.94
  • dependabot/pip/boto3-1.35.95
  • dependabot/pip/boto3-1.35.96
  • dependabot/pip/boto3-1.35.97
  • dependabot/pip/boto3-1.35.98
  • dependabot/pip/boto3-1.35.99
  • dependabot/pip/boto3-1.36.0
  • dependabot/pip/boto3-1.36.1
  • dependabot/pip/boto3-1.36.10
  • dependabot/pip/boto3-1.36.11
  • dependabot/pip/boto3-1.36.12
  • dependabot/pip/boto3-1.36.13
  • dependabot/pip/boto3-1.36.14
  • dependabot/pip/boto3-1.36.15
  • dependabot/pip/boto3-1.36.16
  • dependabot/pip/boto3-1.36.17
  • dependabot/pip/boto3-1.36.18
  • dependabot/pip/boto3-1.36.19
  • dependabot/pip/boto3-1.36.2
  • dependabot/pip/boto3-1.36.20
  • dependabot/pip/boto3-1.36.21
  • dependabot/pip/boto3-1.36.22
  • dependabot/pip/boto3-1.36.23
  • dependabot/pip/boto3-1.36.24
  • dependabot/pip/boto3-1.36.25
  • dependabot/pip/boto3-1.36.26
  • dependabot/pip/boto3-1.36.3
  • dependabot/pip/boto3-1.36.4
  • dependabot/pip/boto3-1.36.5
  • dependabot/pip/boto3-1.36.6
  • dependabot/pip/boto3-1.36.7
  • dependabot/pip/boto3-1.36.8
  • dependabot/pip/boto3-1.36.9
  • dependabot/pip/boto3-1.37.0
  • dependabot/pip/boto3-1.37.1
  • dependabot/pip/boto3-1.37.2
  • dependabot/pip/boto3-1.37.3
  • dependabot/pip/boto3-1.37.4
  • dependabot/pip/boto3-stubs-1.35.76
  • dependabot/pip/boto3-stubs-1.35.77
  • dependabot/pip/boto3-stubs-1.35.78
  • dependabot/pip/boto3-stubs-1.35.79
  • dependabot/pip/boto3-stubs-1.35.80
  • dependabot/pip/boto3-stubs-1.35.81
  • dependabot/pip/boto3-stubs-1.35.82
  • dependabot/pip/boto3-stubs-1.35.83
  • dependabot/pip/boto3-stubs-1.35.84
  • dependabot/pip/boto3-stubs-1.35.85
  • dependabot/pip/boto3-stubs-1.35.86
  • dependabot/pip/boto3-stubs-1.35.87
  • dependabot/pip/boto3-stubs-1.35.88
  • dependabot/pip/boto3-stubs-1.35.89
  • dependabot/pip/boto3-stubs-1.35.90
  • dependabot/pip/boto3-stubs-1.35.91
  • dependabot/pip/boto3-stubs-1.35.92
  • dependabot/pip/boto3-stubs-1.35.93
  • dependabot/pip/boto3-stubs-1.35.94
  • dependabot/pip/boto3-stubs-1.35.95
  • dependabot/pip/boto3-stubs-1.35.96
  • dependabot/pip/boto3-stubs-1.35.97
  • dependabot/pip/boto3-stubs-1.35.98
  • dependabot/pip/boto3-stubs-1.35.99
  • dependabot/pip/boto3-stubs-1.36.0
  • dependabot/pip/boto3-stubs-1.36.1
  • dependabot/pip/boto3-stubs-1.36.10
  • dependabot/pip/boto3-stubs-1.36.11
  • dependabot/pip/boto3-stubs-1.36.12
  • dependabot/pip/boto3-stubs-1.36.13
  • dependabot/pip/boto3-stubs-1.36.14
  • dependabot/pip/boto3-stubs-1.36.15
  • dependabot/pip/boto3-stubs-1.36.16
  • dependabot/pip/boto3-stubs-1.36.17
  • dependabot/pip/boto3-stubs-1.36.18
  • dependabot/pip/boto3-stubs-1.36.2
  • dependabot/pip/boto3-stubs-1.36.21
  • dependabot/pip/boto3-stubs-1.36.22
  • dependabot/pip/boto3-stubs-1.36.23
  • dependabot/pip/boto3-stubs-1.36.24
  • dependabot/pip/boto3-stubs-1.36.25
  • dependabot/pip/boto3-stubs-1.36.26
  • dependabot/pip/boto3-stubs-1.36.3
  • dependabot/pip/boto3-stubs-1.36.4
  • dependabot/pip/boto3-stubs-1.36.5
  • dependabot/pip/boto3-stubs-1.36.6
  • dependabot/pip/boto3-stubs-1.36.7
  • dependabot/pip/boto3-stubs-1.36.8
  • dependabot/pip/boto3-stubs-1.36.9
  • dependabot/pip/boto3-stubs-1.37.0
  • dependabot/pip/boto3-stubs-1.37.1
  • dependabot/pip/boto3-stubs-1.37.2
  • dependabot/pip/boto3-stubs-1.37.3
  • dependabot/pip/boto3-stubs-1.37.4
  • dependabot/pip/cryptography-44.0.1
  • dependabot/pip/jinja2-3.1.5
  • dependabot/pip/moto-5.0.23
  • dependabot/pip/moto-5.0.24
  • dependabot/pip/moto-5.0.25
  • dependabot/pip/moto-5.0.26
  • dependabot/pip/moto-5.0.27
  • dependabot/pip/moto-5.0.28
  • dependabot/pip/mypy-1.14.0
  • dependabot/pip/mypy-1.14.1
  • dependabot/pip/mypy-1.15.0
  • dependabot/pip/pre-commit-4.1.0
  • dependabot/pip/pytest-8.3.4
  • dependabot/pip/ruff-0.8.1
  • dependabot/pip/ruff-0.8.2
  • dependabot/pip/ruff-0.8.3
  • dependabot/pip/ruff-0.8.4
  • dependabot/pip/ruff-0.8.5
  • dependabot/pip/ruff-0.8.6
  • dependabot/pip/ruff-0.9.0
  • dependabot/pip/ruff-0.9.1
  • dependabot/pip/ruff-0.9.2
  • dependabot/pip/ruff-0.9.3
  • dependabot/pip/ruff-0.9.4
  • dependabot/pip/ruff-0.9.5
  • dependabot/pip/ruff-0.9.6
  • dependabot/pip/ruff-0.9.7
  • dependabot/pip/ruff-0.9.8
  • dependabot/pip/ruff-0.9.9
  • dependabot/pip/sentry-sdk-2.19.0
  • dependabot/pip/sentry-sdk-2.19.1
  • dependabot/pip/sentry-sdk-2.19.2
  • dependabot/pip/sentry-sdk-2.20.0
  • dependabot/pip/sentry-sdk-2.22.0
  • infra-flow
  • main
  • ocw-mapping-fix
  • refactor-cli-options
  • support-for-dynamodb
  • workaround

25 Feb 2025 06:45PM UTC coverage: 94.22% (-0.002%) from 94.222%
13528617403

Pull #152

github

jonavellecuerdo
Add some flexibility to the SimpleCSV workflow

Why these changes are being introduced:
* Rework SimpleCSV methods to better handle modest variations
in provided metadata CSV files (field names) and
bitstreams (filenames).

How this addresses that need:
* Define SCCS._get_item_identifier to retrieve identifier from accepted
range of values
* Remove 'item_identifier' from metadata mapping JSON files
* Rework SimpleCSV reconcile methods to match metadata and bitstreams
based on presence of item identifier in bitstream filename;
remove code to retrieve item identifiers from bitstream filenames;
for bitstreams without metadata, indicate filenames instead
* Use pandas to read metadata CSV file
* Add and update unit tests

Side effects of this change:
* The column in the metadata CSV file that contains the item identifier
can take on any name as long as it is listed in the 'source_field_name'
for the 'item_identifier' entry in the metadata mapping JSON file.

Relevant ticket(s):
* https://mitlibraries.atlassian.net/browse/IN-1186
Pull Request #152: Add flexibility to SimpleCSV workflow

37 of 39 new or added lines in 5 files covered. (94.87%)

652 of 692 relevant lines covered (94.22%)

0.94 hits per line

Relevant lines Covered
Build:
Build:
692 RELEVANT LINES 652 COVERED LINES
0.94 HITS PER LINE
Source Files on IN-1186-simplecsv-fix-item-identifiers
  • Tree
  • List 17
  • Changed 5
  • Source Changed 5
  • Coverage Changed 3
Coverage ∆ File Lines Relevant Covered Missed Hits/Line

Recent builds

Builds Branch Commit Type Ran Committer Via Coverage
13528617403 IN-1186-simplecsv-fix-item-identifiers Add some flexibility to the SimpleCSV workflow Why these changes are being introduced: * Rework SimpleCSV methods to better handle modest variations in provided metadata CSV files (field names) and bitstreams (filenames). How this addresses that... Pull #152 25 Feb 2025 06:46PM UTC jonavellecuerdo github
94.22
13528030625 IN-1186-simplecsv-fix-item-identifiers Address comments in PR #152 * Undo changes in SimpleCSV._get_item_identifier * Define @staticmethod SCCS._get_item_identifier * Create new test module 'test_workflow_sccs.py' * Remove 'item_identifier' from metadata mapping JSON files Pull #152 25 Feb 2025 06:14PM UTC jonavellecuerdo github
94.22
13509269626 IN-1186-simplecsv-fix-item-identifiers Add some flexibility to the SimpleCSV workflow Why these changes are being introduced: * Rework SimpleCSV methods to better handle modest variations in provided metadata CSV files (field names) and bitstreams (filenames). How this addresses that... push 24 Feb 2025 10:36PM UTC jonavellecuerdo github
94.39
13505074759 IN-1186-simplecsv-fix-item-identifiers Add some flexibility to the SimpleCSV workflow Why these changes are being introduced: * Flexibility... Reduce the number of change requests to metadata CSV file... How this addresses that need: * Allow multiple 'source_field_name' values for 'i... push 24 Feb 2025 06:26PM UTC jonavellecuerdo github
94.19
13500193669 IN-1186-simplecsv-fix-item-identifiers Update S3Client Why these changes are being introduced: * Initial DSC test runs uncovered that the S3Client.files_iter required some small fixes. How this addresses that need: * Skip the object key for the prefix subfolder (e.g., 'workflow/batch... push 24 Feb 2025 02:21PM UTC jonavellecuerdo github
94.09
See All Builds (510)

Badge your Repo: dspace-submission-composer

We detected this repo isn’t badged! Grab the embed code to the right, add it to your repo to show off your code coverage, and when the badge is live hit the refresh button to remove this message.

Could not find badge in README.

Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

Refresh
  • Settings
  • Repo on GitHub
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2025 Coveralls, Inc