2
99%
main: 99%

Ran 13 Aug 2024 01:40PM UTC

Files 22

Run time 0s

Badge

Embed ▾

Committed 12 Aug 2024 03:54PM UTC coverage: 99.465% (+0.007%) from 99.458%

Job # 10355221461.2

Build Type

Pull #206

github

Committed by

jonavellecuerdo

Commit Message

Deduplicate list fields in TIMDEX record

Why these changes are being introduced:
* Improve data quality of TIMDEX records
by reducing duplication of data in list fields.

How this addresses that need:
* Create an attrs converter function to dedupe list of items
* Create ListFields abstract class with hash method
* Set hash methods in custom classes to ListFields.__hash__
* Set 'converter=dedupe' for every list field in TimdexRecord
* Add unit tests verifying deduplication of list fields

Side effects of this change:
* Deduplication is highly likely to result in diffs
when comparing transformed records before and after this
change. However (and more importantly), reducing duplicates
improves the data quality of TIMDEX records.

Relevant ticket(s):
* https://mitlibraries.atlassian.net/browse/TIMX-332

Pull Request Pull Request #206: Timx 332 dedupe function

Run Details

1674 of 1683 relevant lines covered (99.47%)

0.99 hits per line

MITLibraries / transmogrifier / 10355221461 / 2
99%
main: 99%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 10355221461.2

MITLibraries / transmogrifier / 10355221461 / 2 99% main: 99%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 10355221461.2

MITLibraries / transmogrifier / 10355221461 / 2
99%
main: 99%

README BADGES
x