speedyk-005 / yasbd-lib / 26922348937

97%

push

github

Add configurable StreamCleaner cleanup stages (#41)

* feat(cleaner): allow skipping individual cleanup steps

Refactor StreamCleaner cleanup logic into named pipeline stages and
add the `steps_to_skip` parameter for selectively disabling
transformations such as OCR cleanup, HTML sanitization, whitespace
normalization, and mojibake fixes.

* docs(readme): improve API usage documentation

* feat(cleaner): use Collection input and add step validation

* refactor(cleaner): improve type hints and reformat file

21 of 21 new or added lines in 1 file covered. (100.0%)

390 of 409 relevant lines covered (95.35%)

0.95 hits per line