9066005739

Committed 13 May 2024 03:55PM UTC coverage: 62.267% (+0.02%) from 62.252%

Build # 9066005739

Build Type

push

github

Committed by

web-flow

Commit Message

Fix encoding guesser for non-UTF-8 BOM-based files. Fixes #6595 (#6596)

* Refactor InputStreamReader handling

DRY up handling of null encoding and our special UTF-8-BOM encoding

* Fix user override of encoding guessing

* Fix encoding guess for UTF-16LE & UTF-16BE with BOM. Fixes #6595

- Don't skip BOM for non-UTF-8 cases so that it is still available for character encoding guesser
- Add tests for UTF-16LE and UTF-16BE with BOMs
- Refactor encoding guesser so that it can be used for a single file
- Enhanced format guessing tests to not assume UTF-8 and instead guess encoding
  using refactored encoding guesser

* Use UTF-8 instead of US-ASCII for test fixtures

Run Details

6597 of 12101 branches covered (54.52%)

Branch coverage included in aggregate %.

16785 of 25450 relevant lines covered (65.95%)

2.97 hits per line

Source File
Press 'n' to go to next uncovered line, 'b' for previous

79.81

/com/google/refine/importers/TextFormatGuesser.java

Source Not Available

The file "com/google/refine/importers/TextFormatGuesser.java" isn't available on github. Either it's been removed, or the repo root directory needs to be updated.

OpenRefine / OpenRefine / 9066005739

Source File Press 'n' to go to next uncovered line, 'b' for previous

Source Not Available

Source File
Press 'n' to go to next uncovered line, 'b' for previous