PyThaiNLP / pythainlp / 21246405491

54%

dev: 54%

Build Type

Pull #1222

github

Committed by Copilot

Commit Message

Make normalization more conservative to avoid creating new words

- Update remove_spaces_before_marks() to only remove space after consonants not preceded by vowels
- Add removal of dangling chars after spaces in remove_dangling()
- Remove unused import remove_spaces_before_marks from tests
- Fix import ordering per ruff recommendations

Co-authored-by: bact <128572+bact@users.noreply.github.com>

Pull Request Pull Request #1222: Fix normalize() to remove spaces before Thai tone marks and non-base characters (conservative approach)

Run Details

9 of 9 new or added lines in 1 file covered. (100.0%)

3 existing lines in 1 file now uncovered.

4557 of 8493 relevant lines covered (53.66%)

0.54 hits per line