grobidOrg / grobid / 28313157230

39%

master: 39%

Pull #1480

github

Make tokenizer language-sensitive in PDFALTOSaxHandler

- Add Language field initialized from doc.getLanguage() in constructor
- Add setLanguage()/getLanguage() methods for external configuration
- Pass language to analyzer.tokenize() call instead of using default
- Add tests for language initialization and configuration
- Fixes #376

8677 of 24982 branches covered (34.73%)

Branch coverage included in aggregate %.

18494 of 45348 relevant lines covered (40.78%)

1.65 hits per line