NaturalNode / natural / 15187956951 / 3

87%

master: 87%

push

github

add trimSentences option to SentenceTokenizer, to let users choose to preserve whitespace (#760)

* add trimSentences option to SentenceTokenizer.tokenize()

* trimSentence argument is on the SentenceTokenizer constructor, not on tokenize()

* add test for trimSentence

* Update sentence_tokenizer.js

* Update sentence_tokenizer.js

---------

Co-authored-by: Hugo ter Doest <hwl.ter.doest@gmail.com>

2367 of 3067 branches covered (77.18%)

Branch coverage included in aggregate %.

8932 of 9903 relevant lines covered (90.19%)

13116.19 hits per line