stanford-oval / genie-toolkit / 1085 / 2

56%

master: 56%

push

travis-ci-com

Add option for per-device evaluation

The evaluation functionality now takes an optional `--split-by-device`
flag. If true, the evaluation statistics are calculated for each device
encountered in the evaluation set, and reported separately.

Also fixed the getFunctions (and as a consequence, getDevices)
functions in requoting.js. These were incorrectly  including the dialogue
policy as a function / device. Now they don't anymore. Also added unit
tests for these two functions.

2752 of 7541 branches covered (36.49%)

Branch coverage included in aggregate %.

6545 of 13497 relevant lines covered (48.49%)

45343.36 hits per line