stanford-oval / genie-toolkit / 1085 / 7

56%

master: 56%

push

travis-ci-com

Add option for per-device evaluation

The evaluation functionality now takes an optional `--split-by-device`
flag. If true, the evaluation statistics are calculated for each device
encountered in the evaluation set, and reported separately.

Also fixed the getFunctions (and as a consequence, getDevices)
functions in requoting.js. These were incorrectly  including the dialogue
policy as a function / device. Now they don't anymore. Also added unit
tests for these two functions.

3846 of 12149 branches covered (31.66%)

Branch coverage included in aggregate %.

9407 of 23412 relevant lines covered (40.18%)

474829.64 hits per line