IBM / unitxt / 15112860133 / 1

81%

main: 81%

push

github

LLM judge judgebench benchmarks (#1800)

* Move Metric class into its own file

To avoid import cycle issues

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Add MetricInferenceEngine

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Add toxic chat LLM judge benchmarks

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Fix imports

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Update cards to use LoadJsonFIle

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Fix empty template list

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Another try

Signed-off-by: elronbandel <elronbandel@gmail.com>

---------

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>
Signed-off-by: elronbandel <elronbandel@gmail.com>
Co-authored-by: elronbandel <elronbandel@gmail.com>

1662 of 2068 branches covered (80.37%)

Branch coverage included in aggregate %.

10311 of 12936 relevant lines covered (79.71%)

0.8 hits per line