IBM / unitxt / 16781725116

81%

push

github

Implements LogProbEngine on CrossInference and adds more granite guardian models (#1905)

* Remove prediction_type from GG metric

Granite Guardian metrics don't rely on the prediction field. Now, it is possible to pass None as the prediction. So, setting the prediction_type is not required.

Signed-off-by: Martín Santillán Cooper <marsancoo@gmail.com>

* Add more Granite Guardian models to watsonx, hf and rits

Signed-off-by: Martín Santillán Cooper <marsancoo@gmail.com>

* Add missing entry to _supported_apis

Signed-off-by: Martín Santillán Cooper <marsancoo@gmail.com>

* Implement LogProbInferenceEngine on CrossInferenceEngine

Signed-off-by: Martín Santillán Cooper <marsancoo@gmail.com>

* Change model in TestInferenceEngine  test

Signed-off-by: Martín Santillán Cooper <marsancoo@gmail.com>

* Correct type of RISK_TYPE_TO_CLASS

Signed-off-by: Martín Santillán Cooper <marsancoo@gmail.com>

* Fix type -> typing.Type

Signed-off-by: Martín Santillán Cooper <marsancoo@gmail.com>

* Add missing context fields

Signed-off-by: Martín Santillán Cooper <marsancoo@gmail.com>

* Add types to llm judge criterias

Signed-off-by: Martín Santillán Cooper <marsancoo@gmail.com>

---------

Signed-off-by: Martín Santillán Cooper <marsancoo@gmail.com>

1595 of 1976 branches covered (80.72%)

Branch coverage included in aggregate %.

10789 of 13298 relevant lines covered (81.13%)

0.81 hits per line