IBM / unitxt / 13266729645
81%

DEFAULT BRANCH: main
Ran
Jobs 1
Files 62
Run time 349min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
coverage: 81.123% (-0.3%) from 81.427%
13266729645

push

github

web-flow 
[Breaking change] Add support for all Granite Guardian risks  (#1576)

* Add support for all Granite Guardian risks

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Remove Granite Guardian from LLM as Judge evaluators

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Rename wrong metric name (3.0 version -> 3)

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Add support for custom risks

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Adapt catalog

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Add more examples

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Apply linter

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Add generation params

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Use inference engine instead of internal model

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Add _mock_infer_log_probs to infer_log_prob

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Apply linter

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Bring back breaking catalog names changes

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Add wrongly deleted artifacts

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Only create watsonx inference engine if it is None

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Modularize getting the prompt

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Change default names to what Granite Guardian expects by default

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Adapt rag granite guardian prepare file and catalog

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>

* Adapt metric so it works for all inference engines

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm... (continued)

1498 of 1839 branches covered (81.46%)

Branch coverage included in aggregate %.

9495 of 11712 relevant lines covered (81.07%)

0.81 hits per line

Uncovered Existing Lines

Lines Coverage ∆ File
442
75.1
 -1.15% unitxt/metrics.py
Jobs
ID Job ID Ran Files Coverage
1 13266729645.1 62
81.12
 GitHub Action Run
Source Files on build 13266729645