IBM / unitxt / 15373707476 / 1

81%

main: 81%

push

github

Added param to control of confidence interval calculation in evaluate api (#1815)

* Added param to control of confidence interval calculation in evaluate api.

* Do not load metrics from cache -
because confidence interval change state.

* Made confidence_interval_calculation and explicit flag.

Required because setting n_resamples is not reversible.

Signed-off-by: Yoav Katz <katz@il.ibm.com>

* Update src/unitxt/metrics.py

* Fixed test

Signed-off-by: Yoav Katz <katz@il.ibm.com>

* Improved logger

Signed-off-by: Yoav Katz <katz@il.ibm.com>

* Renamed method.

* Revert "Renamed method."

This reverts commit dbf948a03.

* Renamed member
confidence_interval_calculation
to return_confidence_interval

---------

Signed-off-by: Yoav Katz <katz@il.ibm.com>
Co-authored-by: Elron Bandel <elronbandel@gmail.com>

1658 of 2068 branches covered (80.17%)

Branch coverage included in aggregate %.

10305 of 12947 relevant lines covered (79.59%)

0.8 hits per line