IBM / unitxt / 13481713164

81%

push

github

Enable offline mode for hugginface by using local pre-downloaded metrics, datasets and models (#1603)

* Enable local caching with UNITXT_LOCAL_CACHE

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Add cache_dir parameter to model and tokenizer loading for improved performance

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Update line numbers and generated timestamp in secrets baseline

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Update line number and generated timestamp in secrets baseline

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Fix metrics.py

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Use huggingface prefix

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Clarify documentation for offline Hugging Face model, metrics, and datasets paths

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Rename hf_offline_loaders_path to hf_offline_models_path for clarity

Signed-off-by: elronbandel <elronbandel@gmail.com>

---------

Signed-off-by: elronbandel <elronbandel@gmail.com>

1540 of 1899 branches covered (81.1%)

Branch coverage included in aggregate %.

9677 of 11979 relevant lines covered (80.78%)

0.81 hits per line