IBM / unitxt / 12504583231

81%

push

github

performance by bluebench (#1457)

* performance by bluebench

Signed-off-by: dafnapension <dafnashein@yahoo.com>

* install litellm and diskcache

Signed-off-by: dafnapension <dafnashein@yahoo.com>

* WX_PROJECT_ID

Signed-off-by: dafnapension <dafnashein@yahoo.com>

* WX_API_KEY

Signed-off-by: dafnapension <dafnashein@yahoo.com>

* copied from inference.yml

Signed-off-by: dafnapension <dafnashein@yahoo.com>

* improve the look of the table

Signed-off-by: dafnapension <dafnashein@yahoo.com>

* run on PR first, a run whose results will be overwritten, just to warm the cache, then run on main and finally on PR again

Signed-off-by: dafnapension <dafnashein@yahoo.com>

* wrap dataset_query with quotation marks

Signed-off-by: dafnapension <dafnashein@yahoo.com>

---------

Signed-off-by: dafnapension <dafnashein@yahoo.com>
Co-authored-by: Elron Bandel <elronbandel@gmail.com>

1337 of 1666 branches covered (80.25%)

Branch coverage included in aggregate %.

8445 of 10558 relevant lines covered (79.99%)

0.8 hits per line