IBM / unitxt / 13652154301
81%

DEFAULT BRANCH: main
Ran
Jobs 1
Files 62
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
coverage: 80.404% (-0.003%) from 80.407%
13652154301

push

github

web-flow 
Benjams/add hotpotqa + change type of metadata field to dict (non backward compatible) (#1633)

* small changes to profiler (#1627)

small modifs to profiler

Signed-off-by: dafnapension <dafnashein@yahoo.com>
Signed-off-by: Benjamin Sznajder <benjams@il.ibm.com>

* make metadata to be a dictionary

Signed-off-by: Benjamin Sznajder <benjams@il.ibm.com>

* First commit

Signed-off-by: Benjamin Sznajder <benjams@il.ibm.com>

* add hotpotqa dataset - change the metadata field in the rag_end_to_end task to be a dict and not a str

Signed-off-by: Benjamin Sznajder <benjams@il.ibm.com>

* change the catalog content for clapn/bioasq/miniwki since we changed the metadata_Field

Signed-off-by: Benjamin Sznajder <benjams@il.ibm.com>

* Return MultiStream in lazy loaders to avoid copying (#1628)

* Return MultiStream in lazy loaders avoid copying

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Fix caches in lazy loaders

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Fix LoadFromSklearn typo bug

Signed-off-by: elronbandel <elronbandel@gmail.com>

---------

Signed-off-by: elronbandel <elronbandel@gmail.com>
Signed-off-by: Benjamin Sznajder <benjams@il.ibm.com>

* Update version to 1.19.0 (#1629)

Signed-off-by: elronbandel <elronbandel@gmail.com>
Signed-off-by: Benjamin Sznajder <benjams@il.ibm.com>

* Fix unnecessary attempts in LoadCSV (#1630)

Signed-off-by: Benjamin Sznajder <benjams@il.ibm.com>

* add hotpotqa catalog

Signed-off-by: Benjamin Sznajder <benjams@il.ibm.com>

* Fix LLM as Judge direct criteria typo  (#1631)

Fix criteria typo

Signed-off-by: Martín Santillán Cooper <msantillancooper@ibm.com>
Signed-off-by: Benjamin Sznajder <benjams@il.ibm.com>

* continue the fix of metadata_field

Signed-off-by: Benjamin Sznajder <benjams@il.ibm.com>

* rename the metadata_field to be metadata_tags. In addition, remove the default settings where it was an override

Signed-off-by: Benjamin Sznajder <benjams@il.ibm.com>

* moved breakpoint to op... (continued)

1543 of 1920 branches covered (80.36%)

Branch coverage included in aggregate %.

9691 of 12052 relevant lines covered (80.41%)

0.8 hits per line

Uncovered Existing Lines

Lines Coverage ∆ File
2
92.31
 0.64% unitxt/system_prompts.py
2
96.84
 -0.98% unitxt/task.py
30
84.32
 -0.24% unitxt/operator.py
Jobs
ID Job ID Ran Files Coverage
1 13652154301.1 62
80.4
 GitHub Action Run
Source Files on build 13652154301