IBM / unitxt / 15870906710
81%

DEFAULT BRANCH: main
Ran
Jobs 1
Files 64
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
coverage: 79.887% (-0.3%) from 80.199%
15870906710

push

github

web-flow 
Add multi turn tool calling task and support multiple tools per call (#1811)

* Add multi turn tool calling task and tools

Signed-off-by: elronbandel <elronbandel@gmail.com>

* remove unrelated changes

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Update all the single turn single call datasets in bfcl

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Add llm as judge for tool calling

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Add some more dataset

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Update prepare/tasks/tool_calling/tasks.py

Co-authored-by: Yoav Katz <68273864+yoavkatz@users.noreply.github.com>

* Some fixes

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Revert execute expression mistake

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Add xlam function calling

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Add tool calling benchmark

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Fix typing

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Enhanced multi turn support and examples

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Fix serializers test

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Fix example

Signed-off-by: elronbandel <elronbandel@gmail.com>

---------

Signed-off-by: elronbandel <elronbandel@gmail.com>
Co-authored-by: Yoav Katz <68273864+yoavkatz@users.noreply.github.com>

1698 of 2104 branches covered (80.7%)

Branch coverage included in aggregate %.

10563 of 13244 relevant lines covered (79.76%)

0.8 hits per line

Uncovered Existing Lines

Lines Coverage ∆ File
4
81.15
 -0.31% unitxt/templates.py
5
92.68
 1.77% unitxt/types.py
9
95.41
 -1.83% unitxt/formats.py
17
79.27
 0.84% unitxt/serializers.py
22
79.55
 -9.93% unitxt/collections_operators.py
54
76.31
 -0.79% unitxt/processors.py
61
83.2
 0.0% unitxt/type_utils.py
78
76.89
 -3.39% unitxt/struct_data_operators.py
87
90.36
 -0.32% unitxt/operators.py
578
74.24
 -0.42% unitxt/metrics.py
Jobs
ID Job ID Ran Files Coverage
1 15870906710.1 64
79.89
 GitHub Action Run
Source Files on build 15870906710