IBM / unitxt / 14707293951

81%

push

github

Add tool calling support + Berekley Tool Calling Benchmark (simple-v3) (#1764)

* Add tool calling support + Berekley Tool Calling Benchmark

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Update model in evaluate_tool_calling example to granite-3-3-8b-instruct

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Add support for typing.Type in is_type function and update tests

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Test tool calling utils

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Add tests tool calling metric

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Update bfcl with dataset description

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Add title to Berkeley Function Calling Leaderboard description

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Add comprehensive tutorial on tool calling with Unitxt and Berkeley Function Calling Leaderboard dataset

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Update title for Berkeley Function Calling Leaderboard - Simple V3

Signed-off-by: elronbandel <elronbandel@gmail.com>

---------

Signed-off-by: elronbandel <elronbandel@gmail.com>

1643 of 2034 branches covered (80.78%)

Branch coverage included in aggregate %.

10268 of 12827 relevant lines covered (80.05%)

0.8 hits per line