IBM / unitxt / 14921034938
81%

DEFAULT BRANCH: main
Ran
Jobs 1
Files 63
Run time 1min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
coverage: 80.081% (-0.06%) from 80.14%
14921034938

push

github

web-flow 
Simplify tool calling base types (#1773)

* Fix descriptions and tested types in tool calling

Signed-off-by: elronbandel <elronbandel@gmail.com>

* FIx comparison to be more reproducible

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Change tools to be more simple

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Enhance ToolCallingMetric to validate parameter schemas using jsonschema

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Add tests and update task

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Add jsonschema to tests dependencies

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Fix test

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Fix tool clalling metric tests

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Update tests

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Fix metric

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Increase clarity

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Raise error for wrong json schema

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Update requirements to use jsonschema-rs for tool calling metrics and validation

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Update dependency from jsonschema to jsonschema_rs

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Refactor ToolCallingMetric to use jsonschema_rs for schema validation and improve argument comparison

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Refactor validation logic in verify_required_schema to improve error handling and clarity

Signed-off-by: elronbandel <elronbandel@gmail.com>

* Update requirements in supervised.json to use jsonschema-rs for schema validation

Signed-off-by: elronbandel <elronbandel@gmail.com>

---------

Signed-off-by: elronbandel <elronbandel@gmail.com>

1645 of 2037 branches covered (80.76%)

Branch coverage included in aggregate %.

10251 of 12818 relevant lines covered (79.97%)

0.8 hits per line

Uncovered Existing Lines

Lines Coverage ∆ File
5
90.32
 -9.68% unitxt/types.py
14
78.52
 0.6% unitxt/serializers.py
45
83.2
 0.03% unitxt/type_utils.py
86
91.41
 0.03% unitxt/operators.py
469
75.71
 0.01% unitxt/metrics.py
Jobs
ID Job ID Ran Files Coverage
1 14921034938.1 63
80.08
 GitHub Action Run
Source Files on build 14921034938