IBM / unitxt
78%

DEFAULT BRANCH: main
Repo Added
Files 64
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

LAST BUILD ON BRANCH main
branch: SELECT
CHANGE BRANCH
x

coverage: 78.32% (+0.01%) from 78.307%
37422977924

push

github

web-flow 
fix: Raise a clear error when HFSystemFormat's tokenizer has no chat template (#1983)

* fix: Raise a clear error when HFSystemFormat's tokenizer has no chat template

HFSystemFormat failed on every instance with the generic transformers
ValueError when the model's tokenizer does not define a chat template.
Check this once in prepare() and raise a UnitxtError naming the model and
how to proceed: use a model with a chat template, pass one explicitly via
chat_kwargs_dict={'chat_template': ...}, or use SystemFormat.

Signed-off-by: Waleed Khalid <wak327@gmail.com>

* test: Skip llmevalkit-based tool calling metric tests when llmevalkit is missing

ReflectionToolCallingMetric and ReflectionToolCallingMetricSyntactic
require llmevalkit, an internal package that CI installs only when the
repository secrets are available. Since #1989, pull requests from forks
and Dependabot skip that install, so the 15 tests constructing these
metrics errored with MissingRequirementsError and failed the unittests
and eager jobs. Skip them when llmevalkit is not installed; they still
run wherever it is.

Signed-off-by: Waleed Khalid <wak327@gmail.com>

---------

Signed-off-by: Waleed Khalid <wak327@gmail.com>
Co-authored-by: Yoav Katz <68273864+yoavkatz@users.noreply.github.com>

2785 of 4018 branches covered (69.31%)

Branch coverage included in aggregate %.

10975 of 13551 relevant lines covered (80.99%)

0.81 hits per line

Relevant lines Covered
13551 RELEVANT LINES 10975 COVERED LINES
0.81 HITS PER LINE
Source Files on main

Recent builds

Builds Branch Commit Type Ran Committer Via Coverage
37422977924 main fix: Raise a clear error when HFSystemFormat's tokenizer has no chat template (#1983) * fix: Raise a clear error when HFSystemFormat's tokenizer has no chat template HFSystemFormat failed on every instance with the generic transformers ValueErro... push web-flow github
78.32
37379718599 fix/hf-system-format-missing-chat-template Merge 54c1f199f into e4907f633 Pull #1983 web-flow github
77.69
37312969097 main Bump sentence-transformers from 3.0.1 to 5.6.0 in /prepare/benchmarks/torr (#1985) Bump sentence-transformers in /prepare/benchmarks/torr Bumps [sentence-transformers](https://github.com/huggingface/sentence-transformers) from 3.0.1 to 5.6.0. - ... push web-flow github
78.31
37277233664 main Bump datasets from 2.21.0 to 5.0.1 in /prepare/benchmarks/torr (#1986) Bumps [datasets](https://github.com/huggingface/datasets) from 2.21.0 to 5.0.1. - [Release notes](https://github.com/huggingface/datasets/releases) - [Commits](https://github.... push web-flow github
78.31
37210332000 main CI: Don't fail fork and Dependabot runs on unavailable secrets (#1989) GitHub withholds repository secrets from workflow runs triggered by forks and by Dependabot. Two steps treated those secrets as mandatory and failed hard when they resolved to... push web-flow github
78.32
37206659548 ci/guard-fork-secrets Merge 9f2f63594 into 74b8bb633 Pull #1989 web-flow github
78.32
37196919318 main fix: upgrade vulnerable dependencies in TORR benchmark requirements (#1979) fix: upgrade vulnerable deps in TORR benchmark requirements Remediates the Dependabot alerts tracked in #1978. All three alerted packages were pinned to vulnerable versi... push web-flow github
78.32
37196878424 fix/torr-security-deps-1978 Merge dc1469c9b into 9ef4e23dc Pull #1979 web-flow github
78.32
37196599562 main Security: Fix CodeQL alerts for ReDoS, path injection, and workflow permissions (#1984) * Security: Fix CodeQL alerts for ReDoS, path injection, workflow permissions Remediates the 17 open CodeQL code-scanning alerts reported in the IBM OSPO sec... push web-flow github
78.32
37184674893 fix/codeql-security-alerts-1981 Merge 839a5739d into 398979869 Pull #1984 web-flow github
78.32
See All Builds (1908)