IBM / unitxt / 12732002620

81%

push

github

Mm updates (#1465)

* minor bug fixes

* adding anls

* Added LMMS_eval template, exact_match_mm metric, RGB image augmentor.

* Added qa.with_context_multiple choice lmms_eval template

* Added relaxed_correctness metric, edited info_vqa card, edit lmms_eval template

* minor script changes

* minor run changes

* Added default template

* Added lmms-lab version of chartqa with default template and relaxed correctness metric and with_type task

* Added lmms-lab card of info_vqa. added default template to info_vqa and docvqa

* Wevsrc new with_domain task, new metric. WIP

* removed .github folder

* removed .github

* Finally :)

* s

* Removed not needed differences to main

* fixed pre commit

* websrc working

* discarding not important changes from main

* pre-commit fixes

* pull request error fixes

* pre-commit changes

* removed metric test of relaxed_correctness as it expects ci which I don't give

* ruff fix

* secrets

* Fixing stuff :)

* pre commit fixes

Signed-off-by: Amit Alfassy Amit.Alfassy@ibm.com <amit.alfassy@ibm.com>

* Failed another test

* another failed test

Signed-off-by: Amit Alfassy Amit.Alfassy@ibm.com <amit.alfassy@ibm.com>

* removed comments. Beautified

---------

Signed-off-by: Amit Alfassy Amit.Alfassy@ibm.com <amit.alfassy@ibm.com>
Co-authored-by: Amit Alfassy Amit.Alfassy@ibm.com <amit.alfassy@ibm.com>

1377 of 1724 branches covered (79.87%)

Branch coverage included in aggregate %.

8699 of 10962 relevant lines covered (79.36%)

0.79 hits per line