IBM / unitxt / 13032708880 / 1

81%

main: 81%

push

github

Add CollateInstanceByField operator to group data by specific field (#1546)

* Add GroupByProcessor operator to group data and apply custom functions

Signed-off-by: Sarath-S <sarath.s@ibm.com>

* Add CollateInstanceByField operator to group and aggregate data by field name

Signed-off-by: Sarath-S <sarath.s@ibm.com>

* Add CollateInstanceByField operator to group and aggregate data by field name

Signed-off-by: Sarath-S <sarath.s@ibm.com>

* Add consistency validation and test cases

Signed-off-by: Sarath-S <sarath.s@ibm.com>

* fix for test case failures

Signed-off-by: Sarath-S <sarath.s@ibm.com>

* fix for test case failures

Signed-off-by: Sarath-S <sarath.s@ibm.com>

* Added more tests and clarified error messages

Signed-off-by: Yoav Katz <katz@il.ibm.com>

* More tests

Signed-off-by: Yoav Katz <katz@il.ibm.com>

* Added checks and fixed bug in data classification policty handling

Signed-off-by: Yoav Katz <katz@il.ibm.com>

* Added more tests and error message and remove doc_id default.

Signed-off-by: Yoav Katz <katz@il.ibm.com>

* Improved documentation

Signed-off-by: Yoav Katz <katz@il.ibm.com>

* Fix for handling data_classification_policy None cases

Signed-off-by: Sarath-S <sarath.s@ibm.com>

---------

Signed-off-by: Sarath-S <sarath.s@ibm.com>
Signed-off-by: Yoav Katz <katz@il.ibm.com>
Co-authored-by: Sarath-S <sarath.s@ibm.com>
Co-authored-by: Yoav Katz <katz@il.ibm.com>
Co-authored-by: Yoav Katz <68273864+yoavkatz@users.noreply.github.com>

1439 of 1811 branches covered (79.46%)

Branch coverage included in aggregate %.

9105 of 11498 relevant lines covered (79.19%)

0.79 hits per line