deepset-ai / haystack / 22175870256

Build # 22175870256

Build Type

push

github

Committed by web-flow

Commit Message

feat: add flexible document comparison field to retrieval evaluators (#10604)

* feat: add flexible document comparison field to retrieval evaluators

Add a `document_comparison_field` parameter to DocumentMRREvaluator,
DocumentMAPEvaluator, and DocumentRecallEvaluator. This allows users
to compare documents by `id` or `meta.<key>` instead of the previously
hardcoded `doc.content`.

Closes #9331

* fix: address review feedback for document comparison field

- Use single backticks in docstrings instead of double backticks
- Support nested meta fields (e.g. meta.source.url) matching filtering logic
- Use walrus operator to avoid duplicate _get_comparison_value calls
- Handle {None} in recall validity checks alongside {""}
- Improve warning messages for invalid comparison values
- Simplify mode function selection with if/elif
- Use list comprehension for score calculation
- Fix release notes wording

* style: format test_document_recall.py

* test: add nested meta field tests for document evaluators

---------

Co-authored-by: yaowubarbara <yaowubarbara@users.noreply.github.com>
Co-authored-by: bogdankostic <bogdankostic@web.de>

Run Details

15332 of 16543 relevant lines covered (92.68%)

0.93 hits per line

Source File

Press 'n' to go to next uncovered line, 'b' for previous

Source Not Available