22175870256
93%

Ran 19 Feb 2026 09:32AM UTC

Jobs 1

Files 254

Run time 1min

Badge

Embed ▾

Committed 19 Feb 2026 09:22AM UTC coverage: 92.68% (-0.02%) from 92.699%

Build # 22175870256

Build Type

push

github

Committed by

web-flow

Commit Message

feat: add flexible document comparison field to retrieval evaluators (#10604)

* feat: add flexible document comparison field to retrieval evaluators

Add a `document_comparison_field` parameter to DocumentMRREvaluator,
DocumentMAPEvaluator, and DocumentRecallEvaluator. This allows users
to compare documents by `id` or `meta.<key>` instead of the previously
hardcoded `doc.content`.

Closes #9331

* fix: address review feedback for document comparison field

- Use single backticks in docstrings instead of double backticks
- Support nested meta fields (e.g. meta.source.url) matching filtering logic
- Use walrus operator to avoid duplicate _get_comparison_value calls
- Handle {None} in recall validity checks alongside {""}
- Improve warning messages for invalid comparison values
- Simplify mode function selection with if/elif
- Use list comprehension for score calculation
- Fix release notes wording

* style: format test_document_recall.py

* test: add nested meta field tests for document evaluators

---------

Co-authored-by: yaowubarbara <yaowubarbara@users.noreply.github.com>
Co-authored-by: bogdankostic <bogdankostic@web.de>

Run Details

15332 of 16543 relevant lines covered (92.68%)

0.93 hits per line

Uncovered Existing Lines

Lines	Coverage	∆	File
3	91.3	-4.85%	components/evaluators/document_map.py
3	95.65	-4.35%	components/evaluators/document_recall.py
4	90.48	-4.98%	components/evaluators/document_mrr.py

Jobs

ID	Job ID	Ran	Files	Coverage
1	22175870256.1	19 Feb 2026 09:32AM UTC	254	92.68	GitHub Action Run

deepset-ai / haystack / 22175870256
93%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Uncovered Existing Lines

Jobs

Source Files on build 22175870256

deepset-ai / haystack / 22175870256 93%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Uncovered Existing Lines

Jobs

Source Files on build 22175870256

deepset-ai / haystack / 22175870256
93%

README BADGES
x