• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

deepset-ai / haystack-experimental
98%
main: 71%

Build:
Build:
LAST BUILD BRANCH: fix-md-header-level-inferrer
DEFAULT BRANCH: main
Repo Added 22 May 2024 06:54AM UTC
Token BEipiCF7v1Eii2k5c9QSphBvVjb9XklVG regen
Build 2044 Last
Files 50
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

LAST BUILD ON BRANCH feat/rag-eval-harness-notebook
branch: feat/rag-eval-harness-notebook
CHANGE BRANCH
x
Reset
Sync Branches
  • feat/rag-eval-harness-notebook
  • LLMMetadataExtractor-use-ChatGenerator
  • PR-comments
  • add-metadata-extractor
  • add-normalize-emb-image-emb
  • add-parent-span
  • add-pre-commit-hooks
  • adding-agent-code-from-haystack-main
  • adding-forward-references-llm-metadataextractor
  • adding-pipeline-breakpoints
  • adding-pipeline-for-easy-PR-review
  • adopt-uv
  • agent-deserialize-tool-with-utility-function
  • agent-memory
  • agent-refactor-proposal
  • agent-usage-example
  • agents-update
  • align-mypy-haystack
  • anthropic_tools
  • async-experiments
  • auto-merging-retriever
  • auto-merging-retriever-update
  • bedrock-component-info-update
  • bedrock-multimodal
  • change-default-model-generators
  • changed-ds-deser
  • chat_message_store
  • chat_msg_retriever
  • chat_msg_store
  • chat_msg_writer
  • chatmessage-retriever-writer-adaptations
  • chatmessages-for-tools
  • chatpromptbuilder-multimodal
  • chore/clean-up-LLMMetadaExtractor
  • chore/clean-up-auto-merging-retriever
  • chore/clean-up-inmemory-doc-store-async
  • chore/prepare_agent_pr
  • chore/remove-discontinued-experiments
  • chore/remove-pipeline-asyncpipeline
  • chore/removing-breakpoints
  • ci/release-dev-version
  • ci/setup-tests
  • cleanup
  • david/fix-hybrid-pipeline
  • david/fixing-for-more-pipelines
  • david/pipeline-testing
  • david/remove-sender-in-serialisation
  • dependabot/github_actions/actions/checkout-5
  • dependabot/github_actions/actions/setup-python-6
  • dependabot/github_actions/tj-actions/changed-files-47
  • dependencies-tight-up
  • deserialize-tools-inplace
  • disable_firecrawl
  • disable_meteo
  • doc-length-router
  • doc-to-image-content
  • doc-to-image-content-store-file-path-as-string
  • doc-to-image-fmt
  • document-captioner
  • document-type-router
  • docusaurus-api-ref-sync
  • embedding-based-document-splitter
  • embedding-based-document-splitter-new
  • enhance-tool-logs
  • explicit_param
  • feat/add-regex-extractor
  • feat/add-summarizer
  • feat/agent-breakpoints
  • feat/agent_component
  • feat/agent_examples
  • feat/agent_streaming_llm
  • feat/async-chat-prompt-builder
  • feat/async-inmemory-retrievers
  • feat/async_pipeline
  • feat/breakpoints-structure
  • feat/eval-harness-base-class
  • feat/eval-harness-pipeline-pair
  • feat/eval-harness-rag
  • feat/function-caller
  • feat/multiquery-retriever
  • feat/pipeline-checkpoints
  • feat/rag-eval-harness-ctx-relevance-metric
  • feat/rag-eval-harness-gt-inputs-in-results
  • feat/ready_made_supercomponents
  • feat/remove-RegexTextExtractor
  • feat/summariser-based-on-LLM
  • feat/supercomponent_base
  • feat/supercomponents
  • feature/md-header-infer
  • file-to-image-content
  • fix-agent-check
  • fix-bedrock-test
  • fix-breakpoints
  • fix-bug-in-resuming-inputs
  • fix-component-tool
  • fix-deserialization-errors
  • fix-init-params-in-state
  • fix-json-dumps
  • fix-linting
  • fix-linting-error
  • fix-llmmetadata-extractor
  • fix-logger-message
  • fix-md-header-level-inferrer
  • fix-openai-empty-content
  • fix-validate-input
  • fix/adding-mocks-to-tests
  • fix/adding-pandas-as-dependency
  • fix/auto-merging-retriever-tests
  • fix/component_tool_deserialization_in_agent
  • fix/deepcopy_component_tool
  • fix/document-stores
  • fix/haystack-serialization-fix
  • fix/init-imports
  • fix/naming
  • fix/pipeline
  • fix/pipeline_run
  • fix/pyproject-toml
  • fix/rag-eval-harness-bugs
  • fix/typo-example
  • fix_anthropic_format
  • fix_naming
  • fix_tests
  • fixing-breakpoints-tests
  • fixing-breakpoints-tests-file-name-change
  • fixing-hierarchical-splitter
  • fixing-init-and-test-imports
  • fixing/windows-tests-failing
  • from_component
  • hallucination-risk-calc
  • hatch-scripts-unify
  • hfapi-tools
  • hitl-alternative
  • hitl-with-breakpoints
  • human-in-the-loop
  • image-content
  • image-embedder-experiment
  • image-show
  • image-to-document-converter
  • image-validation
  • imagecontent-convenience-class-methods
  • improve-multimodal-docstrings
  • jinja-chatmessage-extension
  • llmmetadata-extractor
  • main
  • make-LLM-based-evaluators-raise_on_failure_False
  • mem0-integration
  • metadata-extractor-update
  • more-cleanup
  • multi-file-converter-unclassified
  • multimodal-add-usage-examples
  • mv-imagecontent
  • mv-ipython-import
  • ollama-pydantic-fix
  • ollama-tools
  • openai-check-tool-names
  • openai-multimodal
  • openaichatgenerator-with-tools
  • openapi
  • openapi_corner_cases_handling
  • openapi_filter
  • openapitool_error_handling
  • pin-transformers
  • pipe_tool
  • pipeline-wrapper
  • py39
  • pylint-consistency
  • query-expander
  • raise-error-for-async-pipeline
  • refactor-doc-to-img
  • refactor-emb-base-splitter
  • refactor-image-converters
  • refactor-pipeline
  • refactor-serialization
  • refactor/restructure-eval-code
  • remove-agent
  • remove-harness
  • remove-multimodality
  • remove-pre-made-super-components
  • remove-sample-components
  • rename-max-loops-allowed
  • replaced_refs
  • restore-branch
  • revert-resume-state
  • revert/openai_tests
  • rm-multifileconverter-deps
  • rm-tool-chatmessage
  • sanitize_functions
  • sentence-transformers-image-embedder
  • separate-integration-tests
  • sjrl-patch-1
  • skip_flaky_tests_ci
  • skip_on_empty_secrets
  • small-improvments-based-on-feedback
  • state-and-tools-feedback
  • structured-output
  • super-components-update
  • super_component_decorator
  • telemetry
  • test_ci
  • test_flakyness
  • tool
  • tool-from-fun-flexible
  • tool-from-function
  • tool-invoke-error
  • tool-invoker
  • tool-output-handling
  • tool_openapi_integration
  • tools_normalization
  • topk_chat_retriever
  • try-pypdfium2
  • unpin-haystack
  • update-bedrock
  • update-chat-message-store
  • update-example
  • update-hatch
  • update-hitl
  • update-llmmetadataextract-prompt
  • update-ollama
  • update-strict-tools-usage
  • update-transfomers-dep
  • update_openapi_tests

13 Jun 2024 10:57AM UTC coverage: 97.764%. Remained the same
9498393193

Pull #11

github

web-flow
Merge 7b48f6420 into c5f3ab00c
Pull Request #11: feat: Add notebook for RAG eval harness

20 of 22 new or added lines in 1 file covered. (90.91%)

10 existing lines in 1 file now uncovered.

612 of 626 relevant lines covered (97.76%)

0.98 hits per line

Relevant lines Covered
Build:
Build:
626 RELEVANT LINES 612 COVERED LINES
0.98 HITS PER LINE
Source Files on feat/rag-eval-harness-notebook
  • Tree
  • List 22
  • Changed 1
  • Source Changed 1
  • Coverage Changed 1
Coverage ∆ File Lines Relevant Covered Missed Hits/Line

Recent builds

Builds Branch Commit Type Ran Committer Via Coverage
9498393193 feat/rag-eval-harness-notebook Merge 7b48f6420 into c5f3ab00c Pull #11 13 Jun 2024 10:59AM UTC web-flow github
97.76
9401655773 feat/rag-eval-harness-notebook Merge 29d2bfc66 into 90eb38aa0 Pull #11 06 Jun 2024 01:22PM UTC web-flow github
97.76
See All Builds (2025)

Badge your Repo: haystack-experimental

We detected this repo isn’t badged! Grab the embed code to the right, add it to your repo to show off your code coverage, and when the badge is live hit the refresh button to remove this message.

Could not find badge in README.

Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

Refresh
  • Settings
  • Repo on GitHub
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2025 Coveralls, Inc