• Home
  • Features
  • Pricing
  • Docs
  • Announcements
  • Sign In

deepset-ai / haystack-experimental
98%
main: 71%

Build:
Build:
LAST BUILD BRANCH: fix-md-header-level-inferrer
DEFAULT BRANCH: main
Repo Added 22 May 2024 06:54AM UTC
Token BEipiCF7v1Eii2k5c9QSphBvVjb9XklVG regen
Build 2043 Last
Files 50
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

LAST BUILD ON BRANCH feat/eval-harness-rag
branch: feat/eval-harness-rag
CHANGE BRANCH
x
Reset
Sync Branches
  • feat/eval-harness-rag
  • LLMMetadataExtractor-use-ChatGenerator
  • PR-comments
  • add-metadata-extractor
  • add-normalize-emb-image-emb
  • add-parent-span
  • add-pre-commit-hooks
  • adding-agent-code-from-haystack-main
  • adding-forward-references-llm-metadataextractor
  • adding-pipeline-breakpoints
  • adding-pipeline-for-easy-PR-review
  • adopt-uv
  • agent-deserialize-tool-with-utility-function
  • agent-memory
  • agent-refactor-proposal
  • agent-usage-example
  • agents-update
  • align-mypy-haystack
  • anthropic_tools
  • async-experiments
  • auto-merging-retriever
  • auto-merging-retriever-update
  • bedrock-component-info-update
  • bedrock-multimodal
  • change-default-model-generators
  • changed-ds-deser
  • chat_message_store
  • chat_msg_retriever
  • chat_msg_store
  • chat_msg_writer
  • chatmessage-retriever-writer-adaptations
  • chatmessages-for-tools
  • chatpromptbuilder-multimodal
  • chore/clean-up-LLMMetadaExtractor
  • chore/clean-up-auto-merging-retriever
  • chore/clean-up-inmemory-doc-store-async
  • chore/prepare_agent_pr
  • chore/remove-discontinued-experiments
  • chore/remove-pipeline-asyncpipeline
  • chore/removing-breakpoints
  • ci/release-dev-version
  • ci/setup-tests
  • cleanup
  • david/fix-hybrid-pipeline
  • david/fixing-for-more-pipelines
  • david/pipeline-testing
  • david/remove-sender-in-serialisation
  • dependabot/github_actions/actions/checkout-5
  • dependabot/github_actions/actions/setup-python-6
  • dependabot/github_actions/tj-actions/changed-files-47
  • dependencies-tight-up
  • deserialize-tools-inplace
  • disable_firecrawl
  • disable_meteo
  • doc-length-router
  • doc-to-image-content
  • doc-to-image-content-store-file-path-as-string
  • doc-to-image-fmt
  • document-captioner
  • document-type-router
  • docusaurus-api-ref-sync
  • embedding-based-document-splitter
  • embedding-based-document-splitter-new
  • enhance-tool-logs
  • explicit_param
  • feat/add-regex-extractor
  • feat/add-summarizer
  • feat/agent-breakpoints
  • feat/agent_component
  • feat/agent_examples
  • feat/agent_streaming_llm
  • feat/async-chat-prompt-builder
  • feat/async-inmemory-retrievers
  • feat/async_pipeline
  • feat/breakpoints-structure
  • feat/eval-harness-base-class
  • feat/eval-harness-pipeline-pair
  • feat/function-caller
  • feat/multiquery-retriever
  • feat/pipeline-checkpoints
  • feat/rag-eval-harness-ctx-relevance-metric
  • feat/rag-eval-harness-gt-inputs-in-results
  • feat/rag-eval-harness-notebook
  • feat/ready_made_supercomponents
  • feat/remove-RegexTextExtractor
  • feat/summariser-based-on-LLM
  • feat/supercomponent_base
  • feat/supercomponents
  • feature/md-header-infer
  • file-to-image-content
  • fix-agent-check
  • fix-bedrock-test
  • fix-breakpoints
  • fix-bug-in-resuming-inputs
  • fix-component-tool
  • fix-deserialization-errors
  • fix-init-params-in-state
  • fix-json-dumps
  • fix-linting
  • fix-linting-error
  • fix-llmmetadata-extractor
  • fix-logger-message
  • fix-md-header-level-inferrer
  • fix-openai-empty-content
  • fix-validate-input
  • fix/adding-mocks-to-tests
  • fix/adding-pandas-as-dependency
  • fix/auto-merging-retriever-tests
  • fix/component_tool_deserialization_in_agent
  • fix/deepcopy_component_tool
  • fix/document-stores
  • fix/haystack-serialization-fix
  • fix/init-imports
  • fix/naming
  • fix/pipeline
  • fix/pipeline_run
  • fix/pyproject-toml
  • fix/rag-eval-harness-bugs
  • fix/typo-example
  • fix_anthropic_format
  • fix_naming
  • fix_tests
  • fixing-breakpoints-tests
  • fixing-breakpoints-tests-file-name-change
  • fixing-hierarchical-splitter
  • fixing-init-and-test-imports
  • fixing/windows-tests-failing
  • from_component
  • hallucination-risk-calc
  • hatch-scripts-unify
  • hfapi-tools
  • hitl-alternative
  • hitl-with-breakpoints
  • human-in-the-loop
  • image-content
  • image-embedder-experiment
  • image-show
  • image-to-document-converter
  • image-validation
  • imagecontent-convenience-class-methods
  • improve-multimodal-docstrings
  • jinja-chatmessage-extension
  • llmmetadata-extractor
  • main
  • make-LLM-based-evaluators-raise_on_failure_False
  • mem0-integration
  • metadata-extractor-update
  • more-cleanup
  • multi-file-converter-unclassified
  • multimodal-add-usage-examples
  • mv-imagecontent
  • mv-ipython-import
  • ollama-pydantic-fix
  • ollama-tools
  • openai-check-tool-names
  • openai-multimodal
  • openaichatgenerator-with-tools
  • openapi
  • openapi_corner_cases_handling
  • openapi_filter
  • openapitool_error_handling
  • pin-transformers
  • pipe_tool
  • pipeline-wrapper
  • py39
  • pylint-consistency
  • query-expander
  • raise-error-for-async-pipeline
  • refactor-doc-to-img
  • refactor-emb-base-splitter
  • refactor-image-converters
  • refactor-pipeline
  • refactor-serialization
  • refactor/restructure-eval-code
  • remove-agent
  • remove-harness
  • remove-multimodality
  • remove-pre-made-super-components
  • remove-sample-components
  • rename-max-loops-allowed
  • replaced_refs
  • restore-branch
  • revert-resume-state
  • revert/openai_tests
  • rm-multifileconverter-deps
  • rm-tool-chatmessage
  • sanitize_functions
  • sentence-transformers-image-embedder
  • separate-integration-tests
  • sjrl-patch-1
  • skip_flaky_tests_ci
  • skip_on_empty_secrets
  • small-improvments-based-on-feedback
  • state-and-tools-feedback
  • structured-output
  • super-components-update
  • super_component_decorator
  • telemetry
  • test_ci
  • test_flakyness
  • tool
  • tool-from-fun-flexible
  • tool-from-function
  • tool-invoke-error
  • tool-invoker
  • tool-output-handling
  • tool_openapi_integration
  • tools_normalization
  • topk_chat_retriever
  • try-pypdfium2
  • unpin-haystack
  • update-bedrock
  • update-chat-message-store
  • update-example
  • update-hatch
  • update-hitl
  • update-llmmetadataextract-prompt
  • update-ollama
  • update-strict-tools-usage
  • update-transfomers-dep
  • update_openapi_tests

03 Jun 2024 11:25AM UTC coverage: 97.764% (+4.1%) from 93.667%
9349272889

Pull #10

github

web-flow
Merge aa29d849d into 80d80cb1f
Pull Request #10: feat: Implement `RAGEvaluationHarness` and related classes

324 of 336 new or added lines in 8 files covered. (96.43%)

612 of 626 relevant lines covered (97.76%)

0.98 hits per line

Relevant lines Covered
Build:
Build:
626 RELEVANT LINES 612 COVERED LINES
0.98 HITS PER LINE
Source Files on feat/eval-harness-rag
  • Tree
  • List 22
  • Changed 3
  • Source Changed 3
  • Coverage Changed 1
Coverage ∆ File Lines Relevant Covered Missed Hits/Line

Recent builds

Builds Branch Commit Type Ran Committer Via Coverage
9349272889 feat/eval-harness-rag Merge aa29d849d into 80d80cb1f Pull #10 03 Jun 2024 11:27AM UTC web-flow github
97.76
9349228065 feat/eval-harness-rag Merge 2e27fe80a into 80d80cb1f Pull #10 03 Jun 2024 11:24AM UTC web-flow github
97.76
See All Builds (2024)

Badge your Repo: haystack-experimental

We detected this repo isn’t badged! Grab the embed code to the right, add it to your repo to show off your code coverage, and when the badge is live hit the refresh button to remove this message.

Could not find badge in README.

Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

Refresh
  • Settings
  • Repo on GitHub
STATUS · Troubleshooting · Open an Issue · Sales · Support · CAREERS · ENTERPRISE · START FREE · SCHEDULE DEMO
ANNOUNCEMENTS · TWITTER · TOS & SLA · Supported CI Services · What's a CI service? · Automated Testing

© 2025 Coveralls, Inc