deepset-ai
/
haystack
/
5890005962
92%
|
Ran
|
Jobs
10
|
Files
247
|
Run time
15s
|
Badge
Embed ▾
README BADGES
|
coverage: 48.246% (+0.004%) from 48.242%
push
github
web-flowci: Add Github workflow to automate benchmark runs (#5399) * Add config files * log benchmarks to stdout * Add top-k and batch size to configs * Add batch size to configs * fix: don't download files if they already exist * Add batch size to configs * refine script * Remove configs using 1m docs * update run script * update run script * update run script * datadog integration * remove out folder * gitignore benchmarks output * test: send benchmarks to datadog * remove uncommented lines in script * feat: take branch/tag argument for benchmark setup script * fix: run.sh should ignore errors * Add GH workflow to run benchmarks periodically * Remove unused script * Adapt cml.yml * Adapt cml.yml * Rename cml.yml to benchmarks.yml * Revert "Rename cml.yml to benchmarks.yml" This reverts commit 897299433. * remove benchmarks.yml * Use same file extension for all config files * Use checkout@v3 * Run benchmarks sequentially * Add timeout-minutes parameter * Remove changes unrelated to datadog * Apply black * use haystack-oss aws account * Update test/benchmarks/utils.py Co-authored-by: Silvano Cerza <3314350+silvanocerza@users.noreply.github.com> * PR feedback * fix aws credentials step * Fix path * check docker * Allow spinning up containers from within container * Allow spinning up containers from within container * Separate launching doc stores from benchmarks * Remove docker related commands * run only retrievers * change port * Revert "change port" This reverts commit 6e5bcebb1. * Run opensearch benchmark only * Run weaviate benchmark only * Run bm25 benchmarks only * Changes host of doc stores * add step to get docker logs * Revert "add step to get docker logs" This reverts commit c10e6faa7. * Install do... (continued)
11455 of 23743 relevant lines covered (48.25%)
2.57 hits per line
Jobs
| ID | Job ID | Ran | Files | Coverage | |
|---|---|---|---|---|---|
| 1 | cli - 5890005962.1 | 0 |
19.54 |
GitHub Action Run | |
| 2 | agents - 5890005962.2 | 0 |
22.21 |
GitHub Action Run | |
| 3 | document_stores - 5890005962.3 | 0 |
25.03 |
GitHub Action Run | |
| 4 | prompt - 5890005962.4 | 0 |
24.44 |
GitHub Action Run | |
| 5 | utils - 5890005962.5 | 0 |
20.03 |
GitHub Action Run | |
| 6 | pipelines - 5890005962.6 | 0 |
23.69 |
GitHub Action Run | |
| 7 | others - 5890005962.7 | 0 |
21.97 |
GitHub Action Run | |
| 8 | preview - 5890005962.8 | 0 |
24.08 |
GitHub Action Run | |
| 9 | modeling - 5890005962.9 | 0 |
19.87 |
GitHub Action Run | |
| 10 | nodes - 5890005962.10 | 0 |
31.15 |
GitHub Action Run |
Source Files on build 5890005962
Detailed source file information is not available for this build.