jzombie / rust-triplets

96%

main: 96%

LAST BUILD ON BRANCH fix-duplicate-text-samples-in-batch

branch: fix-duplicate-text-samples-in-batch

CHANGE BRANCH

x

Reset

• fix-duplicate-text-samples-in-batch
• 22-implement-optional-bm25-mining
• 42-add-focused-docs-on-chunking-strategy
• 46-add-csv-source-input
• 50-simplify-readme
• 60-add-support-for-hf-tokens
• 62-add-ocr-drop-rule-denoiser-option
• add-additional-kvp-testing
• add-chi-squared-goodness-of-fit-test
• add-deterministic-hasher
• add-kvp-to-metadata
• add-more-tests
• add-repo-url
• add-xplatform-notes
• async-hf
• bm25-per-source-pooling
• bump-deps-05122026
• bump-simd-r-drive
• bump-simd-r-drive-again
• centralize-tokenization
• dependabot/cargo/cargo-23d45d8cf2
• dependabot/cargo/cargo-64b2a50fd2
• dependabot/cargo/cargo-6aa8836123
• dependabot/cargo/clap-4.6.0
• dependabot/cargo/parquet-58.1.0
• dependabot/cargo/parquet-58.2.0
• dependabot/cargo/parquet-58.3.0
• dependabot/cargo/serde_json-1.0.150
• dependabot/cargo/tempfile-3.26.0
• dependabot/cargo/tempfile-3.27.0
• dependabot/cargo/tokio-1.50.0
• dependabot/cargo/tracing-subscriber-0.3.23
• dependabot/cargo/ureq-3.3.0
• doc-ingest-record-tuning
• doc-section-chunks
• expose-hash-utils
• extended-metrics
• extract-constants
• feature/allow-same-anchor-positive
• fix-duplicate-texts-across-ingestion-window
• fix-duplicate-texts-across-ingestion-window--attempt-2
• fix-duplicate-texts-across-ingestion-window--attempt-2--step-counter
• fix-duplicate-texts-in-batches-or-ingestion-windows
• fix-duplicate-texts-in-batches-or-ingestion-windows--fix-incorrect-step-tracking
• fix-hf-order-oriented-expansion
• fix-hf-order-oriented-expansion--cleanup
• fix-hf-order-oriented-expansion--debug-linux-tests
• fix-hf-order-oriented-expansion--extract-sub-crates
• fix-hf-order-oriented-expansion--head-support
• fix-hf-order-oriented-expansion--hf-test-tools
• fix-hf-unintended-all-splits-fallback
• fix-incorrect-prose-usage-of-huggingface
• fix-windows-tests
• fix/typo-prevent
• hf-cached-client
• hf-url-test
• hugging-face-source
• improve-bm25-perf
• improve-hf-integration
• improve-refresh-clarity
• inner-chunk-proximity-relevance-heuristic
• integrate-cache-manager
• main
• parallel-sampling
• refine-hf-presize-501
• refine-readme-header
• replace-step-param
• snapshots
• tagline
• update-ci-env
• update-docs
• update-hf-docs

Build # 25846896363

Build Type

Pull #103

github

Committed by web-flow

Commit Message

Merge 920a514dd into 69e538242

Pull Request Pull Request #103: Prevvent duplicate text samples in batch

Coverage Stats

7 of 7 new or added lines in 1 file covered. (100.0%)

20088 of 21002 relevant lines covered (95.65%)

5122.08 hits per line