cofacts / rumors-api / 37339790156

84%

master: 84%

Build Type

Pull #388

github

Committed by yutin1987

Commit Message

feat: hybrid BM25 + kNN vector search with Gemini embeddings

Add dense-vector (kNN) retrieval to ListArticles/ListReplies, opt-in via
the `embedding` similarity filter. kNN narrows the candidate set and the
existing BM25 / perceptual-hash scoring ranks the results.

- Embed articles and replies on create; backfill script for old docs.
- Audio/video embed as a single vector capped at 80s (no duration probe).
- Media queries reuse the doc-side embedding by content hash, else fetch
  bytes from the query URL and embed — search never persists to GCS, so
  no orphan files.
- All Gemini calls (embeddings + transcription) use the Developer API and
  feed media via the Files API; Vertex AI is removed.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

Pull Request Pull Request #388: vector search

Coverage Stats

1029 of 1294 branches covered (79.52%)

Branch coverage included in aggregate %.

192 of 205 new or added lines in 10 files covered. (93.66%)

4 existing lines in 1 file now uncovered.

1918 of 2200 relevant lines covered (87.18%)

16.86 hits per line