cofacts / rumors-api / 37040970942

84%

master: 84%

Build Type

Pull #388

github

Committed by yutin1987

Commit Message

feat: hybrid BM25 + kNN vector search with Gemini embeddings

Add dense-vector (kNN) retrieval to ListArticles/ListReplies, opt-in via
the `embedding` similarity filter. kNN narrows the candidate set and the
existing BM25 / perceptual-hash scoring ranks the results.

- Embed articles and replies on create; backfill script for old docs.
- Audio/video embed as a single vector capped at 80s (no duration probe).
- Media queries reuse the doc-side embedding by content hash, else fetch
  bytes from the query URL and embed — search never persists to GCS, so
  no orphan files.
- All Gemini calls (embeddings + transcription) use the Developer API and
  feed media via the Files API; Vertex AI is removed.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

Pull Request Pull Request #388: vector search

Coverage Stats

1034 of 1299 branches covered (79.6%)

Branch coverage included in aggregate %.

200 of 213 new or added lines in 10 files covered. (93.9%)

4 existing lines in 1 file now uncovered.

1927 of 2209 relevant lines covered (87.23%)

16.79 hits per line