benwbrum / fromthepage / 29278919473

74%

push

github

Add rake task to generate Claude vs Gemini AI disagreement CSV report (#5679)

* Add rake task to generate Claude vs Gemini AI disagreement CSV report

Accepts a work or collection slug, loops through each page, and computes
character disagreement rate (reusing the existing CER/Levenshtein logic)
between the latest finished Claude and Gemini AI transcriptions. Notes
which engine is missing when a page lacks a finished transcription from
either model, and includes work/page identifiers plus AI-tab and
transcribe-tab URLs to support triage.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>

* Fix formatting of missing models output

---------

Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: Ben W. Brumfield <benwbrum@gmail.com>

2765 of 4329 branches covered (63.87%)

Branch coverage included in aggregate %.

10986 of 14307 relevant lines covered (76.79%)

196.53 hits per line