2
49%
main: 49%

Ran 03 Nov 2025 06:13PM UTC

Files 90

Run time 2s

Badge

Embed ▾

Committed 03 Nov 2025 06:10PM UTC coverage: 52.504% (+0.1%) from 52.385%

Job # 9d29161a52b826f7e1f1f9a04f7e64e319b7801a-PR-174.2

Build Type

Pull #174

github

Committed by

neilberkman

Commit Message

Add OAuth2 token caching for Google Vertex AI

OAuth2 token generation on every request adds 60-180ms overhead
(file I/O, JWT signing, HTTP round trip). Tokens are valid for 1 hour,
so this overhead is wasteful for repeated requests.

Implementation:
- GenServer + ETS cache storing tokens per service account
- 55 minute TTL (5 minute safety margin before 1 hour expiry)
- GenServer serializes concurrent refresh requests to prevent duplicates
- Per-node cache (no distributed coordination needed)

Performance impact:
- Before: 1000 requests = 60-180 seconds auth overhead
- After: 1000 requests = 60-180ms auth overhead (first request only)
- Improvement: 99.9% reduction in auth overhead

Pull Request Pull Request #174: Add OAuth2 token caching for Google Vertex AI

Run Details

3953 of 7529 relevant lines covered (52.5%)

89.33 hits per line

agentjido / req_llm / 9d29161a52b826f7e1f1f9a04f7e64e319b7801a-PR-174 / 2
49%
main: 49%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 9d29161a52b826f7e1f1f9a04f7e64e319b7801a-PR-174.2

agentjido / req_llm / 9d29161a52b826f7e1f1f9a04f7e64e319b7801a-PR-174 / 2 49% main: 49%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 9d29161a52b826f7e1f1f9a04f7e64e319b7801a-PR-174.2

agentjido / req_llm / 9d29161a52b826f7e1f1f9a04f7e64e319b7801a-PR-174 / 2
49%
main: 49%

README BADGES
x