stacklok / toolhive / 26898478851

66%

Build Type

push

github

Committed by web-flow

Commit Message

Add lazy mode to thv llm setup (#5427)

* Add lazy mode to llm Setup that skips OIDC login

The inline OIDC browser login in "thv llm setup" cannot complete in
unattended provisioning contexts (e.g. an MDM profile configuring a
fleet of laptops at first login), where no human is present to finish
the callback.

Add a lazy parameter to llm.Setup that skips only the interactive login.
Tool detection, config-file patching, and config persistence still run,
so the on-disk result is identical to a normal setup except that no OIDC
token is obtained yet — login is deferred to first gateway access. The
sole call site passes false for now; the --lazy CLI flag is wired in a
later change.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

* Add --lazy flag and make llm token interactive

Wire the lazy parameter added to llm.Setup to a new --lazy flag on
"thv llm setup", so unattended provisioning can configure tools without
the interactive OIDC browser login.

For deferred login to be transparent, "thv llm token" now builds an
interactive token source: on a genuine cache miss it launches the same
OIDC browser flow setup would have run, while a cached or refreshable
token is still printed without prompting. This is what signs the user in
on first use after a lazy setup, with no extra command to run.

Regenerate CLI docs for the new flag and updated token help.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

* Widen LLM proxy per-request token-fetch timeout

The proxy's per-request token fetch used a 10-second timeout. After a
lazy setup, the first request through the proxy drives the interactive
OIDC browser login via the token source, and 10 seconds is far too short
for a human to complete it — the request would be cut off mid-login.

Introduce a tokenFetchTimeout constant set to 3 minutes. Once a token is
cached, subsequent requests are served from cache and return well within
the bound, so only the initial login ever ... (continued)

Coverage Stats

14 of 25 new or added lines in 3 files covered. (56.0%)

7 existing lines in 2 files now uncovered.

66414 of 100832 relevant lines covered (65.87%)

61.47 hits per line