stacklok / toolhive / 25362313240

65%

Build Type

push

github

Committed by web-flow

Commit Message

Add --anthropic-path-prefix flag and auto-probe for Envoy AI Gateway (#5174)

Some gateways (e.g. Envoy AI Gateway) serve native-Anthropic traffic at
/anthropic/v1/messages rather than /v1/messages, causing Claude Code to
receive 404s and report "model not found" errors.

- Add --anthropic-path-prefix flag to `thv llm setup` (default empty).
  When set, the prefix is appended to the gateway URL when writing
  ANTHROPIC_BASE_URL in direct-mode tool configs (Claude Code, Codex).
- Auto-probe: if the flag is omitted, issue a HEAD request to
  <gateway>/anthropic/v1/messages; a 401 response (auth-reachable path)
  triggers automatic prefix selection. 404 or any error means no prefix.
- Proxy-mode tools (Cursor, VS Code) are unaffected — they route through
  `thv llm proxy` and don't use ANTHROPIC_BASE_URL.

Closes #5158

Co-authored-by: taskbot <taskbot@users.noreply.github.com>

Coverage Stats

74 of 105 new or added lines in 3 files covered. (70.48%)

33 existing lines in 4 files now uncovered.

61926 of 95986 relevant lines covered (64.52%)

58.89 hits per line