stacklok / toolhive / 24980886573

67%

Build Type

push

github

Committed by web-flow

Commit Message

Add localhost reverse proxy for LLM gateway (#5035)

* Add localhost reverse proxy for LLM gateway

Implements a background daemon that bridges AI tools using static API
keys (e.g. Cursor) to an OIDC-protected LLM gateway.

New pkg/llm/proxy package:
- proxy.go: httputil.ReverseProxy wrapper that strips incoming
  Authorization headers, injects fresh OIDC tokens, and forwards to
  the configured gateway. Binds listener in New() so Addr() is valid
  before Start(). Loopback guard rejects non-localhost listen addrs.
  SSE streaming works without buffering (FlushInterval: -1). Graceful
  5-second shutdown on context cancellation.
- daemon.go: PID-file lifecycle (IsRunning, Stop, StartDetached).
  StartDetached forks the current binary with TOOLHIVE_DETACHED=1,
  redirecting stdout/stderr to the XDG log file.
- daemon_unix.go / daemon_windows.go: platform-specific processAlive
  and SysProcAttr helpers via build tags.

CLI wiring (cmd/thv/app/llm.go):
- thv llm proxy start [--foreground]: background by default, foreground
  with --foreground or when running as detached child.
- thv llm proxy stop: sends SIGTERM via process.KillProcess and removes
  PID file.

Closes: #5029

* changes from review

* changes from review

---------

Co-authored-by: taskbot <taskbot@users.noreply.github.com>

Coverage Stats

119 of 199 new or added lines in 4 files covered. (59.8%)

8 existing lines in 4 files now uncovered.

59332 of 89537 relevant lines covered (66.27%)

61.75 hits per line