lsm / neokai / 25263895299

82%

push

github

Add Ollama model providers (#1745)

* Add Ollama model providers

Support local Ollama and Ollama Cloud through a native /api/chat bridge so they work with existing Anthropic-compatible routing and settings flows.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

* Address Ollama provider review feedback

Tighten model routing, make capabilities accurate, add model-list cache expiry, and translate Ollama tool calls into Anthropic streaming events.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

* Preserve Ollama tool-call history.

Keep assistant tool calls and subsequent tool results structured when bridging Anthropic messages to Ollama so multi-turn function calling remains intact.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

* Fix Ollama shorthand routing and model list endpoint.

Prevent local Ollama from claiming the ollama-cloud shorthand and expose /v1/models from the bridge so SDK initialization succeeds before streaming.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

* Keep Ollama bridges per upstream config.

Avoid stopping active session bridges when another session uses different Ollama credentials, and surface length-limited Ollama streams as max_tokens.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

* Route Ollama colon cloud model IDs.

Recognize Ollama Cloud model IDs ending in :cloud without broadening unrelated -cloud provider names, keeping local and cloud routing deterministic.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

* Check local Ollama availability before routing.

Avoid selecting the local provider as available unless its configured daemon responds to the tags endpoint.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

* Handle Ollama bridge continuation edge cases.

Preserve tool-result adjacency before supplemental user text and classify upstream rate limits for Anthropic-compatible clients.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

... (continued)

7843 of 10812 branches covered (72.54%)

Branch coverage included in aggregate %.

499 of 547 new or added lines in 5 files covered. (91.22%)

61619 of 86454 relevant lines covered (71.27%)

253.0 hits per line