dcdpr / jp / 15911573302

58%

push

github

feat(llm, llamacpp): Add Llamacpp provider support (#162)

Introduces support for Llamacpp as a new LLM provider, enabling users to
connect to local Llamacpp servers. The provider uses OpenAI-compatible
APIs and supports streaming chat completions with reasoning extraction.

Users can configure the provider by setting the base URL in their
configuration, which defaults to `http://127.0.0.1:8080`. The provider
integrates with the existing tool calling and reasoning systems,
providing a local alternative to cloud-based LLM services.

The `ReasoningExtractor` has been moved to the shared provider module to
enable reuse across both Ollama and LLamacpp models that support
reasoning capabilities.

Signed-off-by: Jean Mertz <git@jeanmertz.com>
Co-authored-by: Ryan Grant <rgrant@contract.design>

189 of 373 new or added lines in 6 files covered. (50.67%)

3640 of 9711 relevant lines covered (37.48%)

4.79 hits per line