stacklok / toolhive / 28267642899

push

github

Add OpenAI-compatible embedding client to vmcp optimizer (#5633)

* Add OpenAI-compatible embedding client to vmcp

The vmcp optimizer only spoke the TEI embedding API. Add an "openai"
provider for OpenAI-compatible services (OpenAI, Azure, Bifrost,
LiteLLM), selected via optimizer.embeddingProvider with the model in
embeddingModel and the key read from OPENAI_API_KEY. Defaults to "tei",
so existing configs are unaffected.

Closes #5305

Signed-off-by: Gabriel Cosi <contact@gabrielcosi.dev>

* Reject embeddingServerRef with openai provider

Signed-off-by: Gabriel Cosi <contact@gabrielcosi.dev>

* Drain OpenAI response body before close

Signed-off-by: Gabriel Cosi <contact@gabrielcosi.dev>

* Trim trailing slash from OpenAI base URL

Signed-off-by: Gabriel Cosi <contact@gabrielcosi.dev>

* Add live OpenAI embedding integration test

Signed-off-by: Gabriel Cosi <contact@gabrielcosi.dev>

* Generalize embedding gateway examples

Signed-off-by: Gabriel Cosi <contact@gabrielcosi.dev>

---------

Signed-off-by: Gabriel Cosi <contact@gabrielcosi.dev>

117 of 129 new or added lines in 3 files covered. (90.7%)

69706 of 103484 relevant lines covered (67.36%)

65.48 hits per line