stacklok / toolhive / 21181527692

73%

Build Type

push

github

Committed by web-flow

Commit Message

feat(vmcp): integrate a dummy optimizer (#3312)

This PR integrates a DummyOptimizer into the vMCP server. In a future PR, the dummy optimizer will be replaced by a real optimizer that relies on embedding search.

Closes StacklokLabs/research#134
Closes StacklokLabs/research#139
Closes StacklokLabs/research#140

Changes
The commits largely tell the story in an easy to digest sequence, with a bit of debugging and polish at the end.

At a high level:

extract AddOnRegisterSession hook to standalone method - This is a noop. In a later commit, I modify the contained function. It was already complex, so moving it to a separate method is intended to make the code a bit more maintainable.
add optimizer interfaces and types - the purpose of this PR
implement a dummy optimizer - this is necessary for e2e testing this PR and ensuring everything is wired up correctly.
operator: deep copy config fields - modify the CRD config converter to deep copy the embedded config. This means new config fields like the optimizer settings don't require an update of the converter.
introduce a reflection module for producing JSON schema objects from structs - Rather than hardcoding the JSON schema, allow it to be derived from the structs definition.
integration of the optimizer - on each session creation, if the optimizer is enabled, we'll create an optimizer containing all of the tools & composite tools. The only tools exposed to the client will be find_tool and call_tool.

---------

Signed-off-by: Jeremy Drouillard <jeremy@stacklok.com>

Coverage Stats

223 of 335 new or added lines in 7 files covered. (66.57%)

294 existing lines in 4 files now uncovered.

36140 of 60655 relevant lines covered (59.58%)

80.9 hits per line