agentjido / req_llm / af324417b37fdc158982d25bf60265054a2fb852

49%

Build Type

push

github

Committed by web-flow

Commit Message

Add JSON Schema validation using JSV library (#134)

* Add JSON Schema validation using JSV library

Adds client-side JSON Schema validation to catch invalid schemas
before sending to LLM providers. Uses JSV library for draft 2020-12
and draft 7 support.

Changes:
- Add jsv ~> 0.11 dependency
- Update ReqLLM.Schema.validate/2 to validate :json schemas with JSV
- Add validate_with_jsv/2 and format_jsv_errors/1 helper functions
- Update CHANGELOG.md with new validation feature

This catches errors like embedding JSON strings instead of parsed
maps in schemas, providing better error messages before API calls.

* Enhance JSON Schema validation in ReqLLM.Schema

- Updated `validate_with_jsv/2` to handle additional error types (RuntimeError, JSV.BuildError) during validation.
- Added comprehensive tests for various JSON Schema validation scenarios, including nested structures, type mismatches, and required fields.
- Improved error handling to provide clearer feedback for validation failures.

These changes strengthen the JSON Schema validation capabilities, ensuring more robust error detection and handling for user-defined schemas.

---------

Co-authored-by: Mike Hostetler <84222+mikehostetler@users.noreply.github.com>

Run Details

10 of 15 new or added lines in 1 file covered. (66.67%)

1 existing line in 1 file now uncovered.

3651 of 6938 relevant lines covered (52.62%)

435.72 hits per line