agentjido / req_llm / 78b2802f5d4a912b24ce84111f3567bc0339058b-PR-87

49%

main: 49%

Build Type

Pull #87

github

Committed by mikehostetler

Commit Message

Enhance model compatibility task and update testing scenarios

- Introduced new `failed_only` and `record_failed` options in `Mix.Tasks.ReqLlm.ModelCompat` for improved testing control.
- Updated `build_test_args` to include coverage filtering for specific scenarios.
- Added support for object generation checks in `ReqLLM.Capability` with detailed documentation.
- Refactored provider tests to categorize scenarios, including object generation and reasoning tokens.
- Updated `supported_models.json` to reflect recent model status changes and last checked timestamps.
- Enhanced test documentation in `AGENTS.md` to clarify usage of scenario filters.

This commit improves the overall testing framework and enhances the clarity of model capabilities.

Pull Request Pull Request #87: Optimize model compatibility testing with true parallelization

Run Details

57 of 158 new or added lines in 7 files covered. (36.08%)

189 existing lines in 4 files now uncovered.

2686 of 5505 relevant lines covered (48.79%)

177.85 hits per line