1
49%
main: 49%

Ran 09 Oct 2025 04:54PM UTC

Files 67

Run time 4s

Badge

Embed ▾

Committed 09 Oct 2025 04:53PM UTC coverage: 48.774% (+0.001%) from 48.773%

Job # 78b2802f5d4a912b24ce84111f3567bc0339058b-PR-87.1

Build Type

Pull #87

github

Committed by

mikehostetler

Commit Message

Enhance model compatibility task and update testing scenarios

- Introduced new `failed_only` and `record_failed` options in `Mix.Tasks.ReqLlm.ModelCompat` for improved testing control.
- Updated `build_test_args` to include coverage filtering for specific scenarios.
- Added support for object generation checks in `ReqLLM.Capability` with detailed documentation.
- Refactored provider tests to categorize scenarios, including object generation and reasoning tokens.
- Updated `supported_models.json` to reflect recent model status changes and last checked timestamps.
- Enhanced test documentation in `AGENTS.md` to clarify usage of scenario filters.

This commit improves the overall testing framework and enhances the clarity of model capabilities.

Pull Request Pull Request #87: Optimize model compatibility testing with true parallelization

Run Details

2685 of 5505 relevant lines covered (48.77%)

89.05 hits per line

agentjido / req_llm / 78b2802f5d4a912b24ce84111f3567bc0339058b-PR-87 / 1
49%
main: 49%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 78b2802f5d4a912b24ce84111f3567bc0339058b-PR-87.1

agentjido / req_llm / 78b2802f5d4a912b24ce84111f3567bc0339058b-PR-87 / 1 49% main: 49%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Source Files on job 78b2802f5d4a912b24ce84111f3567bc0339058b-PR-87.1

agentjido / req_llm / 78b2802f5d4a912b24ce84111f3567bc0339058b-PR-87 / 1
49%
main: 49%

README BADGES
x