cweill / gotests / 18736962549

94%

master: 94%

Build Type

Pull #194

github

Committed by cweill

Commit Message

fix(ai): improve E2E test determinism and use natural language test names

Changes:
- Remove exampleNames from prompt that was forcing specific test name patterns
- Add seed=42 to Ollama requests for deterministic output
- Rewrite E2E tests to use render package instead of CLI (enables code coverage)
- Add import formatting normalization to handle goimports behavior
- Update prompt to use natural language test names with spaces (e.g., "valid input" instead of "valid_input")
- Regenerate all 11 golden files with updated prompt

E2E test results: 9/11 tests passing deterministically on first attempt

Known issue: calculator_multiply and calculator_divide tests still fail all 10 attempts
despite seed=42. This suggests qwen2.5-coder:0.5b may not be fully deterministic for
receiver methods. Further investigation needed.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

Pull Request Pull Request #194: feat: AI-powered test case generation

Run Details

685 of 746 new or added lines in 10 files covered. (91.82%)

6 existing lines in 2 files now uncovered.

1547 of 1640 relevant lines covered (94.33%)

1325.96 hits per line