bramp / build-along / 19059580114

89%

Build Type

push

github

Committed by bramp

Commit Message

Add golden file testing framework for classifier

Implements a golden file testing framework to validate classifier behavior
through snapshot testing. Tests will skip until expected files are created
after classifier invariants are fixed.

New files:
- classifier_golden_test.py: Golden file test implementation with custom
  serialization for classification results that handles Element objects as
  dict keys and provides clean JSON output format
- generate_golden_files.py: Script to regenerate golden files after fixes
- fixtures/*_raw.json: 9 test fixtures from set 75375 covering various
  page layouts (parts lists, building steps, etc.)
- fixtures/README.md: Documentation for the test fixture format

BUILD changes:
- Added 'generate-golden-files' target with sandboxing disabled
- Added 'fixtures' files() target for JSON test data
- Tests depend on fixtures for golden file comparisons

The framework uses __tag__ field (dataclass-wizard convention) for type
identification. Custom serialization in _serialize_classification_result
is necessary because:
1. Element objects are used as dict keys (not JSON serializable)
2. Golden files need simplified format with string IDs
3. Circular references (page_data) must be removed

Tests currently skip for missing expected files, to be generated once
classifier bugs are fixed.

Run Details

17 of 116 new or added lines in 1 file covered. (14.66%)

122 existing lines in 4 files now uncovered.

3579 of 4248 relevant lines covered (84.25%)

0.84 hits per line