16392682388
100%
PROD: 100%

Ran 19 Jul 2025 09:00PM UTC

Jobs 1

Files 1

Run time 1min

Badge

Embed ▾

Committed 19 Jul 2025 08:58PM UTC coverage: 100.0%. Remained the same

Build # 16392682388

Build Type

push

github

Committed by

imjuliengaupin

Commit Message

Implemented robust data validation pipeline with dynamic schema handling

- Add three-tier validation system (Pydantic → Fallback → Manual)
- Fix single record vs array data flow normalization across all agents
- Implement dynamic schema transformation detection and recreation
- Add comprehensive type safety with proper MyPy annotations
- Fix logging inconsistencies for accurate record count reporting
- Add transformation metadata tracking (is_transformed, transformed_on)
- Implement graceful error handling with detailed error messages
- Add live dashboard with before/after transformation previews
- Support all data formats: single records, arrays, NDJSON
- Add schema update logic for all transformation modes

Core changes:
- DataValidationAgent: Dynamic schema recreation + 3-tier fallback
- DataTransformationAgent: Proper record counting + schema updates
- DataIngestionAgent: Fixed record count reporting
- Schema generators: Enhanced dynamic model creation
- All agents: Consistent type hints and error handling

Resolves data processing pipeline robustness and type safety

Run Details

2 of 2 relevant lines covered (100.0%)

1.0 hits per line

Jobs

ID	Job ID	Ran	Files	Coverage
1	16392682388.1	19 Jul 2025 09:00PM UTC	1	100.0	GitHub Action Run

imjuliengaupin / bourne / 16392682388
100%
PROD: 100%

README BADGES
x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 16392682388

imjuliengaupin / bourne / 16392682388 100% PROD: 100%

README BADGES x

Markdown

Textile

RDoc

HTML

Rst

Jobs

Source Files on build 16392682388

imjuliengaupin / bourne / 16392682388
100%
PROD: 100%

README BADGES
x