Alan-Jowett / CoPilot-For-Consensus / 20150984098

82%

push

github

Add schema validation wrappers for Pub/Sub and Document Storage (#91)

* Initial plan

* Add ValidatingEventPublisher and ValidatingDocumentStore with tests and examples

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Update README documentation for ValidatingEventPublisher and ValidatingDocumentStore

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Fix linting issues in validating adapters

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Fix circular dependency between adapters

- Made copilot-schema-validation optional for copilot_storage (install with [validation] extra)
- Kept copilot-schema-validation required for copilot_events (needed for event models)
- Updated install_adapters.py to correct dependency order
- Updated README to document optional dependency

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Switch ingestion service to use ValidatingEventPublisher

- Wrapped base publisher with ValidatingEventPublisher for automatic schema validation
- All published events (ArchiveIngested, ArchiveIngestionFailed) now validated before publishing
- Updated README to document schema validation feature
- All tests pass (10/10)

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Update adapters/copilot_storage/README.md

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Fix schema validation error in ingestion service

- Remove 'status' field from ArchiveMetadata when creating ArchiveIngested event
- The 'status' field is used internally for logging but not part of the event schema
- This resolves validation failure when using ValidatingEventPublisher

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Fix missing import: add create_logger from copilot_logging

* Fix publisher variable reference: use base_publisher before wrapping with ValidatingEventP... (continued)

111 of 123 new or added lines in 4 files covered. (90.24%)

399 of 682 relevant lines covered (58.5%)

0.59 hits per line