Alan-Jowett / CoPilot-For-Consensus / 21098755087

78%

push

github

copilot_storage: return schema-clean documents (no backend/system/extra fields) (#905)

* Initial plan

* Add schema-based document sanitization to copilot_storage

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Update ingestion service to use sanitized documents from storage

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Address code review feedback

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Address PR review comments: add edge case tests, improve logging, enhance path resolution

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Fix code review issues: use tuple for cache key, clean up test comments

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Fix code review comments and linting issues

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Fix test expecting system fields that are now sanitized

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Fix schema sanitization + ingestion source serialization

Signed-off-by: Alan Jowett <alan.jowett@microsoft.com>

---------

Signed-off-by: Alan Jowett <alan.jowett@microsoft.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>
Co-authored-by: Alan Jowett <alan.jowett@microsoft.com>

92 of 100 new or added lines in 6 files covered. (92.0%)

7734 of 9921 relevant lines covered (77.96%)

0.88 hits per line