Alan-Jowett / CoPilot-For-Consensus / 20141913675

82%

push

github

Add pluggable thread chunking strategies for embedding and summarization (#39)

* Initial plan

* Add thread chunking abstraction layer with implementations

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Fix potential IndexError in TokenWindowChunker and add documentation

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Add architecture documentation for thread chunking abstraction

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Refactor: Move chunking to separate copilot_chunking SDK module

Move chunking functionality from copilot_events to new copilot_chunking module following SDK pattern. This separates chunking concerns and aligns with the project's modular architecture.

Changes:
- Create sdk/copilot_chunking/ module with own setup.py
- Move chunkers.py to copilot_chunking/copilot_chunking/
- Move tests to copilot_chunking/tests/
- Move CHUNKING.md to copilot_chunking/README.md
- Revert copilot_events/__init__.py to remove chunking exports
- Update imports in service integration examples

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Rename sdk directory to adapters

Rename the sdk directory to adapters following project reorganization. Updated all references in documentation and code comments.

Changes:
- Rename sdk/ to adapters/
- Update all references in README files and documentation
- Update path references in chunking_architecture.md
- Tests still pass with new structure

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Fix up pr

Signed-off-by: Alan Jowett <alan.jowett@microsoft.com>

* Cleanup PR:

Signed-off-by: Alan Jowett <alan.jowett@microsoft.com>

* Add CI workflow for copilot_chunking adapter

Add GitHub Actions workflow to test the copilot_chunking adapter following the same pattern as other adapter CI workflows. Includes:
- Unit tests on Python 3.11 and 3.12
- Code coverag... (continued)

139 of 141 new or added lines in 2 files covered. (98.58%)

139 of 141 relevant lines covered (98.58%)

1.97 hits per line