Alan-Jowett / CoPilot-For-Consensus / 20382816326

78%

push

github

Add file upload endpoint and UI for local mailbox ingestion (#467)

* Initial plan

* Add backend upload endpoint and UI file picker

- Added POST /api/uploads endpoint to ingestion service
- Implements file validation (type, size limits up to 100MB)
- Sanitizes filenames to prevent path traversal
- Saves uploads to /data/raw_archives/uploads
- Added file picker UI component for local source type
- Shows upload progress with progress bar
- Auto-fills URL field with server path after upload
- Updated NGINX config with 100MB client_max_body_size
- Added comprehensive unit tests for upload endpoint

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Add python-multipart dependency for file uploads

- Added python-multipart to ingestion requirements.txt
- All upload endpoint tests passing (6/6)
- Tests cover file validation, sanitization, and error cases

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Add documentation for file upload feature

- Updated ingestion README with upload endpoint examples
- Added UI upload workflow documentation
- Documented upload directory structure
- Included curl examples for API usage

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Remove merge conflict markers from styles.css

- Cleaned up git merge conflict markers
- Code review feedback addressed

Co-authored-by: Alan-Jowett <20480683+Alan-Jowett@users.noreply.github.com>

* Address PR review feedback: Fix compound extensions and add tests

- Add _split_extension() helper to properly handle .tar.gz and .tgz
- Validate file extension after sanitization to prevent bypass
- Fix duplicate filename handling to preserve compound extensions
- Fix filename truncation to preserve compound extensions
- Change python-multipart version from == to >= for compatibility
- Add test for file size limit validation (>100MB -> 413 error)
- Add test for compound extension preservation (.tar.gz)

Co-a... (continued)

57 of 64 new or added lines in 1 file covered. (89.06%)

5135 of 6406 relevant lines covered (80.16%)

0.9 hits per line