Stevenic / teams-ai / 10567548255

80%

Build Type

push

github

Committed by Stevenic

Commit Message

Updated StreamingResponse class to support queue based delivery of chunks to client

- Added an outbound activity queue to the StreamingResponse class.
- Made protocol fixes identified in latest PR submission.
- Updated LLMClient class to use new queue based chunking methods.

These changes avoid issues with the non-async events fired from the model. Chunks can come in as slow or as fast as they want from the model and they will be delivered as quickly as they can to the client. Chunks may be combined prior to deliver to the client.

Run Details

2807 of 4034 branches covered (69.58%)

Branch coverage included in aggregate %.

9 of 9 new or added lines in 2 files covered. (100.0%)

1 existing line in 1 file now uncovered.

10622 of 12716 relevant lines covered (83.53%)

17.23 hits per line