KusionStack / karpor / 39579317773

65%

Build Type

push

github

Committed by web-flow

Commit Message

fix(ai): stop the stream goroutine when the context is cancelled (#866)

## What type of PR is this?

/kind bug

## What this PR does / why we need it:

`GenerateStream` of the OpenAI, Azure OpenAI and DeepSeek clients
(`pkg/infra/ai`) starts a goroutine that sends every chunk, and the
final `ERROR: ...` message, to a buffered channel (size 100) without
looking at `ctx`. If the consumer stops reading and cancels the context
(for example the HTTP client disconnected), the goroutine blocks forever
on the full channel and keeps the upstream HTTP response open.

This wraps the sends in a `select` on `ctx.Done()`, the same way the
Hugging Face client already does.

## Tests

New `pkg/infra/ai/stream_cancel_test.go`: a server streams 300 chunks
(more than the buffer), the consumer reads nothing and cancels the
context, and the test checks that the `GenerateStream` goroutine exits.
It runs for the three clients, fails on `main` for all three and passes
with the change. `gofmt`, `go vet` and `go test ./pkg/infra/ai/` are
clean (golang:1.26 container).

## Special notes for your reviewer:

This change was made with Claude Code.

Co-authored-by: elliotxx <951376975@qq.com>

Coverage Stats

12 of 21 new or added lines in 3 files covered. (57.14%)

5 existing lines in 4 files now uncovered.

4501 of 6902 relevant lines covered (65.21%)

0.72 hits per line