dcdpr / jp / 28382385386

69%

Build Type

push

github

Committed by web-flow

Commit Message

feat(md, cli): Stream top-level paragraphs incrementally (#805)

Long assistant paragraphs — a single prose line with no internal
newlines — previously stalled the terminal until the whole paragraph
arrived, sometimes over a minute for a reasoning block. The buffer now
streams a top-level paragraph incrementally as its content grows, so
output appears as it is generated rather than only when the block
terminates.

Streamed output is byte-for-byte identical to whole-paragraph rendering:
the renderer accumulates the paragraph's source, re-renders the growing
buffer on each chunk, and prints only the stable committed prefix
(everything up to the last wrapped newline), holding the in-progress
visual line until a later chunk or the terminator commits it. The
concatenation of all printed deltas equals
`format_terminal_with(full_paragraph, opts)` exactly.

Several guards manage the ambiguities that would otherwise break that
guarantee:

- **Block-start** — the partial-line classifier enters paragraph mode as
soon as the line's first non-space character rules out every block
starter (header, fence, list, HTML, thematic break, reference, table),
so a leading `#` / `` ` `` / `|` / digit / etc. waits for the newline.
- **Setext threshold** — a source-byte threshold (~128) holds the first
line or two so a short setext underline can still turn a run into a
heading.
- **Inline ground state** — the committed prefix never ends inside an
open inline construct (emphasis, code span, link, angle bracket).
- **Tables** — a block whose header line begins with a pipe is kept
whole and never streamed, because a table's column widths depend on its
later rows and so its rendering is not prefix-stable.
- **Wrap-in-progress** — the renderer holds the in-progress visual line
until it is committed.

Byte-identity has two documented exceptions, both almost never produced
by LLM output: a setext heading whose content exceeds the threshold
streams as prose instead of becoming a headi... (continued)

Coverage Stats

233 of 237 new or added lines in 3 files covered. (98.31%)

5 existing lines in 1 file now uncovered.

37287 of 55247 relevant lines covered (67.49%)

681.8 hits per line