humanspeak / svelte-markdown / 37908433827

96%

push

github

fix(streaming): keep text entrances when extensions are loaded (#405)

* fix(streaming): keep text entrances when extension tokenizers are loaded

Loading any Marked extension (e.g. markedKatex) made the provenance tracer
mark the entire parse unknown, so StreamingText suppressed entrances for
every word — even in answers with no math.

Extension tokenizers are now treated as opaque: their tokens, and anything
they lex on their own behalf, stay unknown, while built-in markdown around
them keeps exact source provenance. If built-in text merges into an
extension token, or resolution fails, the parse falls back to all-unknown.
walkTokens and custom tokenizers still make the whole parse unknown.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* test(routes): add KaTeX + streaming motion comparison page

Streams the same answer into panes with and without markedKatex using
RiseWords. Math fades in through a KatexRenderer wrapper that follows the
same `enabled` flag as text motion and respects reduced motion.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>

2149 of 2315 branches covered (92.83%)

Branch coverage included in aggregate %.

43 of 43 new or added lines in 1 file covered. (100.0%)

3076 of 3131 relevant lines covered (98.24%)

224173.68 hits per line