rieske / trans / 30035549451

92%

push

github

feat(scanner): C-ish tokens, keywords, and string-literal decode (#61)

Expand scanner.lex with C punctuation (. -> ? : ...), hex/float forms,
richer char escapes, and a fuller keyword set (const, struct, sizeof, …)
so later grammar/AST work can see the right terminals.

Add util::StringLiteralDecode for string/escape decoding (unit-tested)
and ScannerTokens tests that pin the new lexemes without depending on
typedef registries or attribute filtering.

63 of 86 new or added lines in 1 file covered. (73.26%)

5782 of 6281 relevant lines covered (92.06%)

199864.66 hits per line