Logflare / logflare / e08261711390d6c2b99b744f57571e20aa6ee7d0

80%

Build Type

push

github

Committed by web-flow

Commit Message

perf(schema): rewrite SchemaUtils.flatten_typemap as direct walk (#3458)

* chore(bench): add LogEvent.make/2 :tprof profiling script

Adds test/profiling/log_event_make_profile.exs alongside the existing
log_event_make_bench.exs. Reuses the OTEL trace and edge log fixtures
and the Factory-backed source so the profile reflects realistic ingest
shapes (validate_schema defaults to true, exercising the full
BigQuerySchemaChange path).

Selects fixture via FIXTURE=edge_log|otel_trace, profile type via
TPROF_TYPE=time|calls|memory, and iteration count via ITERATIONS=N.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* chore(bench): track LogEvent.make/2 trend via snapshot history file

Adds snapshot/history tooling to test/profiling/log_event_make_bench.exs.
Every run captures ips, wall (avg/median/p99), memory, and reductions
per fixture, loads the most-recent entry from log_event_make_bench.history.exs,
and prints a delta table. Pass SAVE_SNAPSHOT=1 to append a new entry;
LABEL and MACHINE env vars are optional for context.

Seed the history file with an origin/main baseline so the next
performance change can be compared against a real measurement point.

Drop the obsolete static-comment baselines at the bottom of the bench
script — the history file is now the source of truth.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* perf(schema): replace Iteraptor.to_flatmap in flatten_typemap with direct walk

SchemaUtils.flatten_typemap/1 used Iteraptor.to_flatmap, which walks
generic nested structures and pays for that genericity: per-key
Integer.parse to detect list vs map indices, polymorphic String.Chars
dispatch on every value, and key-path concatenation via
Iteraptor.Utils.squeeze. The typemap shape is narrow and known
(%{atom => %{t: type} | %{t: :map, fields: nested}}), so none of that
machinery is load-bearing.

Replace with a direct tail-recursive walk that builds the dot-delimited
flat map in one pass a... (continued)

Coverage Stats

7 of 7 new or added lines in 1 file covered. (100.0%)

9 existing lines in 4 files now uncovered.

12361 of 15548 relevant lines covered (79.5%)

5195.23 hits per line