mostafa / xk6-kafka
78%
main: 78%

LAST BUILD BRANCH: refs/tags/v2.2.0
DEFAULT BRANCH: main
Repo Added
Files 27
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

LAST BUILD ON BRANCH refs/tags/v2.2.0
branch: SELECT
CHANGE BRANCH
x

coverage: 78.362% (+0.06%) from 78.301%
34252945442

push

github

web-flow 
perf: restore producer throughput in compat produce config decode (#415)

* perf: restore producer throughput in compat produce config decode

The protobuf serde PR (#389) replaced the produce config decode with a
mapstructure decoder using a per-field reflection hook. That double
reflection walk (export to map, then mapstructure decode) runs on every
produce() call and roughly halved writer throughput: the README
benchmark (scripts/test_json.js, 50 VUs, 60s) dropped from ~373k to
~208k msg/s. Found via git bisect.

Restore the fast JSON round-trip decode and keep the plain-string
payload fix from #389 by normalizing message key/value payloads in the
exported map first: strings and number arrays become []byte in place,
which round-trips losslessly through the base64 semantics encoding/json
applies to []byte fields. Handles both export shapes ([]any from
script-created values, []map[string]any from Go-created ones).

Benchmark on the same machine/container: ~208k -> ~372-382k msg/s,
matching the v2.0.0 tag's ~373k msg/s.

* docs: refresh benchmark results and note v2.1.0 regression

Re-measured scripts/test_json.js (50 VUs, 60s) on the reference machine:
372,484 msg/s (best observed today: 382,078 msg/s), matching the
documented v2.0.0 figure. Also fixes the stale v1.x.x/main framing and
adds a note about the v2.1.0 producer throughput regression.

23 of 40 new or added lines in 1 file covered. (57.5%)

2 existing lines in 2 files now uncovered.

4067 of 5190 relevant lines covered (78.36%)

31.45 hits per line

Relevant lines Covered
5190 RELEVANT LINES 4067 COVERED LINES
31.45 HITS PER LINE
Source Files on main

Recent builds

Builds Branch Commit Type Ran Committer Via Coverage
34252945442 refs/tags/v2.2.0 perf: restore producer throughput in compat produce config decode (#415) * perf: restore producer throughput in compat produce config decode The protobuf serde PR (#389) replaced the produce config decode with a mapstructure decoder using a per-... push web-flow github
78.36
34252756500 main perf: restore producer throughput in compat produce config decode (#415) * perf: restore producer throughput in compat produce config decode The protobuf serde PR (#389) replaced the produce config decode with a mapstructure decoder using a per-... push web-flow github
78.38
34249245069 fix/produce-config-decode-throughput docs: refresh benchmark results and note v2.1.0 regression Re-measured scripts/test_json.js (50 VUs, 60s) on the reference machine: 372,484 msg/s (best observed today: 382,078 msg/s), matching the documented v2.0.0 figure. Also fixes the stale v1... Pull #415 mostafa github
78.36
34237589309 main chore: replace archived hamba/avro with confluent-avro-go (#414) hamba/avro is archived and unmaintained. Confluent maintains a fork (github.com/confluentinc/confluent-avro-go) that continues the v2 line and powers confluent-kafka-go's Schema Reg... push web-flow github
78.3
34236097741 chore/confluent-avro-go chore: replace archived hamba/avro with confluent-avro-go hamba/avro is archived and unmaintained. Confluent maintains a fork (github.com/confluentinc/confluent-avro-go) that continues the v2 line and powers confluent-kafka-go's Schema Registry A... Pull #414 mostafa github
78.3
34229327639 main feat: initialize consumer groups at current end offsets (#412) * feat: initialize consumer groups at current end offsets * fix: harden consumer group offset initialization - Drop the ConsumerGroupOffsetsConfig godoc misplaced above the AdminC... push web-flow github
78.3
34225513395 feature/initialize-consumer-group-offsets fix: retry offset listing while partition leadership settles ListOffsets right after topic creation can fail with NOT_LEADER_FOR_PARTITION (or LEADER_NOT_AVAILABLE, UNKNOWN_TOPIC_OR_PART, REPLICA_NOT_AVAILABLE) while leadership propagates, which ... Pull #412 mostafa github
78.3
34222355351 feature/initialize-consumer-group-offsets docs: regenerate api-docs v2 markdown Output of yarn --cwd api-docs run generate-docs:v2: adds the initializeConsumerGroupOffsets section to AdminClient.md, adds pages for the ConsumerGroupOffsetsConfig and ConsumerGroupOffset interfaces, and ref... Pull #412 mostafa github
78.18
34220425404 main fix: convert numeric types inside array/map union branches in Avro se… (#410) * fix: convert numeric types inside array/map union branches in Avro serializer * fix: wrap map union branches and add array/map union branch tests - Wrap map branch ... push web-flow github
78.7
34218798105 avro-schema-serialization-issue ci: upgrade golangci-lint to v2.13.2 v2.12.2 does not recognize the exhaustruct_v5 linter name (renamed in v2.13.x), failing config validation. v2.13.2 matches the version mise installs locally (golangci-lint = "2"), keeping CI and local lint in ... Pull #410 mostafa github
78.7
See All Builds (517)