evolution-gaming / kafka-journal / 14332624683

83%

master: 94%

Build Type

push

Committed by migesok

Commit Message

New improved Kafka offset commit logic for replicator

The next release version should have a minor increment - 4.2.0

- TopicCommit.apply renamed to TopicCommit.sync, TopicCommit.apply deprecated
- Added TopicCommit.asyncPeriodic implementation
- TopicCommit.delayed deprecated in favor of TopicCommit.asyncPeriodic
- TopicCommit.asyncPeriodic is used by default in the replicator
- updated skafka for an async commit method fix

Main features of asyncPeriodic:
- periodic commits are done asynchronously without blocking the main poll loop, improving latency
- it properly handles rebalance, not loosing progress for revoked partitions
- same logic commits offsets on app shutdown because Java consumer invokes revoke partition callbacks
  on closure
- gracefully handles RebalanceInProgressException

Additionally:
- made TopicCommit journal package private - it is used only in journal package private APIs,
  and it is not supposed to be used outside the internal journal code
- ToTry[StateT] impl in ConsumeTopicTest - it didn't work on flatMap'ed RebalanceCallback's

Run Details

61 of 78 new or added lines in 5 files covered. (78.21%)

18 existing lines in 14 files now uncovered.

3221 of 3885 relevant lines covered (82.91%)

1.41 hits per line