hyperledger / fabric-x-committer / 36705432257

90%

Build Type

push

github

Committed by web-flow

Commit Message

[sidecar] Parse a block's transactions in parallel (#840)

#### Type of change

- Improvement (improvement to code, performance, etc)

#### Description

- Splits `mapBlock` into a parallel parse and a serial fold.
`parseMessages` parses, classifies
and validates each message across up to `max-workers-for-tx-parsing`
goroutines, each given at
least `min-tx-parsing-batch-size` messages, and `applyParsedTX` folds
the results into the
  block in message order.
- Adds the sidecar `max-workers-for-tx-parsing` (default 1, parsing on
one goroutine) and
  `min-tx-parsing-batch-size` (default 256) settings.
- The TX ID dedup set, the one-snapshot-per-block rule and the batch
order stay single-threaded,
so which transactions a block accepts and rejects does not depend on how
parsing was split.
- Replaces `mapConfigTx` with `parseConfigTx` and `appendConfigTx`: a
config TX is validated in
the parallel pass, where failing the block is still an option, and
appended in the serial one.
- Each parse worker builds its own messages' TxWithRefs in per-block
slabs, now allocated in
  `parseMessages`, so the slabs need no locking.

#### Related issues

- resolves #786

Signed-off-by: Liran Funaro <liran.funaro@gmail.com>

Coverage Stats

56 of 64 new or added lines in 3 files covered. (87.5%)

27 existing lines in 8 files now uncovered.

9770 of 10775 relevant lines covered (90.67%)

10674.24 hits per line