hyperledger / fabric-x-committer
91%
main: 91%

LAST BUILD BRANCH: queue-gauge-per-stream
DEFAULT BRANCH: main
Repo Added
Files 132
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst

LAST BUILD ON BRANCH queue-gauge-per-stream
branch: queue-gauge-per-stream
CHANGE BRANCH
x

coverage: 91.219% (+0.2%) from 91.067%
30811478386

Pull #737

github

liran-funaro 
[verifier, sidecar] Report per-stream queues as one series per stream

#### Type of change

- New feature
- Improvement (improvement to code, performance, etc)

#### Description

- Add `monitoring.ChannelLenGaugeVec[T]`, a collector for a queue that exists once per stream.
  `Register`/`Unregister` add and remove a channel, and `Collect` reads the length of each live one,
  so there is still no sampler goroutine and cardinality follows the number of live streams rather
  than growing without bound. A series disappears with its stream, which matters more than the
  cardinality: left behind it would keep reporting the depth of a queue nothing drains, reading as a
  stuck worker rather than a finished one. Re-registering the same label values replaces the channel,
  since prometheus rejects a duplicate series mid-scrape.
- Report the verifier's three `parallelExecutor` queues per stream. The verifier previously exported
  no queue gauge at all, only `active_streams` and `active_requests`, so verification backpressure
  was invisible.
- Report each all-transactions subscription's block queue as
  `sidecar_notifier_stream_block_queue_size`, hooked into the existing `registerAllTxStream` /
  `unregisterAllTxStream`.
- Teach `scripts/metrics_doc_extract.py` to read an explicitly instantiated generic helper,
  including the nested brackets of a slice element (`[[]*committerpb.TxStatus]`), and a label list
  passed as a variable. Both were dropped from the generated doc silently.

#### Additional details (Optional)

`prometheus` has no `GaugeFuncVec`, which is why this needs a custom `Collector` rather than another
helper over `NewGaugeFunc`.

The stream label is a counter, unique only among the live streams — that is all it needs to be, since
a series exists only while its stream does. `docs/performance-tuning.md` now says to read these with
`sum` for the total or `max` to catch one saturated worker while the total still looks healthy.

Verified the guard bit... (continued)
Pull Request #737: [verifier, sidecar] Report per-stream queues as one series per stream

283 of 284 new or added lines in 16 files covered. (99.65%)

14 existing lines in 6 files now uncovered.

10741 of 11775 relevant lines covered (91.22%)

32935.17 hits per line

Relevant lines Covered
11775 RELEVANT LINES 10741 COVERED LINES
32935.17 HITS PER LINE
Source Files on queue-gauge-per-stream

Recent builds

Builds Branch Commit Type Ran Committer Via Coverage
30811478386 queue-gauge-per-stream [verifier, sidecar] Report per-stream queues as one series per stream #### Type of change - New feature - Improvement (improvement to code, performance, etc) #### Description - Add `monitoring.ChannelLenGaugeVec[T]`, a collector for a queue th... Pull #737 liran-funaro github
91.22
See All Builds (961)