iotaledger / iota / 21771791033
64%

DEFAULT BRANCH: develop
Ran
Jobs 1
Files 1514
Run time 2min
Badge
Embed ▾
README BADGES
x

If you need to use a raster PNG badge, change the '.svg' to '.png' in the link

Markdown

Textile

RDoc

HTML

Rst
coverage: 63.547% (+0.4%) from 63.136%
21771791033

push

github

web-flow 
feat(starfish): add detailed metrics for accepted headers and transactions (#10107)

# Description of change

Add detailed metrics for tracking accepted block headers and
transactions in Starfish consensus, along with corresponding Grafana
dashboard panels.

**Metrics:**
- `block_manager_suspended_blocks` - counters of how many suspended
blocks in RAM
- `accepted_transactions_source` / `accepted_block_headers_source` -
counters with source and authority labels
- `accepted_transactions_round_gap` / `accepted_block_headers_round_gap`
- histograms by source
- `cordial_knowledge_entries` / `cordial_knowledge_headers_not_known` /
`cordial_knowledge_shards_not_known` - gauges tracking cordial knowledge
data structure sizes
- `core_skipped_transactions` - counter for duplicate non-empty
transactions skipped in core (analogous to `core_skipped_headers`)

**Dashboard panels:**
- Overview: Accepted headers/transactions by source, Skipped
headers/transactions by core
- Accepted Round Gaps (heatmaps per source)
- Starfish RAM: Block manager, DAG state, Cordial knowledge sizes
- Block information: Acknowledgment depth
- Consensus Adapter RAM (Sequencing certificate metrics)

## Links to any relevant issues

Fixes #10108

## How the change has been tested

- [x] Basic tests (linting, compilation, formatting, unit/integration
tests)
- [ ] Patch-specific tests (correctness, functionality coverage)
- [x] I have added tests that prove my fix is effective or that my
feature works
- [x] I have checked that new and existing unit tests pass locally with
my changes

---------

Co-authored-by: Piotr Macek <4007944+piotrm50@users.noreply.github.com>

123 of 160 new or added lines in 6 files covered. (76.88%)

481 existing lines in 69 files now uncovered.

220766 of 347407 relevant lines covered (63.55%)

2789690.67 hits per line

New Missed Lines in Diff

Lines Coverage ∆ File
37
88.95
 -3.5% crates/starfish/core/src/cordial_knowledge.rs

Uncovered Existing Lines

Lines Coverage ∆ File
1
85.8
 9.83% consensus/core/src/authority_service.rs
1
85.0
 1.3% consensus/core/src/subscriber.rs
1
53.85
 26.2% crates/iota-cluster-test/src/faucet.rs
1
83.78
 -7.39% crates/iota-cluster-test/src/test_case/native_transfer_test.rs
1
89.69
 1.03% crates/iota-core/src/connection_monitor.rs
1
88.57
 -2.81% crates/iota-graphql-rpc/src/extensions/feature_gate.rs
1
91.83
 -0.71% crates/iota-json-rpc/src/governance_api.rs
1
29.08
 -14.62% crates/iota-transactional-test-runner/src/lib.rs
1
88.95
 -3.5% crates/starfish/core/src/cordial_knowledge.rs
1
94.5
 0.63% crates/starfish/core/src/transactions_synchronizer.rs
2
56.63
 -9.23% crates/iota-aws-orchestrator/src/client/mod.rs
2
57.27
 11.78% crates/iota-cluster-test/src/cluster.rs
2
70.0
 -18.71% crates/iota-cluster-test/src/test_case/shared_object_test.rs
2
87.47
 -0.04% crates/iota-core/src/authority/authority_per_epoch_store.rs
2
52.17
 -17.06% crates/iota-core/src/mysticeti_adapter.rs
2
73.91
 -10.7% crates/iota-core/src/starfish_adapter.rs
2
76.92
 -7.69% crates/iota-data-ingestion-core/src/progress_store/mod.rs
2
95.22
 -0.87% crates/iota-http/src/lib.rs
2
66.82
 -3.77% crates/iota-json-rpc/src/authority_state.rs
2
89.1
 -1.85% crates/iota-json-rpc/src/move_utils.rs
2
50.0
 -50.0% crates/iota-network/src/randomness/server.rs
3
81.71
 -3.66% consensus/config/src/crypto.rs
3
73.08
 -0.28% crates/iota-core/src/checkpoints/mod.rs
3
19.61
 -5.88% crates/iota-stardust-types/src/block/address/mod.rs
3
57.69
 0.77% crates/iota-stardust-types/src/block/output/basic.rs
3
0.0
 -6.38% crates/iota-stardust-types/src/block/protocol.rs
3
89.56
 0.0% crates/iota-test-transaction-builder/src/lib.rs
3
83.34
 0.08% crates/iota-transactional-test-runner/src/test_adapter.rs
3
97.3
 -2.03% crates/iota-types/src/mock_checkpoint_builder.rs
3
78.78
 0.0% crates/iota-types/src/transaction.rs
3
77.91
 -0.61% external-crates/move/crates/move-vm-test-utils/src/tiered_gas_schedule.rs
4
89.96
 -1.62% consensus/core/src/core_thread.rs
4
65.12
 0.0% crates/iota-config/src/transaction_deny_config.rs
4
72.31
 -0.33% crates/iota-core/src/authority/authority_store.rs
4
90.33
 1.36% crates/iota-core/src/epoch/randomness.rs
4
85.19
 -14.81% crates/iota-grpc-client/src/api/ledger/transactions.rs
4
73.55
 -0.57% crates/iota-network/src/randomness/mod.rs
4
83.25
 -0.49% crates/iota-types/src/base_types.rs
4
73.12
 -1.08% crates/iota-types/src/messages_consensus.rs
4
0.0
 -80.0% crates/iota-types/src/messages_safe_client.rs
5
73.77
 -8.2% crates/iota-core/src/traffic_controller/nodefw_test_server.rs
5
80.0
 -20.0% crates/iota-grpc-client/src/api/execution/simulate.rs
5
84.5
 -0.52% crates/iota/src/client_ptb/builder.rs
5
61.9
 -9.52% crates/iota-storage/src/object_store/mod.rs
5
99.21
 -0.24% crates/starfish/core/src/block_manager/mod.rs
5
86.28
 -0.3% crates/starfish/core/src/leader_timeout.rs
6
80.08
 -0.47% crates/iota-core/src/authority.rs
6
76.3
 -1.3% crates/iota-core/src/storage.rs
6
83.65
 -1.14% crates/iota-grpc-server/src/types.rs
6
13.33
 -41.9% crates/iota-network/src/state_sync/server.rs
6
88.89
 -2.66% crates/starfish/core/src/core_thread.rs
6
85.42
 3.75% crates/starfish/core/src/network/tonic_network.rs
6
82.53
 -1.04% external-crates/move/crates/move-compiler/src/shared/mod.rs
7
88.6
 -0.97% crates/iota-core/src/authority/consensus_quarantine.rs
7
34.3
 -0.19% crates/iota-rest-api/src/client/sdk.rs
7
70.64
 -2.03% crates/iota-transaction-builder/src/utils.rs
8
86.89
 -6.56% crates/iota-transaction-builder/src/package.rs
9
52.02
 -1.35% crates/iota-json-rpc-types/src/iota_object.rs
9
55.72
 -0.43% crates/iota-json-rpc-types/src/iota_transaction.rs
10
85.47
 0.21% consensus/core/src/network/tonic_network.rs
10
91.54
 -0.03% crates/starfish/core/src/header_synchronizer.rs
11
76.34
 1.6% crates/test-cluster/src/lib.rs
13
84.55
 -2.16% crates/iota-transaction-builder/src/lib.rs
15
91.49
 -1.91% crates/iota-core/src/consensus_adapter.rs
17
0.0
 0.0% crates/iota-indexer/src/db.rs
20
90.85
 -1.08% crates/iota-protocol-config/src/lib.rs
25
50.97
 3.73% crates/iota-proxy/src/admin.rs
66
0.0
 0.0% crates/iota-analytics-indexer/src/lib.rs
77
0.0
 0.0% crates/iota-aws-orchestrator/src/ssh.rs
Jobs
ID Job ID Ran Files Coverage
1 nextest+simtest - 21771791033.1 1518
63.41
 GitHub Action Run
Source Files on build 21771791033