Every Sigil node exposes Prometheus metrics on :7778/metrics. This page lists the recommended dashboards, the alert thresholds operators run in production, and the integration points for status reporting.

Metric categories

CategoryExamplesPurpose
Consensussigil_consensus_round_total, sigil_consensus_rounds_missed_totalTrack MACA participation.
Block applysigil_block_apply_seconds, sigil_state_root_compute_secondsTrack block-time budget.
Mempoolsigil_mempool_size, sigil_mempool_admitted_totalTrack admission pressure.
P2Psigil_p2p_peers_connected, sigil_p2p_bytes_in_totalTrack network health.
Storagesigil_akasha_compaction_seconds, sigil_akasha_disk_bytesTrack AkashaKV health.
RPCsigil_rpc_requests_total, sigil_rpc_5xx_totalTrack public surface load.

Required alerts (validator)

AlertThresholdSeverityAction
Validator inactiveOff the active set for > 1 epochCriticalInvestigate immediately.
Round miss rate> 5% over 24hHighInvestigate consensus link.
Equivocation detectedsigil_consensus_equivocation_total > 0CriticalHalt validator, audit keystore.
P99 block apply> 4 sHighInvestigate CPU or I/O.
Disk usage> 70%HighProvision more storage or prune.
Peer count< 8HighInvestigate networking.
WAL lag> 1 blockHighInvestigate storage.
HSM signing latency> 200 ms p99MediumInvestigate keystore.

Required alerts (RPC node)

AlertThresholdSeverityAction
Sync lag> 10 blocks behind public RPCHighRe-sync or restore from snapshot.
5xx rate> 1% over 5 minutesHighInvestigate.
429 rate> 10% over 5 minutesMediumRate limit may need raising.
WebSocket queue overflowsigil_ws_overflow_total > 0MediumInvestigate slow consumers.

Grafana dashboards

The Sigil Foundation publishes reference dashboards:
DashboardDescription
sigil-validator-overview.jsonOne-pane validator overview. Round participation, block apply, peer health, slashing status.
sigil-rpc-overview.jsonRPC traffic, error rates, sync lag, subscription health.
sigil-consensus.jsonPer-round latency, proposer rotation, quorum margin.
sigil-storage.jsonAkashaKV compaction, WAL lag, disk usage.
All dashboards are at grafana.sigil.ml/dashboards.

Status page integration

Production deployments should report to a status page. The Sigil Foundation uses Atlassian Statuspage; the validator cluster reports to status.sigil.ml. See the status page runbook for the integration recipe.

Log aggregation

Validators emit structured JSON logs via the tracing crate. Recommended sinks: Loki, Elasticsearch, or Datadog. Critical fields:
  • levelINFO, WARN, ERROR.
  • target — module path (sigil_consensus::round, sigil_rpc::handler, etc.).
  • span — current span.
  • block_height, round, validator_did — consensus context.

See also