Disk usage alert rule

PromQL expression: fire when root disk > 85% used

100 - (node_filesystem_avail_bytes{mountpoint="/"} / node_filesystem_size_bytes{mountpoint="/"} * 100) > 85

tool
prometheus30 commands
tags
prometheusmonitoring

More prometheus commands

  • curl -X POST http://prometheus:9090/-/reload

    Hot reload Prometheus config and rules without restart

  • curl -s http://prometheus:9090/api/v1/alerts | jq '.data.alerts[] | select(.state=="firing") | {name: .labels.alertname, severity: .labels.severity}'

    Show only firing alerts with name and severity

  • curl -s http://prometheus:9090/api/v1/label/__name__/values | jq '.data | length, .[0:20]'

    Count total metric names and preview first 20

  • count by (job) ({__name__=~".+"})

    PromQL: count active time series grouped by job label

  • amtool silence add alertname=HighMemory --duration=2h --comment='Investigating'

    Create an Alertmanager silence for 2 hours

all 30 prometheus commands