Max of per-second rate over window

subquery: peak 5m rate sampled each minute over the last hour; spot bursts

max_over_time(rate(node_network_receive_bytes_total[5m])[1h:1m])
tool
prometheus30 commands
tags
prometheusperformancenetworkobservability

More prometheus commands

  • Aggregate keeping all labels but instance
    sum without(instance) (rate(http_requests_total{code=~"5.."}[5m]))

    without() keeps every label except instance; cleaner than listing many by() labels

  • Recording rule for expensive ratio
    groups: - name: slo rules: - record: job:request_errors:ratio5m expr: sum by(job)(rate(http_requests_total{code=~"5.."}[5m])) / sum by(job)(rate(http_requests_total[5m]))

    precompute SLO error ratio to keep dashboards and alerts fast

  • Validate rules and config with promtool
    promtool check rules rules.yml && promtool check config prometheus.yml

    lint before reload; run in CI to catch broken expr/yaml before deploy

  • Instant query from CLI
    promtool query instant http://localhost:9090 'topk(5, sum by(pod)(rate(container_cpu_usage_seconds_total[5m])))'

    run PromQL without a browser; great for scripted top-N investigations

  • Find cardinality offenders in TSDB
    promtool tsdb analyze /prometheus --limit 20

    lists highest-cardinality metrics and label pairs; first stop for memory blowups

all 30 prometheus commands