Instant query from CLI

run PromQL without a browser; great for scripted top-N investigations

promtool query instant http://localhost:9090 'topk(5, sum by(pod)(rate(container_cpu_usage_seconds_total[5m])))'
tool
prometheus30 commands
tags
prometheusdebugtroubleshootingperformance

More prometheus commands

  • Find cardinality offenders in TSDB
    promtool tsdb analyze /prometheus --limit 20

    lists highest-cardinality metrics and label pairs; first stop for memory blowups

  • Query Prometheus via curl
    curl -sG 'http://prometheus:9090/api/v1/query' --data-urlencode 'query=up' | jq .

    Ad-hoc PromQL query from CLI

  • Instant query via promtool
    promtool query instant http://prometheus:9090 'up{job="kubelet"}'

    Run an instant PromQL query using promtool

  • Range query via curl
    curl -sG 'http://prometheus:9090/api/v1/query_range' --data-urlencode 'query=rate(http_requests_total[5m])' --data-urlencode 'start=2024-01-01T00:00:00Z' --data-urlencode 'end=2024-01-01T01:00:00Z' --data-urlencode 'step=60s' | jq .

    Query Prometheus for a time range via HTTP API

  • Check alert rules
    promtool check rules rules.yml

    Validate Prometheus alert/recording rule files for syntax

all 30 prometheus commands