Quantile over unwrapped latency loki
p99 latency from a numeric log field per route. note: unwrap needs a numeric label/field.
quantile_over_time(0.99, {app="api"} | json | unwrap latency_ms [5m]) by (route)
more loki
all 7 commands →
Count matching lines over time
sum(count_over_time({namespace="prod"} |~ "timeout|deadline exceeded" [1m]))
logcli ad-hoc query
logcli query '{job="app/api"} |= "panic"' --since=1h --limit=200 --output=jsonl
Loki query_range via API
curl -sG "$LOKI_ADDR/loki/api/v1/query_range" --data-urlencode 'query=sum(rate({app="api"}[5m]))' --data-urlencode 'step=60' | jq '.data.result'
Push log lines to Loki
curl -s -H 'Content-Type: application/json' -XPOST "$LOKI_ADDR/loki/api/v1/push" -d '{"streams":[{"stream":{"app":"test"},"values":[["'$(date +%s%N)'","hello loki"]]}]}'
Parse JSON logs and reshape line
{app="api"} |= "error" | json | line_format "{{.level}} {{.msg}}"