Detect OOMKilled containers

List pods whose last container exit was OOMKilled across all namespaces

kubectl get po -A -o jsonpath='{range .items[*]}{.metadata.namespace}{" "}{.metadata.name}{" "}{.status.containerStatuses[*].lastState.terminated.reason}{"\n"}{end}' | grep OOMKilled
tool
k8s-debug27 commands
tags
k8s-debugtroubleshootingperformancek8s

More k8s-debug commands

  • Pending pods scheduling reason
    kubectl get po -A --field-selector=status.phase=Pending -o name | xargs -I{} kubectl describe {} -n <ns> | grep -A3 FailedScheduling

    Extract FailedScheduling reasons for every Pending pod (taints, resources, affinity)

  • Node NotReady triage
    kubectl describe node <node> | grep -A12 Conditions; ssh <node> 'journalctl -u kubelet -n 100 --no-pager'

    Read node Conditions then tail kubelet journal to find why node is NotReady

  • ImagePullBackOff root cause
    kubectl get events -n <ns> --field-selector reason=Failed -o wide | grep -i 'pull\|manifest\|unauthorized'

    Surface registry pull failures: bad tag, missing imagePullSecret, or rate limit

  • Cleanup evicted pods
    kubectl get po -A | grep Evicted | awk '{print $2" -n "$1}' | xargs -L1 kubectl delete po

    Bulk-delete all Evicted pods left behind by node-pressure eviction

  • Force-remove stuck Terminating pod
    kubectl patch po <pod> -n <ns> -p '{"metadata":{"finalizers":null}}' --type=merge; kubectl delete po <pod> -n <ns> --grace-period=0 --force

    Clear finalizers to unstick a pod hung in Terminating; note: confirm node is gone first

all 27 k8s-debug commands