Analyze scheduler latency

Record context switches and show wakeup latency per task to find tasks waiting too long in the run queue

perf sched record -- sleep 10 && perf sched latency --sort max

tool
perf17 commands
tags
perfperformancekerneltroubleshooting

More perf commands

  • perf trace -s -p <pid>

    Trace syscalls like strace and print a summary with -s; lower overhead because it does not use ptrace

  • perf probe --add 'tcp_sendmsg size' && perf record -e probe:tcp_sendmsg -a -- sleep 5

    Add a kprobe that captures an argument and record it, so you can look inside the kernel without rebuilding it

  • perf record -g ./my_app

    Record performance data with call graphs

  • perf report

    Browse the recorded perf data interactively

  • perf list

    List all perf events that this system supports

all 17 perf commands