FM / profiling

/usr/share/systemtap/examples/profiling/

/usr/share/systemtap/examples/profiling

Name	Size	Mode	Actions
container_check.meta	1064	0644	edit dl rm
container_check.stp	6323	0755	edit dl rm
errno.meta	456	0644	edit dl rm
errno.stp	984	0755	edit dl rm
fileline-profile.meta	783	0644	edit dl rm
fileline-profile.stp	1218	0755	edit dl rm
fntimes.meta	512	0644	edit dl rm
fntimes.stp	870	0755	edit dl rm
fntimes.txt	1375	0644	edit dl rm
functioncallcount.meta	649	0644	edit dl rm
functioncallcount.stp	490	0755	edit dl rm
functioncallcount.tcl	399	0644	edit dl rm
graphcall.stp	534	0755	edit dl rm
ioctl_handler.meta	1209	0644	edit dl rm
ioctl_handler.stp	811	0755	edit dl rm
latencytap.meta	877	0644	edit dl rm
latencytap.stp	12755	0755	edit dl rm
latencytap.tcl	140	0644	edit dl rm
latencytap.txt	2104	0644	edit dl rm
linetimes.meta	688	0644	edit dl rm
linetimes.stp	1608	0755	edit dl rm
linetimes.txt	13936	0644	edit dl rm
perf.meta	578	0644	edit dl rm
perf.stp	1936	0755	edit dl rm
perf.tcl	166	0644	edit dl rm
periodic.meta	895	0644	edit dl rm
periodic.stp	2659	0755	edit dl rm
pf2.meta	420	0644	edit dl rm
pf2.stp	370	0755	edit dl rm
pf2.txt	406	0644	edit dl rm
pf3.meta	439	0644	edit dl rm
pf3.stp	992	0755	edit dl rm
pf3.txt	489	0644	edit dl rm
pf4.meta	471	0644	edit dl rm
pf4.stp	952	0755	edit dl rm
pf4.tcl	79	0644	edit dl rm
pf4.txt	754	0644	edit dl rm
sched_switch.meta	780	0644	edit dl rm
sched_switch.stp	2127	0755	edit dl rm
syscallerrorsbypid.meta	1067	0644	edit dl rm
syscallerrorsbypid.stp	950	0755	edit dl rm
syscalllatency.meta	1072	0644	edit dl rm
syscalllatency.stp	989	0755	edit dl rm
syscallsbypid.meta	1020	0644	edit dl rm
syscallsbypid.stp	785	0755	edit dl rm
syscallsrw.meta	489	0644	edit dl rm
syscallsrw.stp	375	0755	edit dl rm
thread-times.meta	384	0644	edit dl rm
thread-times.stp	1241	0755	edit dl rm
thread-times.txt	1009	0644	edit dl rm
timeout.meta	728	0644	edit dl rm
timeout.stp	2775	0755	edit dl rm
topsys.meta	446	0644	edit dl rm
topsys.stp	745	0755	edit dl rm
ucalls.meta	1065	0644	edit dl rm
ucalls.stp	3544	0755	edit dl rm

Edit: /usr/share/systemtap/examples/profiling/latencytap.txt (2104B)

latencytap.stp - Show Reasons and Durations for Processes Sleeping

The latencytap.stp script collects data on the intervals processes
  are deactivated (sleeping).  The script categorizes the reasons for
  the sleeps by analyzing the backtraces and displays a sorted list of
  the top 20 causes from largest total sum time sleeping to smallest.
  The output is updated every 30 seconds. The script needs to be
  compiled with the '--all-modules' option to produce reasons for
  sleeps caused by modules.  Optionally, this script can be used with
  the '-c' or '-x' options to focus on a specific PID.

$ stap latencytap.stp --all-modules -w

Reason                                            Count  Average(us)  Maximum(us) Percent%
kernel workqueue thread                             109      1232008     14462131      44%
Waiting for event (poll)                              3     13340013     20020024      13%
Waiting for event (poll)                            148       200224       200381       9%
RCU grace period kernel thread                        7      4010912      9997792       9%
                                                      5      5615087      9997712       9%

jdb2() kernel thread                                  2     10716824     14449748       7%
Application requested delay                           2      9999829      9999833       6%
jdb2() kernel thread                                  3       288906       541672       0%
RCU grace period kernel thread                        8         2542         2994       0%
                                                      7         2519         2958       0%
Creating block layer request                          1         1599         1599       0%
Submitting block IO                                  15          103          118       0%
jdb2() kernel thread                                  3          333          395       0%
Waiting for event (epoll)                             1          342          342       0%
Creating block layer request                          1          271          271       0%

latencytap.stp - Show Reasons and Durations for Processes Sleeping The latencytap.stp script collects data on the intervals processes are deactivated (sleeping). The script categorizes the reasons for the sleeps by analyzing the backtraces and displays a sorted list of the top 20 causes from largest total sum time sleeping to smallest. The output is updated every 30 seconds. The script needs to be compiled with the '--all-modules' option to produce reasons for sleeps caused by modules. Optionally, this script can be used with the '-c' or '-x' options to focus on a specific PID. $ stap latencytap.stp --all-modules -w Reason Count Average(us) Maximum(us) Percent% kernel workqueue thread 109 1232008 14462131 44% Waiting for event (poll) 3 13340013 20020024 13% Waiting for event (poll) 148 200224 200381 9% RCU grace period kernel thread 7 4010912 9997792 9% 5 5615087 9997712 9% jdb2() kernel thread 2 10716824 14449748 7% Application requested delay 2 9999829 9999833 6% jdb2() kernel thread 3 288906 541672 0% RCU grace period kernel thread 8 2542 2994 0% 7 2519 2958 0% Creating block layer request 1 1599 1599 0% Submitting block IO 15 103 118 0% jdb2() kernel thread 3 333 395 0% Waiting for event (epoll) 1 342 342 0% Creating block layer request 1 271 271 0%