[af_unix] afd20b9290: stress-ng.sockdiag.ops_per_sec -26.3% regression
by kernel test robot
Greeting,
FYI, we noticed a -26.3% regression of stress-ng.sockdiag.ops_per_sec due to commit:
commit: afd20b9290e184c203fe22f2d6b80dc7127ba724 ("af_unix: Replace the big lock with small locks.")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: stress-ng
on test machine: 128 threads 2 sockets Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz with 128G memory
with following parameters:
nr_threads: 100%
testtime: 60s
class: network
test: sockdiag
cpufreq_governor: performance
ucode: 0xd000280
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
sudo bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
sudo bin/lkp run generated-yaml-file
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
=========================================================================================
class/compiler/cpufreq_governor/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
network/gcc-9/performance/x86_64-rhel-8.3/100%/debian-10.4-x86_64-20200603.cgz/lkp-icl-2sp6/sockdiag/stress-ng/60s/0xd000280
commit:
e6b4b87389 ("af_unix: Save hash in sk_hash.")
afd20b9290 ("af_unix: Replace the big lock with small locks.")
e6b4b873896f0e92 afd20b9290e184c203fe22f2d6b
---------------- ---------------------------
%stddev %change %stddev
\ | \
3.129e+08 -26.3% 2.306e+08 stress-ng.sockdiag.ops
5214640 -26.3% 3842782 stress-ng.sockdiag.ops_per_sec
82895 -6.9% 77178 stress-ng.time.involuntary_context_switches
103737 -9.5% 93892 stress-ng.time.voluntary_context_switches
7067 -6.3% 6620 vmstat.system.cs
0.05 -0.0 0.04 ± 6% mpstat.cpu.all.soft%
0.13 ± 3% -0.0 0.12 ± 5% mpstat.cpu.all.usr%
1783836 ± 7% -21.6% 1397649 ± 12% numa-vmstat.node1.numa_hit
1689477 ± 8% -22.9% 1303128 ± 13% numa-vmstat.node1.numa_local
894897 ± 22% +46.6% 1312222 ± 11% turbostat.C1E
3.85 ± 55% +3.5 7.33 ± 10% turbostat.C1E%
2451882 ± 4% -24.3% 1855676 ± 2% numa-numastat.node0.local_node
2501404 ± 3% -23.8% 1905161 ± 3% numa-numastat.node0.numa_hit
2437526 -24.1% 1849165 ± 3% numa-numastat.node1.local_node
2503693 -23.5% 1915338 ± 3% numa-numastat.node1.numa_hit
7977 ± 19% -22.6% 6178 ± 8% softirqs.CPU2.RCU
7989 ± 25% -23.4% 6121 ± 3% softirqs.CPU25.RCU
8011 ± 24% -26.8% 5862 ± 3% softirqs.CPU8.RCU
890963 ± 3% -17.4% 735738 softirqs.RCU
74920 -3.6% 72233 proc-vmstat.nr_slab_unreclaimable
5007343 -23.7% 3821593 proc-vmstat.numa_hit
4891675 -24.2% 3705934 proc-vmstat.numa_local
5007443 -23.7% 3821701 proc-vmstat.pgalloc_normal
4796850 -24.7% 3610677 proc-vmstat.pgfree
0.71 ± 17% -41.1% 0.42 perf-stat.i.MPKI
0.12 ± 12% -0.0 0.10 ± 8% perf-stat.i.branch-miss-rate%
10044516 ± 13% -23.6% 7678759 ± 3% perf-stat.i.cache-misses
42758000 ± 6% -28.5% 30580693 perf-stat.i.cache-references
6920 -5.9% 6510 perf-stat.i.context-switches
571.08 ± 2% -13.4% 494.31 ± 2% perf-stat.i.cpu-migrations
39356 ± 12% +29.2% 50865 ± 3% perf-stat.i.cycles-between-cache-misses
0.01 ± 36% -0.0 0.00 ± 24% perf-stat.i.dTLB-load-miss-rate%
0.01 ± 23% -0.0 0.00 ± 14% perf-stat.i.dTLB-store-miss-rate%
8.447e+08 +27.0% 1.073e+09 perf-stat.i.dTLB-stores
13.36 -2.2% 13.07 perf-stat.i.major-faults
364.56 ± 9% -24.9% 273.60 perf-stat.i.metric.K/sec
350.63 +0.7% 353.23 perf-stat.i.metric.M/sec
87.88 +1.4 89.23 perf-stat.i.node-load-miss-rate%
1381985 ± 12% -27.7% 999393 ± 3% perf-stat.i.node-load-misses
198989 ± 6% -31.9% 135458 ± 4% perf-stat.i.node-loads
4305132 -27.4% 3124590 perf-stat.i.node-store-misses
581796 ± 5% -25.6% 432807 ± 3% perf-stat.i.node-stores
0.46 ± 5% -28.7% 0.33 perf-stat.overall.MPKI
39894 ± 12% +28.6% 51310 ± 3% perf-stat.overall.cycles-between-cache-misses
0.01 ± 22% -0.0 0.00 ± 12% perf-stat.overall.dTLB-store-miss-rate%
9916145 ± 13% -23.8% 7560589 ± 3% perf-stat.ps.cache-misses
42385546 ± 5% -28.7% 30225277 perf-stat.ps.cache-references
6786 -5.9% 6385 perf-stat.ps.context-switches
562.65 ± 2% -13.5% 486.73 ± 2% perf-stat.ps.cpu-migrations
8.314e+08 +26.8% 1.055e+09 perf-stat.ps.dTLB-stores
1359293 ± 11% -27.7% 982331 ± 3% perf-stat.ps.node-load-misses
205280 ± 6% -33.3% 136979 ± 5% perf-stat.ps.node-loads
4237942 -27.5% 3070934 perf-stat.ps.node-store-misses
585102 ± 5% -26.6% 429702 ± 3% perf-stat.ps.node-stores
5.844e+12 +0.9% 5.897e+12 perf-stat.total.instructions
99.26 +0.5 99.72 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.sendmsg
99.25 +0.5 99.72 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.sendmsg
99.25 +0.5 99.72 perf-profile.calltrace.cycles-pp.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe.sendmsg
99.26 +0.5 99.73 perf-profile.calltrace.cycles-pp.sendmsg
99.24 +0.5 99.71 perf-profile.calltrace.cycles-pp.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe
99.24 +0.5 99.71 perf-profile.calltrace.cycles-pp.sock_sendmsg.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg.do_syscall_64
99.25 +0.5 99.72 perf-profile.calltrace.cycles-pp.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe.sendmsg
99.24 +0.5 99.71 perf-profile.calltrace.cycles-pp.netlink_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg
97.56 +0.5 98.04 perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.sock_diag_rcv.netlink_unicast.netlink_sendmsg
99.22 +0.5 99.70 perf-profile.calltrace.cycles-pp.netlink_unicast.netlink_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg
99.19 +0.5 99.68 perf-profile.calltrace.cycles-pp.sock_diag_rcv.netlink_unicast.netlink_sendmsg.sock_sendmsg.____sys_sendmsg
98.41 +0.5 98.90 perf-profile.calltrace.cycles-pp.__mutex_lock.sock_diag_rcv.netlink_unicast.netlink_sendmsg.sock_sendmsg
0.48 -0.4 0.07 ± 5% perf-profile.children.cycles-pp.recvmsg
0.46 ± 2% -0.4 0.06 perf-profile.children.cycles-pp.___sys_recvmsg
0.47 ± 2% -0.4 0.07 ± 6% perf-profile.children.cycles-pp.__sys_recvmsg
0.45 -0.4 0.06 ± 9% perf-profile.children.cycles-pp.____sys_recvmsg
1.14 -0.4 0.76 perf-profile.children.cycles-pp.netlink_dump
1.09 -0.4 0.73 perf-profile.children.cycles-pp.unix_diag_dump
0.66 -0.3 0.37 ± 2% perf-profile.children.cycles-pp._raw_spin_lock
0.26 ± 2% -0.1 0.19 ± 2% perf-profile.children.cycles-pp.sk_diag_fill
0.07 ± 5% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.__x64_sys_socket
0.07 ± 5% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.__sys_socket
0.07 -0.0 0.04 ± 57% perf-profile.children.cycles-pp.__close
0.12 ± 4% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.memset_erms
0.11 ± 4% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.nla_put
0.08 ± 5% -0.0 0.06 perf-profile.children.cycles-pp.__nlmsg_put
0.08 ± 5% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.__socket
0.08 -0.0 0.06 ± 7% perf-profile.children.cycles-pp.__nla_put
0.07 -0.0 0.05 perf-profile.children.cycles-pp.__nla_reserve
0.07 ± 5% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.rcu_core
0.08 ± 5% -0.0 0.06 perf-profile.children.cycles-pp.__softirqentry_text_start
0.07 -0.0 0.05 ± 8% perf-profile.children.cycles-pp.rcu_do_batch
0.06 ± 7% -0.0 0.05 perf-profile.children.cycles-pp.sock_i_ino
99.89 +0.0 99.92 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
99.89 +0.0 99.92 perf-profile.children.cycles-pp.do_syscall_64
0.00 +0.1 0.08 perf-profile.children.cycles-pp.__raw_callee_save___native_queued_spin_unlock
99.26 +0.5 99.73 perf-profile.children.cycles-pp.sendmsg
99.25 +0.5 99.72 perf-profile.children.cycles-pp.__sys_sendmsg
99.25 +0.5 99.72 perf-profile.children.cycles-pp.___sys_sendmsg
99.24 +0.5 99.71 perf-profile.children.cycles-pp.____sys_sendmsg
99.24 +0.5 99.71 perf-profile.children.cycles-pp.sock_sendmsg
99.24 +0.5 99.71 perf-profile.children.cycles-pp.netlink_sendmsg
99.22 +0.5 99.70 perf-profile.children.cycles-pp.netlink_unicast
97.59 +0.5 98.08 perf-profile.children.cycles-pp.osq_lock
99.19 +0.5 99.68 perf-profile.children.cycles-pp.sock_diag_rcv
98.41 +0.5 98.90 perf-profile.children.cycles-pp.__mutex_lock
0.12 ± 5% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.unix_diag_dump
0.11 -0.0 0.08 perf-profile.self.cycles-pp.memset_erms
0.00 +0.1 0.06 perf-profile.self.cycles-pp.__raw_callee_save___native_queued_spin_unlock
0.28 ± 5% +0.1 0.35 ± 2% perf-profile.self.cycles-pp._raw_spin_lock
97.23 +0.5 97.72 perf-profile.self.cycles-pp.osq_lock
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang
1 week, 4 days
[memcg] 0f12156dff: will-it-scale.per_process_ops -33.6% regression
by kernel test robot
Greeting,
FYI, we noticed a -33.6% regression of will-it-scale.per_process_ops due to commit:
commit: 0f12156dff2862ac54235fc72703f18770769042 ("memcg: enable accounting for file lock caches")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: will-it-scale
on test machine: 104 threads 2 sockets Skylake with 192G memory
with following parameters:
nr_task: 50%
mode: process
test: lock1
cpufreq_governor: performance
ucode: 0x2006a0a
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
In addition to that, the commit also has significant impact on the following tests:
+------------------+---------------------------------------------------------------------------------+
| testcase: change | will-it-scale: will-it-scale.per_process_ops -40.9% regression |
| test machine | 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz with 256G memory |
| test parameters | cpufreq_governor=performance |
| | mode=process |
| | nr_task=50% |
| | test=lock1 |
| | ucode=0xd000280 |
+------------------+---------------------------------------------------------------------------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
bin/lkp run generated-yaml-file
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-9/performance/x86_64-rhel-8.3/process/50%/debian-10.4-x86_64-20200603.cgz/lkp-skl-fpga01/lock1/will-it-scale/0x2006a0a
commit:
b655843444 ("memcg: enable accounting for pollfd and select bits arrays")
0f12156dff ("memcg: enable accounting for file lock caches")
b655843444152c0a 0f12156dff2862ac54235fc7270
---------------- ---------------------------
%stddev %change %stddev
\ | \
65855410 -33.6% 43722413 ± 5% will-it-scale.52.processes
1266449 -33.6% 840815 ± 5% will-it-scale.per_process_ops
65855410 -33.6% 43722413 ± 5% will-it-scale.workload
141099 ± 3% +8.2% 152680 ± 2% meminfo.Active
140875 ± 3% +8.2% 152456 ± 2% meminfo.Active(anon)
28.79 +6.7 35.47 mpstat.cpu.all.sys%
20.49 -6.7 13.76 ± 5% mpstat.cpu.all.usr%
138801 ± 3% +8.4% 150456 ± 2% numa-meminfo.node1.Active
138689 ± 3% +8.4% 150381 ± 2% numa-meminfo.node1.Active(anon)
34681 ± 3% +8.3% 37570 ± 2% numa-vmstat.node1.nr_active_anon
34681 ± 3% +8.3% 37570 ± 2% numa-vmstat.node1.nr_zone_active_anon
4480 ± 3% -85.9% 632.67 ± 12% slabinfo.Acpi-Parse.active_objs
4480 ± 3% -85.9% 632.67 ± 12% slabinfo.Acpi-Parse.num_objs
2957456 ±214% -96.5% 104939 ± 5% turbostat.C1
103.99 +5.8% 110.04 turbostat.RAMWatt
19.83 -34.5% 13.00 ± 4% vmstat.cpu.us
2487 ± 2% +4.4% 2596 vmstat.system.cs
35219 ± 3% +8.2% 38114 ± 2% proc-vmstat.nr_active_anon
10977 +1.8% 11171 proc-vmstat.nr_mapped
40640 ± 3% +7.6% 43745 ± 2% proc-vmstat.nr_shmem
35219 ± 3% +8.2% 38114 ± 2% proc-vmstat.nr_zone_active_anon
53061 ± 3% +6.5% 56488 ± 3% proc-vmstat.pgactivate
0.02 ± 19% -24.0% 0.01 ± 18% perf-sched.sch_delay.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
9.26 ± 21% -39.8% 5.58 ± 14% perf-sched.wait_and_delay.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
172.83 ± 11% -29.4% 122.00 ± 5% perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk
127.50 ± 4% +47.8% 188.50 ± 7% perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode
1080 ± 19% +66.6% 1799 ± 13% perf-sched.wait_and_delay.count.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
7204 ± 3% -12.0% 6337 perf-sched.wait_and_delay.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
7204 ± 3% -12.0% 6337 perf-sched.wait_and_delay.max.ms.do_syslog.part.0.kmsg_read.vfs_read
7209 ± 3% -12.0% 6342 perf-sched.wait_and_delay.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read
6825 ± 4% -11.5% 6036 perf-sched.wait_and_delay.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
9.26 ± 21% -39.8% 5.57 ± 14% perf-sched.wait_time.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
7204 ± 3% -12.0% 6337 perf-sched.wait_time.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
7204 ± 3% -12.0% 6337 perf-sched.wait_time.max.ms.do_syslog.part.0.kmsg_read.vfs_read
0.05 ± 7% +751.3% 0.40 ±180% perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_reschedule_ipi.[unknown]
7209 ± 3% -12.0% 6342 perf-sched.wait_time.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read
6825 ± 4% -11.5% 6036 perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
827.67 ± 9% -16.3% 692.50 ± 4% interrupts.CPU13.CAL:Function_call_interrupts
3623 ± 54% +66.8% 6045 ± 33% interrupts.CPU26.NMI:Non-maskable_interrupts
3623 ± 54% +66.8% 6045 ± 33% interrupts.CPU26.PMI:Performance_monitoring_interrupts
239.50 ± 18% -33.1% 160.33 ± 38% interrupts.CPU41.RES:Rescheduling_interrupts
261.33 ± 18% -54.4% 119.17 ± 49% interrupts.CPU42.RES:Rescheduling_interrupts
7894 -30.2% 5511 ± 37% interrupts.CPU45.NMI:Non-maskable_interrupts
7894 -30.2% 5511 ± 37% interrupts.CPU45.PMI:Performance_monitoring_interrupts
3374 ± 40% +90.6% 6432 ± 23% interrupts.CPU58.NMI:Non-maskable_interrupts
3374 ± 40% +90.6% 6432 ± 23% interrupts.CPU58.PMI:Performance_monitoring_interrupts
272.83 ± 8% -36.4% 173.50 ± 40% interrupts.CPU6.RES:Rescheduling_interrupts
2890 ± 37% +61.0% 4652 ± 37% interrupts.CPU76.NMI:Non-maskable_interrupts
2890 ± 37% +61.0% 4652 ± 37% interrupts.CPU76.PMI:Performance_monitoring_interrupts
272.67 ± 9% -29.0% 193.67 ± 27% interrupts.CPU81.RES:Rescheduling_interrupts
3475 ± 47% +109.3% 7273 ± 12% interrupts.CPU93.NMI:Non-maskable_interrupts
3475 ± 47% +109.3% 7273 ± 12% interrupts.CPU93.PMI:Performance_monitoring_interrupts
3054 ± 37% +91.7% 5857 ± 38% interrupts.CPU96.NMI:Non-maskable_interrupts
3054 ± 37% +91.7% 5857 ± 38% interrupts.CPU96.PMI:Performance_monitoring_interrupts
0.05 ± 5% +1601.9% 0.79 ± 20% perf-stat.i.MPKI
12.52 ± 2% +20.9 33.42 ± 4% perf-stat.i.cache-miss-rate%
647128 ± 2% +4855.0% 32065121 ± 8% perf-stat.i.cache-misses
5130146 ± 2% +1777.3% 96305803 ± 9% perf-stat.i.cache-references
2302 +6.1% 2443 perf-stat.i.context-switches
259518 ± 2% -98.1% 4827 ± 6% perf-stat.i.cycles-between-cache-misses
0.17 -0.1 0.11 perf-stat.i.dTLB-load-miss-rate%
65644478 -33.6% 43563819 ± 5% perf-stat.i.dTLB-load-misses
51892 -27.4% 37675 ± 3% perf-stat.i.dTLB-store-misses
68181011 -33.4% 45405593 ± 5% perf-stat.i.iTLB-load-misses
1933 +58.2% 3058 ± 3% perf-stat.i.instructions-per-iTLB-miss
81.87 ± 12% +782.2% 722.30 ± 16% perf-stat.i.metric.K/sec
126326 ± 3% +6119.4% 7856755 ± 2% perf-stat.i.node-load-misses
26893 ± 6% +3382.5% 936567 ± 3% perf-stat.i.node-loads
87.04 +12.8 99.79 perf-stat.i.node-store-miss-rate%
33838 ± 3% +28351.8% 9627739 perf-stat.i.node-store-misses
0.04 ± 2% +1709.7% 0.71 ± 14% perf-stat.overall.MPKI
0.52 -0.0 0.49 ± 3% perf-stat.overall.branch-miss-rate%
12.65 ± 2% +20.7 33.35 ± 4% perf-stat.overall.cache-miss-rate%
222708 ± 2% -98.0% 4560 ± 8% perf-stat.overall.cycles-between-cache-misses
0.17 -0.1 0.10 perf-stat.overall.dTLB-load-miss-rate%
0.00 -0.0 0.00 ± 2% perf-stat.overall.dTLB-store-miss-rate%
1929 +56.0% 3010 perf-stat.overall.instructions-per-iTLB-miss
82.22 +7.1 89.34 perf-stat.overall.node-load-miss-rate%
78.75 +21.2 99.91 perf-stat.overall.node-store-miss-rate%
603681 +56.8% 946452 perf-stat.overall.path-length
649626 ± 2% +4816.5% 31938893 ± 8% perf-stat.ps.cache-misses
5137402 ± 2% +1767.5% 95941923 ± 9% perf-stat.ps.cache-references
2313 +5.8% 2448 perf-stat.ps.context-switches
65424262 -33.6% 43419292 ± 5% perf-stat.ps.dTLB-load-misses
51749 -27.4% 37573 ± 3% perf-stat.ps.dTLB-store-misses
67951468 -33.4% 45252180 ± 5% perf-stat.ps.iTLB-load-misses
126213 ± 3% +6102.7% 7828694 ± 2% perf-stat.ps.node-load-misses
27281 ± 6% +3321.9% 933553 ± 3% perf-stat.ps.node-loads
33783 ± 3% +28302.8% 9595407 perf-stat.ps.node-store-misses
15207 ± 10% -34.0% 10039 ± 12% softirqs.CPU0.RCU
16968 ± 17% -36.3% 10810 ± 19% softirqs.CPU1.RCU
17526 ± 19% -36.4% 11142 ± 14% softirqs.CPU10.RCU
17232 ± 16% -48.1% 8946 ± 13% softirqs.CPU100.RCU
15770 ± 16% -43.7% 8874 ± 28% softirqs.CPU101.RCU
14396 ± 15% -44.6% 7969 ± 13% softirqs.CPU102.RCU
18909 ± 5% -46.4% 10130 ± 17% softirqs.CPU103.RCU
17822 ± 23% -45.3% 9744 ± 22% softirqs.CPU11.RCU
18056 ± 22% -52.5% 8582 ± 22% softirqs.CPU12.RCU
14576 ± 17% -33.3% 9723 ± 15% softirqs.CPU13.RCU
18836 ± 15% -47.1% 9961 ± 8% softirqs.CPU14.RCU
20542 ± 17% -54.3% 9394 ± 11% softirqs.CPU15.RCU
17485 ± 19% -42.0% 10141 ± 19% softirqs.CPU16.RCU
17387 ± 17% -37.8% 10807 ± 13% softirqs.CPU17.RCU
18473 ± 15% -49.9% 9250 ± 18% softirqs.CPU18.RCU
19232 ± 19% -44.1% 10751 ± 10% softirqs.CPU19.RCU
17052 ± 21% -42.9% 9744 ± 22% softirqs.CPU2.RCU
17330 ± 17% -43.5% 9797 ± 16% softirqs.CPU20.RCU
18624 ± 15% -43.9% 10445 ± 24% softirqs.CPU21.RCU
18206 ± 18% -44.4% 10123 ± 26% softirqs.CPU22.RCU
18047 ± 12% -44.5% 10022 ± 23% softirqs.CPU23.RCU
19351 ± 18% -47.7% 10115 ± 21% softirqs.CPU24.RCU
18629 ± 17% -51.4% 9057 ± 18% softirqs.CPU25.RCU
15355 ± 14% -44.8% 8480 ± 13% softirqs.CPU26.RCU
15129 ± 14% -39.7% 9117 ± 16% softirqs.CPU27.RCU
14744 ± 10% -39.0% 8996 ± 21% softirqs.CPU28.RCU
13973 ± 11% -39.4% 8470 ± 18% softirqs.CPU29.RCU
35779 ± 10% -27.5% 25930 ± 30% softirqs.CPU29.SCHED
18703 ± 16% -43.4% 10577 ± 19% softirqs.CPU3.RCU
17000 ± 19% -40.8% 10057 ± 21% softirqs.CPU30.RCU
18602 ± 16% -40.6% 11040 ± 15% softirqs.CPU31.RCU
17242 ± 23% -44.0% 9662 ± 19% softirqs.CPU32.RCU
17841 ± 15% -43.1% 10144 ± 21% softirqs.CPU33.RCU
17867 ± 14% -44.6% 9890 ± 21% softirqs.CPU34.RCU
19083 ± 16% -46.7% 10177 ± 15% softirqs.CPU35.RCU
19161 ± 11% -49.8% 9616 ± 24% softirqs.CPU36.RCU
19335 ± 15% -47.7% 10106 ± 16% softirqs.CPU37.RCU
20460 ± 11% -54.3% 9341 ± 17% softirqs.CPU38.RCU
10641 ± 58% +117.0% 23087 ± 43% softirqs.CPU38.SCHED
20165 ± 8% -53.5% 9381 ± 17% softirqs.CPU39.RCU
20158 ± 9% -47.3% 10630 ± 20% softirqs.CPU4.RCU
18503 ± 20% -40.7% 10980 ± 20% softirqs.CPU40.RCU
18917 ± 11% -51.1% 9241 ± 17% softirqs.CPU41.RCU
19989 ± 9% -57.3% 8544 ± 12% softirqs.CPU42.RCU
10393 ± 58% +155.8% 26585 ± 30% softirqs.CPU42.SCHED
16499 ± 11% -45.5% 8991 ± 19% softirqs.CPU43.RCU
18599 ± 16% -49.3% 9433 ± 24% softirqs.CPU44.RCU
20721 ± 8% -56.4% 9035 ± 14% softirqs.CPU45.RCU
6210 ± 26% +213.4% 19464 ± 52% softirqs.CPU45.SCHED
16912 ± 21% -43.6% 9547 ± 24% softirqs.CPU46.RCU
19085 ± 14% -49.9% 9571 ± 15% softirqs.CPU47.RCU
16524 ± 21% -46.7% 8815 ± 20% softirqs.CPU48.RCU
18590 ± 13% -52.0% 8921 ± 11% softirqs.CPU49.RCU
19473 ± 15% -47.6% 10198 ± 12% softirqs.CPU5.RCU
19807 ± 16% -51.7% 9574 ± 20% softirqs.CPU50.RCU
14621 ± 7% -44.6% 8100 ± 14% softirqs.CPU51.RCU
21579 ± 9% -49.4% 10911 ± 16% softirqs.CPU52.RCU
17758 ± 25% -50.6% 8778 ± 25% softirqs.CPU53.RCU
18495 ± 15% -47.1% 9776 ± 18% softirqs.CPU54.RCU
16729 ± 20% -46.4% 8963 ± 20% softirqs.CPU55.RCU
15031 ± 10% -44.4% 8358 ± 18% softirqs.CPU56.RCU
15721 ± 17% -42.2% 9080 ± 30% softirqs.CPU57.RCU
14757 ± 3% -32.1% 10022 ± 23% softirqs.CPU58.RCU
37022 ± 9% -41.4% 21679 ± 41% softirqs.CPU58.SCHED
16077 ± 6% -41.1% 9466 ± 32% softirqs.CPU59.RCU
20064 ± 11% -54.4% 9150 ± 18% softirqs.CPU6.RCU
14811 ± 18% -46.8% 7880 ± 15% softirqs.CPU60.RCU
15191 ± 8% -49.8% 7623 ± 14% softirqs.CPU61.RCU
16592 ± 13% -49.0% 8455 ± 12% softirqs.CPU62.RCU
15392 ± 21% -44.3% 8566 ± 17% softirqs.CPU63.RCU
18606 ± 16% -52.5% 8837 ± 19% softirqs.CPU65.RCU
14770 ± 22% -40.4% 8802 ± 29% softirqs.CPU66.RCU
14465 ± 11% -32.3% 9797 ± 24% softirqs.CPU67.RCU
16993 ± 16% -48.1% 8818 ± 12% softirqs.CPU68.RCU
18034 ± 14% -52.9% 8497 ± 18% softirqs.CPU69.RCU
18628 ± 16% -47.9% 9700 ± 18% softirqs.CPU7.RCU
16564 ± 17% -42.4% 9545 ± 15% softirqs.CPU70.RCU
16333 ± 19% -45.3% 8933 ± 25% softirqs.CPU71.RCU
17985 ± 19% -52.0% 8624 ± 25% softirqs.CPU72.RCU
16575 ± 17% -50.7% 8172 ± 15% softirqs.CPU73.RCU
17243 ± 18% -48.5% 8875 ± 15% softirqs.CPU74.RCU
17293 ± 12% -44.8% 9547 ± 15% softirqs.CPU75.RCU
16269 ± 20% -46.7% 8673 ± 24% softirqs.CPU76.RCU
17326 ± 18% -45.8% 9383 ± 22% softirqs.CPU77.RCU
18826 ± 18% -50.6% 9292 ± 24% softirqs.CPU78.RCU
19893 ± 8% -52.4% 9460 ± 18% softirqs.CPU79.RCU
18812 ± 19% -43.6% 10616 ± 19% softirqs.CPU8.RCU
20001 ± 12% -53.0% 9393 ± 14% softirqs.CPU80.RCU
20756 ± 5% -53.9% 9562 ± 18% softirqs.CPU81.RCU
18840 ± 15% -53.5% 8761 ± 17% softirqs.CPU82.RCU
17159 ± 21% -52.3% 8189 ± 20% softirqs.CPU83.RCU
18671 ± 16% -52.4% 8881 ± 19% softirqs.CPU84.RCU
18929 ± 11% -55.5% 8421 ± 21% softirqs.CPU85.RCU
17559 ± 15% -51.0% 8604 ± 13% softirqs.CPU86.RCU
17343 ± 14% -53.0% 8154 ± 18% softirqs.CPU87.RCU
15481 ± 13% -43.6% 8727 ± 14% softirqs.CPU88.RCU
16364 ± 14% -43.9% 9187 ± 24% softirqs.CPU89.RCU
18492 ± 19% -43.5% 10441 ± 14% softirqs.CPU9.RCU
14056 ± 7% -38.3% 8666 ± 21% softirqs.CPU90.RCU
14189 ± 6% -37.9% 8815 ± 24% softirqs.CPU91.RCU
15154 ± 14% -48.1% 7867 ± 15% softirqs.CPU92.RCU
15589 ± 14% -42.4% 8979 ± 25% softirqs.CPU93.RCU
14492 ± 10% -34.4% 9504 ± 19% softirqs.CPU94.RCU
34198 ± 16% -52.1% 16384 ± 44% softirqs.CPU94.SCHED
17203 ± 7% -46.2% 9249 ± 16% softirqs.CPU95.RCU
15367 ± 11% -44.0% 8601 ± 12% softirqs.CPU96.RCU
14328 ± 13% -37.8% 8911 ± 27% softirqs.CPU97.RCU
16134 ± 16% -46.3% 8672 ± 19% softirqs.CPU98.RCU
15282 ± 17% -44.5% 8486 ± 18% softirqs.CPU99.RCU
1808149 ± 6% -46.3% 971467 ± 15% softirqs.RCU
36250 ± 5% +36.3% 49404 ± 2% softirqs.TIMER
17.47 ± 9% -5.9 11.61 ± 9% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64
9.44 ± 9% -3.2 6.23 ± 9% perf-profile.calltrace.cycles-pp.__entry_text_start.__libc_fcntl64
8.57 ± 9% -2.9 5.64 ± 9% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.__libc_fcntl64
2.27 ± 9% -1.0 1.27 ± 29% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_safe_stack.__libc_fcntl64
2.68 ± 9% -1.0 1.70 ± 9% perf-profile.calltrace.cycles-pp.memset_erms.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait
2.65 ± 8% -0.9 1.78 ± 9% perf-profile.calltrace.cycles-pp.security_file_lock.do_lock_file_wait.fcntl_setlk.do_fcntl.__x64_sys_fcntl
2.52 ± 9% -0.9 1.65 ± 9% perf-profile.calltrace.cycles-pp._copy_from_user.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.80 ± 8% -0.5 0.28 ±100% perf-profile.calltrace.cycles-pp._raw_spin_lock.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
1.34 ± 9% -0.5 0.83 ± 9% perf-profile.calltrace.cycles-pp.memset_erms.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl
1.62 ± 9% -0.5 1.12 ± 10% perf-profile.calltrace.cycles-pp.common_file_perm.security_file_lock.do_lock_file_wait.fcntl_setlk.do_fcntl
0.82 ± 10% -0.4 0.38 ± 71% perf-profile.calltrace.cycles-pp.syscall_enter_from_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64
0.66 ± 11% -0.4 0.28 ±100% perf-profile.calltrace.cycles-pp.locks_delete_lock_ctx.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
1.04 ± 9% -0.3 0.69 ± 9% perf-profile.calltrace.cycles-pp.copy_user_generic_unrolled._copy_from_user.do_fcntl.__x64_sys_fcntl.do_syscall_64
0.86 ± 9% -0.3 0.59 ± 8% perf-profile.calltrace.cycles-pp.__fget_light.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64
0.00 +0.6 0.59 ± 11% perf-profile.calltrace.cycles-pp.mod_objcg_state.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait
1.06 ± 9% +0.9 1.92 ± 12% perf-profile.calltrace.cycles-pp.locks_dispose_list.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
0.00 +0.9 0.92 ± 10% perf-profile.calltrace.cycles-pp.get_obj_cgroup_from_current.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl
0.67 ± 9% +1.0 1.68 ± 14% perf-profile.calltrace.cycles-pp.kmem_cache_free.locks_dispose_list.posix_lock_inode.do_lock_file_wait.fcntl_setlk
0.00 +1.4 1.38 ± 8% perf-profile.calltrace.cycles-pp.get_obj_cgroup_from_current.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait
0.00 +1.8 1.79 ± 59% perf-profile.calltrace.cycles-pp.page_counter_cancel.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.fcntl_setlk
0.00 +2.2 2.18 ± 58% perf-profile.calltrace.cycles-pp.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.fcntl_setlk.do_fcntl
0.00 +2.2 2.21 ± 58% perf-profile.calltrace.cycles-pp.obj_cgroup_uncharge_pages.kmem_cache_free.fcntl_setlk.do_fcntl.__x64_sys_fcntl
0.00 +2.4 2.35 ± 43% perf-profile.calltrace.cycles-pp.page_counter_cancel.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.posix_lock_inode
0.00 +2.8 2.80 ± 59% perf-profile.calltrace.cycles-pp.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk
0.00 +2.8 2.84 ± 41% perf-profile.calltrace.cycles-pp.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.posix_lock_inode.do_lock_file_wait
0.00 +2.9 2.86 ± 41% perf-profile.calltrace.cycles-pp.obj_cgroup_uncharge_pages.kmem_cache_free.posix_lock_inode.do_lock_file_wait.fcntl_setlk
1.10 ± 9% +2.9 3.98 ± 32% perf-profile.calltrace.cycles-pp.kmem_cache_free.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64
0.00 +3.0 2.99 ± 55% perf-profile.calltrace.cycles-pp.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl
1.69 ± 9% +3.8 5.49 ± 21% perf-profile.calltrace.cycles-pp.kmem_cache_free.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
3.39 ± 8% +4.0 7.42 ± 22% perf-profile.calltrace.cycles-pp.locks_alloc_lock.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64
3.00 ± 8% +4.2 7.17 ± 23% perf-profile.calltrace.cycles-pp.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl.__x64_sys_fcntl
0.00 +4.6 4.61 ± 29% perf-profile.calltrace.cycles-pp.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode
0.00 +5.0 5.00 ± 27% perf-profile.calltrace.cycles-pp.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait
6.48 ± 9% +6.3 12.76 ± 12% perf-profile.calltrace.cycles-pp.locks_alloc_lock.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
5.71 ± 9% +6.5 12.21 ± 13% perf-profile.calltrace.cycles-pp.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait.fcntl_setlk
0.00 +7.3 7.35 ± 35% perf-profile.calltrace.cycles-pp.page_counter_try_charge.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock
17.27 ± 9% +8.5 25.78 ± 11% perf-profile.calltrace.cycles-pp.do_lock_file_wait.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64
13.80 ± 9% +9.6 23.35 ± 12% perf-profile.calltrace.cycles-pp.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl.__x64_sys_fcntl
28.29 ± 9% +13.3 41.58 ± 12% perf-profile.calltrace.cycles-pp.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64
26.73 ± 9% +13.8 40.53 ± 12% perf-profile.calltrace.cycles-pp.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64
23.74 ± 9% +14.8 38.56 ± 13% perf-profile.calltrace.cycles-pp.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe
17.55 ± 9% -5.9 11.68 ± 9% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
9.74 ± 9% -3.3 6.41 ± 9% perf-profile.children.cycles-pp.syscall_return_via_sysret
9.02 ± 8% -3.1 5.96 ± 9% perf-profile.children.cycles-pp.__entry_text_start
4.02 ± 9% -1.5 2.53 ± 9% perf-profile.children.cycles-pp.memset_erms
2.58 ± 9% -0.9 1.69 ± 9% perf-profile.children.cycles-pp._copy_from_user
2.68 ± 8% -0.9 1.80 ± 9% perf-profile.children.cycles-pp.security_file_lock
2.02 ± 7% -0.7 1.33 ± 9% perf-profile.children.cycles-pp._raw_spin_lock
1.40 ± 8% -0.6 0.85 ± 10% perf-profile.children.cycles-pp.___might_sleep
1.67 ± 9% -0.5 1.16 ± 10% perf-profile.children.cycles-pp.common_file_perm
1.48 ± 9% -0.5 0.98 ± 9% perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack
1.23 ± 9% -0.4 0.81 ± 9% perf-profile.children.cycles-pp.copy_user_generic_unrolled
1.04 ± 9% -0.4 0.67 ± 9% perf-profile.children.cycles-pp.__might_sleep
0.86 ± 10% -0.3 0.56 ± 9% perf-profile.children.cycles-pp.syscall_enter_from_user_mode
0.86 ± 9% -0.3 0.59 ± 8% perf-profile.children.cycles-pp.__fget_light
0.76 ± 7% -0.3 0.50 ± 8% perf-profile.children.cycles-pp.apparmor_file_lock
0.77 ± 8% -0.3 0.51 ± 9% perf-profile.children.cycles-pp.__cond_resched
0.59 ± 8% -0.2 0.38 ± 9% perf-profile.children.cycles-pp.__might_fault
0.66 ± 9% -0.2 0.46 ± 9% perf-profile.children.cycles-pp.locks_release_private
0.56 ± 9% -0.2 0.36 ± 9% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.58 ± 9% -0.2 0.44 ± 10% perf-profile.children.cycles-pp.locks_insert_lock_ctx
0.69 ± 11% -0.1 0.54 ± 9% perf-profile.children.cycles-pp.locks_delete_lock_ctx
0.56 ± 10% -0.1 0.44 ± 8% perf-profile.children.cycles-pp.locks_unlink_lock_ctx
0.38 ± 8% -0.1 0.26 ± 10% perf-profile.children.cycles-pp.rcu_all_qs
0.33 ± 11% -0.1 0.21 ± 9% perf-profile.children.cycles-pp.flock64_to_posix_lock
0.35 ± 8% -0.1 0.24 ± 10% perf-profile.children.cycles-pp.aa_file_perm
0.27 ± 21% -0.1 0.16 ± 9% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
0.23 ± 9% -0.1 0.13 ± 8% perf-profile.children.cycles-pp.__init_waitqueue_head
0.31 ± 8% -0.1 0.21 ± 9% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.24 ± 9% -0.1 0.17 ± 6% perf-profile.children.cycles-pp.testcase
0.19 ± 11% -0.1 0.12 ± 10% perf-profile.children.cycles-pp.should_failslab
0.15 ± 10% -0.1 0.09 ± 10% [email protected]
0.16 ± 7% -0.1 0.10 ± 14% perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare
0.13 ± 9% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.security_file_fcntl
0.12 ± 12% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.__list_del_entry_valid
0.14 ± 9% -0.0 0.10 ± 10% perf-profile.children.cycles-pp.locks_get_lock_context
0.08 ± 10% -0.0 0.03 ± 70% perf-profile.children.cycles-pp.vfs_lock_file
0.13 ± 8% -0.0 0.10 ± 7% perf-profile.children.cycles-pp.locks_delete_block
0.10 ± 10% -0.0 0.06 ± 14% perf-profile.children.cycles-pp.__list_add_valid
0.10 ± 10% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.memset
0.00 +0.1 0.08 ± 9% perf-profile.children.cycles-pp.obj_cgroup_uncharge
0.00 +0.2 0.21 ± 18% perf-profile.children.cycles-pp.mem_cgroup_from_task
0.00 +0.6 0.55 ± 9% perf-profile.children.cycles-pp.rcu_read_unlock_strict
0.00 +0.6 0.60 ± 9% perf-profile.children.cycles-pp.refill_obj_stock
1.10 ± 9% +0.9 1.96 ± 12% perf-profile.children.cycles-pp.locks_dispose_list
0.00 +1.7 1.67 ± 10% perf-profile.children.cycles-pp.mod_objcg_state
0.00 +2.4 2.42 ± 35% perf-profile.children.cycles-pp.propagate_protected_usage
0.00 +2.5 2.47 ± 9% perf-profile.children.cycles-pp.get_obj_cgroup_from_current
0.00 +4.7 4.74 ± 36% perf-profile.children.cycles-pp.page_counter_cancel
0.00 +5.8 5.77 ± 35% perf-profile.children.cycles-pp.page_counter_uncharge
0.00 +5.8 5.82 ± 35% perf-profile.children.cycles-pp.obj_cgroup_uncharge_pages
0.00 +7.4 7.36 ± 35% perf-profile.children.cycles-pp.page_counter_try_charge
0.00 +7.4 7.42 ± 35% perf-profile.children.cycles-pp.obj_cgroup_charge_pages
3.47 ± 9% +7.8 11.27 ± 18% perf-profile.children.cycles-pp.kmem_cache_free
0.00 +8.1 8.05 ± 32% perf-profile.children.cycles-pp.obj_cgroup_charge
17.35 ± 9% +8.5 25.81 ± 11% perf-profile.children.cycles-pp.do_lock_file_wait
14.01 ± 9% +9.5 23.56 ± 12% perf-profile.children.cycles-pp.posix_lock_inode
10.00 ± 8% +10.2 20.24 ± 14% perf-profile.children.cycles-pp.locks_alloc_lock
9.00 ± 8% +10.7 19.67 ± 14% perf-profile.children.cycles-pp.kmem_cache_alloc
28.35 ± 9% +13.3 41.61 ± 12% perf-profile.children.cycles-pp.__x64_sys_fcntl
26.89 ± 9% +13.7 40.63 ± 12% perf-profile.children.cycles-pp.do_fcntl
23.92 ± 9% +14.7 38.67 ± 13% perf-profile.children.cycles-pp.fcntl_setlk
17.12 ± 9% -5.7 11.40 ± 9% perf-profile.self.cycles-pp.syscall_exit_to_user_mode
9.72 ± 9% -3.3 6.39 ± 9% perf-profile.self.cycles-pp.syscall_return_via_sysret
7.81 ± 8% -2.6 5.16 ± 9% perf-profile.self.cycles-pp.__entry_text_start
3.90 ± 9% -1.4 2.45 ± 9% perf-profile.self.cycles-pp.memset_erms
1.97 ± 7% -0.7 1.32 ± 10% perf-profile.self.cycles-pp._raw_spin_lock
1.78 ± 9% -0.6 1.21 ± 9% perf-profile.self.cycles-pp.__libc_fcntl64
1.34 ± 8% -0.5 0.82 ± 11% perf-profile.self.cycles-pp.___might_sleep
1.35 ± 9% -0.4 0.94 ± 10% perf-profile.self.cycles-pp.common_file_perm
1.19 ± 9% -0.4 0.79 ± 9% perf-profile.self.cycles-pp.copy_user_generic_unrolled
1.30 ± 8% -0.3 0.96 ± 8% perf-profile.self.cycles-pp.posix_lock_inode
0.91 ± 9% -0.3 0.58 ± 9% perf-profile.self.cycles-pp.__might_sleep
1.08 ± 9% -0.3 0.76 ± 8% perf-profile.self.cycles-pp.fcntl_setlk
0.74 ± 8% -0.3 0.43 ± 10% perf-profile.self.cycles-pp.locks_alloc_lock
0.79 ± 9% -0.3 0.51 ± 10% perf-profile.self.cycles-pp.syscall_enter_from_user_mode
0.76 ± 9% -0.3 0.49 ± 6% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.83 ± 9% -0.3 0.56 ± 8% perf-profile.self.cycles-pp.__fget_light
0.70 ± 9% -0.2 0.46 ± 8% perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack
0.66 ± 7% -0.2 0.43 ± 7% perf-profile.self.cycles-pp.apparmor_file_lock
0.64 ± 9% -0.2 0.42 ± 9% perf-profile.self.cycles-pp.locks_release_private
0.52 ± 9% -0.2 0.34 ± 9% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.47 ± 10% -0.2 0.30 ± 9% perf-profile.self.cycles-pp.do_lock_file_wait
0.54 ± 9% -0.2 0.38 ± 9% perf-profile.self.cycles-pp.do_fcntl
0.46 ± 9% -0.2 0.30 ± 8% perf-profile.self.cycles-pp.__x64_sys_fcntl
0.40 ± 11% -0.2 0.25 ± 11% perf-profile.self.cycles-pp.do_syscall_64
0.33 ± 11% -0.1 0.19 ± 10% perf-profile.self.cycles-pp.flock64_to_posix_lock
0.38 ± 9% -0.1 0.25 ± 9% perf-profile.self.cycles-pp.__cond_resched
0.25 ± 7% -0.1 0.14 ± 10% perf-profile.self.cycles-pp.locks_dispose_list
0.24 ± 9% -0.1 0.13 ± 8% perf-profile.self.cycles-pp.testcase
0.28 ± 7% -0.1 0.19 ± 11% perf-profile.self.cycles-pp.aa_file_perm
0.22 ± 24% -0.1 0.13 ± 8% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
0.28 ± 8% -0.1 0.18 ± 10% perf-profile.self.cycles-pp.exit_to_user_mode_prepare
0.25 ± 9% -0.1 0.16 ± 10% perf-profile.self.cycles-pp._copy_from_user
0.26 ± 8% -0.1 0.17 ± 10% perf-profile.self.cycles-pp.rcu_all_qs
0.18 ± 9% -0.1 0.10 ± 10% perf-profile.self.cycles-pp.__init_waitqueue_head
0.15 ± 8% -0.1 0.07 ± 14% perf-profile.self.cycles-pp.syscall_exit_to_user_mode_prepare
0.14 ± 9% -0.1 0.08 ± 11% perf-profile[email protected]
0.12 ± 12% -0.1 0.07 ± 7% perf-profile.self.cycles-pp.__list_del_entry_valid
0.18 ± 12% -0.1 0.13 ± 8% perf-profile.self.cycles-pp.security_file_lock
0.08 ± 12% -0.0 0.03 ±100% perf-profile.self.cycles-pp.__list_add_valid
0.12 ± 9% -0.0 0.08 ± 11% perf-profile.self.cycles-pp.locks_get_lock_context
0.10 ± 10% -0.0 0.06 ± 11% perf-profile.self.cycles-pp.__might_fault
0.10 ± 10% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.memset
0.10 ± 8% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.security_file_fcntl
0.11 ± 8% -0.0 0.08 ± 8% perf-profile.self.cycles-pp.locks_delete_block
0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.obj_cgroup_uncharge
0.00 +0.2 0.16 ± 24% perf-profile.self.cycles-pp.mem_cgroup_from_task
0.00 +0.3 0.34 ± 9% perf-profile.self.cycles-pp.rcu_read_unlock_strict
0.00 +0.6 0.56 ± 9% perf-profile.self.cycles-pp.obj_cgroup_charge
0.00 +0.6 0.58 ± 10% perf-profile.self.cycles-pp.refill_obj_stock
3.14 ± 8% +1.3 4.46 ± 10% perf-profile.self.cycles-pp.kmem_cache_alloc
0.00 +1.7 1.65 ± 10% perf-profile.self.cycles-pp.mod_objcg_state
0.00 +2.2 2.17 ± 9% perf-profile.self.cycles-pp.get_obj_cgroup_from_current
0.00 +2.4 2.40 ± 35% perf-profile.self.cycles-pp.propagate_protected_usage
0.00 +4.7 4.70 ± 36% perf-profile.self.cycles-pp.page_counter_cancel
0.00 +5.9 5.92 ± 35% perf-profile.self.cycles-pp.page_counter_try_charge
will-it-scale.52.processes
7e+07 +-----------------------------------------------------------------+
| .+ + + + + |
6.5e+07 |+++ ++++++.++++ +++.+ +++++.+++++++.++++ ++.++ +++++.+++++++ |
| |
6e+07 |-+ |
| |
5.5e+07 |-+ |
| |
5e+07 |-+ O |
| OO O O OOO OO O O OOO O |
4.5e+07 |O+O OOOO O O O O OOO O OOOOO O O O O OO O OOOO O |
| O O O OO O O O|
4e+07 |-+ O O |
| |
3.5e+07 +-----------------------------------------------------------------+
will-it-scale.per_process_ops
1.3e+06 +-----------------------------------------------------------------+
|+++.+++++++.++++++++.+++++++.+++++++.+++++++.++++++++.+++++++ |
1.2e+06 |-+ |
| |
| |
1.1e+06 |-+ |
| |
1e+06 |-+ |
| O |
900000 |-+ O O O O O O O O O O |
|O O OOO O O OO O O O O O O OOOO O O O OO O O OOOO |
| O O O O OO OO O OO O|
800000 |-O O O O |
| |
700000 +-----------------------------------------------------------------+
will-it-scale.workload
7e+07 +-----------------------------------------------------------------+
| .+ + + + + |
6.5e+07 |+++ ++++++.++++ +++.+ +++++.+++++++.++++ ++.++ +++++.+++++++ |
| |
6e+07 |-+ |
| |
5.5e+07 |-+ |
| |
5e+07 |-+ O |
| OO O O OOO OO O O OOO O |
4.5e+07 |O+O OOOO O O O O OOO O OOOOO O O O O OO O OOOO O |
| O O O OO O O O|
4e+07 |-+ O O |
| |
3.5e+07 +-----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-icl-2sp2: 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz with 256G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-9/performance/x86_64-rhel-8.3/process/50%/debian-10.4-x86_64-20200603.cgz/lkp-icl-2sp2/lock1/will-it-scale/0xd000280
commit:
b655843444 ("memcg: enable accounting for pollfd and select bits arrays")
0f12156dff ("memcg: enable accounting for file lock caches")
b655843444152c0a 0f12156dff2862ac54235fc7270
---------------- ---------------------------
%stddev %change %stddev
\ | \
1.785e+08 -40.9% 1.055e+08 ± 2% will-it-scale.64.processes
2788911 -40.9% 1649196 ± 2% will-it-scale.per_process_ops
1.785e+08 -40.9% 1.055e+08 ± 2% will-it-scale.workload
366571 ± 7% +15.2% 422206 ± 9% numa-numastat.node0.local_node
2807 +2.4% 2874 vmstat.system.cs
0.02 ± 2% -0.0 0.02 ± 2% mpstat.cpu.all.soft%
5.55 -2.4 3.15 ± 7% mpstat.cpu.all.usr%
5364 ± 2% -85.5% 778.67 ± 13% slabinfo.Acpi-Parse.active_objs
5364 ± 2% -85.5% 778.67 ± 13% slabinfo.Acpi-Parse.num_objs
49038 +5.1% 51541 proc-vmstat.nr_active_anon
55209 +5.1% 58037 proc-vmstat.nr_shmem
49038 +5.1% 51541 proc-vmstat.nr_zone_active_anon
183.83 ± 28% +320.7% 773.33 ±101% interrupts.154:IR-PCI-MSI.25690117-edge.eth0-TxRx-5
836.50 ± 10% +46.3% 1223 ± 30% interrupts.CPU103.CAL:Function_call_interrupts
1348 ± 83% +208.2% 4155 ± 50% interrupts.CPU2.RES:Rescheduling_interrupts
1089 ± 77% +158.6% 2818 ± 53% interrupts.CPU4.RES:Rescheduling_interrupts
183.83 ± 28% +320.7% 773.33 ±101% interrupts.CPU5.154:IR-PCI-MSI.25690117-edge.eth0-TxRx-5
806.17 ± 14% +31.2% 1058 ± 30% interrupts.CPU55.CAL:Function_call_interrupts
723.17 ± 74% +417.0% 3738 ± 82% interrupts.CPU55.RES:Rescheduling_interrupts
4847 ± 94% -97.1% 138.17 ± 19% interrupts.CPU86.NMI:Non-maskable_interrupts
4847 ± 94% -97.1% 138.17 ± 19% interrupts.CPU86.PMI:Performance_monitoring_interrupts
8069 ± 63% -80.7% 1561 ±200% interrupts.CPU99.NMI:Non-maskable_interrupts
8069 ± 63% -80.7% 1561 ±200% interrupts.CPU99.PMI:Performance_monitoring_interrupts
2345 -12.0% 2063 perf-sched.wait_and_delay.avg.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
2345 -12.0% 2063 perf-sched.wait_and_delay.avg.ms.do_syslog.part.0.kmsg_read.vfs_read
262.68 ± 7% -42.8% 150.13 ± 12% perf-sched.wait_and_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
561.17 ± 9% -16.5% 468.33 ± 5% perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
183.33 ± 7% +43.2% 262.50 ± 8% perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode
113.33 ± 11% +78.7% 202.50 ± 4% perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
7031 -12.0% 6185 perf-sched.wait_and_delay.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
7031 -12.0% 6185 perf-sched.wait_and_delay.max.ms.do_syslog.part.0.kmsg_read.vfs_read
7035 -12.0% 6189 perf-sched.wait_and_delay.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read
2345 -12.0% 2063 perf-sched.wait_time.avg.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
2345 -12.0% 2063 perf-sched.wait_time.avg.ms.do_syslog.part.0.kmsg_read.vfs_read
2.50 ± 7% -47.6% 1.31 ± 18% perf-sched.wait_time.avg.ms.rcu_gp_kthread.kthread.ret_from_fork
262.68 ± 7% -42.8% 150.13 ± 12% perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
7031 -12.0% 6185 perf-sched.wait_time.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
7031 -12.0% 6185 perf-sched.wait_time.max.ms.do_syslog.part.0.kmsg_read.vfs_read
7035 -12.0% 6189 perf-sched.wait_time.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read
0.04 ± 22% +1112.5% 0.50 ±128% perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.posix_lock_inode.do_lock_file_wait.fcntl_setlk
0.02 ± 3% +1574.6% 0.27 ± 6% perf-stat.i.MPKI
7.076e+10 -6.5% 6.615e+10 ± 2% perf-stat.i.branch-instructions
0.05 +0.0 0.08 ± 5% perf-stat.i.branch-miss-rate%
35955313 ± 2% +45.6% 52354202 ± 5% perf-stat.i.branch-misses
10.31 +18.0 28.33 ± 8% perf-stat.i.cache-miss-rate%
492492 +4777.7% 24022051 ± 4% perf-stat.i.cache-misses
4620608 +1768.8% 86349315 ± 4% perf-stat.i.cache-references
2651 +2.5% 2716 perf-stat.i.context-switches
0.47 +8.5% 0.51 ± 2% perf-stat.i.cpi
425867 -98.4% 6992 ± 5% perf-stat.i.cycles-between-cache-misses
0.00 ± 4% +0.0 0.00 ± 11% perf-stat.i.dTLB-load-miss-rate%
1.03e+11 -3.8% 9.907e+10 ± 2% perf-stat.i.dTLB-loads
0.00 +0.0 0.00 ± 8% perf-stat.i.dTLB-store-miss-rate%
6.534e+10 -11.3% 5.796e+10 ± 2% perf-stat.i.dTLB-stores
3.516e+11 -7.2% 3.263e+11 ± 2% perf-stat.i.instructions
2.11 -7.1% 1.96 ± 2% perf-stat.i.ipc
37.50 ± 2% +2090.1% 821.35 ± 3% perf-stat.i.metric.K/sec
1867 -6.7% 1743 ± 2% perf-stat.i.metric.M/sec
104632 ± 2% +6707.0% 7122311 ± 3% perf-stat.i.node-load-misses
14377 ± 21% +3209.4% 475820 ± 29% perf-stat.i.node-loads
45.30 ± 16% +51.5 96.80 perf-stat.i.node-store-miss-rate%
48602 ± 14% +22917.3% 11186859 ± 6% perf-stat.i.node-store-misses
65851 ± 9% +432.6% 350742 ± 9% perf-stat.i.node-stores
0.01 +1902.5% 0.27 ± 6% perf-stat.overall.MPKI
0.05 +0.0 0.08 ± 6% perf-stat.overall.branch-miss-rate%
10.65 +17.3 27.92 ± 8% perf-stat.overall.cache-miss-rate%
0.47 +7.7% 0.51 ± 2% perf-stat.overall.cpi
336119 -97.9% 6940 ± 4% perf-stat.overall.cycles-between-cache-misses
0.00 ± 4% +0.0 0.00 ± 10% perf-stat.overall.dTLB-load-miss-rate%
0.00 +0.0 0.00 ± 4% perf-stat.overall.dTLB-store-miss-rate%
2.11 -7.1% 1.96 ± 2% perf-stat.overall.ipc
87.73 ± 2% +6.0 93.76 perf-stat.overall.node-load-miss-rate%
42.34 ± 13% +54.6 96.95 perf-stat.overall.node-store-miss-rate%
594415 +56.9% 932831 perf-stat.overall.path-length
7.05e+10 -6.5% 6.592e+10 ± 2% perf-stat.ps.branch-instructions
35867377 +45.6% 52233576 ± 5% perf-stat.ps.branch-misses
493933 +4747.8% 23944727 ± 4% perf-stat.ps.cache-misses
4639810 +1756.0% 86115077 ± 4% perf-stat.ps.cache-references
2653 +2.6% 2721 perf-stat.ps.context-switches
1.027e+11 -3.8% 9.872e+10 ± 2% perf-stat.ps.dTLB-loads
6.51e+10 -11.3% 5.775e+10 ± 2% perf-stat.ps.dTLB-stores
3.504e+11 -7.2% 3.252e+11 ± 2% perf-stat.ps.instructions
104869 ± 2% +6668.1% 7097622 ± 3% perf-stat.ps.node-load-misses
14698 ± 21% +3134.0% 475371 ± 29% perf-stat.ps.node-loads
48497 ± 14% +22887.1% 11148161 ± 6% perf-stat.ps.node-store-misses
65971 ± 9% +430.7% 350139 ± 8% perf-stat.ps.node-stores
1.061e+14 -7.2% 9.845e+13 ± 2% perf-stat.total.instructions
11738 ± 11% -32.5% 7926 ± 19% softirqs.CPU1.RCU
12768 ± 12% -39.4% 7741 ± 11% softirqs.CPU10.RCU
8853 ± 10% -33.9% 5851 ± 8% softirqs.CPU100.RCU
9695 ± 6% -40.1% 5811 ± 5% softirqs.CPU101.RCU
9277 ± 7% -38.0% 5752 ± 7% softirqs.CPU102.RCU
9585 ± 8% -33.5% 6376 ± 17% softirqs.CPU103.RCU
9838 ± 7% -40.5% 5857 ± 9% softirqs.CPU104.RCU
9315 ± 8% -40.6% 5529 ± 7% softirqs.CPU105.RCU
9661 ± 10% -40.5% 5749 ± 5% softirqs.CPU106.RCU
9531 ± 6% -35.6% 6138 ± 7% softirqs.CPU108.RCU
9472 ± 7% -34.4% 6210 ± 16% softirqs.CPU109.RCU
11502 ± 13% -41.5% 6726 ± 14% softirqs.CPU11.RCU
9003 ± 11% -34.3% 5916 ± 12% softirqs.CPU111.RCU
9739 ± 7% -36.5% 6187 ± 10% softirqs.CPU113.RCU
9453 ± 9% -34.2% 6220 ± 13% softirqs.CPU114.RCU
9891 ± 7% -31.3% 6798 ± 18% softirqs.CPU115.RCU
10008 ± 9% -39.1% 6090 ± 12% softirqs.CPU116.RCU
10132 ± 17% -41.7% 5912 ± 15% softirqs.CPU117.RCU
9765 ± 8% -37.5% 6103 ± 8% softirqs.CPU118.RCU
8960 ± 11% -33.9% 5923 ± 8% softirqs.CPU119.RCU
10910 ± 17% -34.0% 7197 ± 6% softirqs.CPU12.RCU
9577 ± 6% -37.6% 5973 ± 12% softirqs.CPU120.RCU
9565 ± 10% -42.9% 5457 ± 7% softirqs.CPU121.RCU
9137 ± 10% -38.7% 5604 ± 11% softirqs.CPU124.RCU
9418 ± 13% -34.3% 6186 ± 13% softirqs.CPU125.RCU
9151 ± 15% -37.2% 5745 ± 11% softirqs.CPU126.RCU
10800 ± 7% -34.7% 7057 ± 10% softirqs.CPU127.RCU
9815 ± 9% -29.1% 6958 ± 6% softirqs.CPU13.RCU
11463 ± 15% -39.2% 6967 ± 12% softirqs.CPU14.RCU
10757 ± 15% -37.6% 6716 ± 10% softirqs.CPU15.RCU
10809 ± 17% -38.5% 6648 ± 16% softirqs.CPU16.RCU
11169 ± 14% -42.4% 6435 ± 13% softirqs.CPU17.RCU
12215 ± 11% -40.1% 7319 ± 13% softirqs.CPU19.RCU
11500 ± 12% -39.2% 6996 ± 10% softirqs.CPU2.RCU
11027 ± 18% -32.7% 7416 ± 9% softirqs.CPU20.RCU
11155 ± 17% -39.5% 6745 ± 5% softirqs.CPU21.RCU
11083 ± 16% -32.8% 7451 ± 12% softirqs.CPU22.RCU
11841 ± 15% -44.9% 6523 ± 13% softirqs.CPU23.RCU
11415 ± 16% -38.7% 6997 ± 15% softirqs.CPU24.RCU
11325 ± 5% -37.7% 7061 ± 8% softirqs.CPU25.RCU
12111 ± 11% -44.5% 6715 ± 11% softirqs.CPU26.RCU
11627 ± 11% -43.1% 6613 ± 11% softirqs.CPU27.RCU
11113 ± 3% -40.1% 6658 ± 10% softirqs.CPU28.RCU
10333 ± 13% -33.2% 6907 ± 8% softirqs.CPU29.RCU
12191 ± 13% -42.5% 7009 ± 13% softirqs.CPU3.RCU
10265 ± 11% -31.7% 7012 ± 9% softirqs.CPU30.RCU
11440 ± 13% -39.6% 6910 ± 17% softirqs.CPU31.RCU
10389 ± 12% -33.8% 6874 ± 11% softirqs.CPU32.RCU
11224 ± 10% -37.3% 7032 ± 19% softirqs.CPU33.RCU
10886 ± 13% -32.8% 7317 ± 16% softirqs.CPU34.RCU
10588 ± 9% -32.7% 7125 ± 6% softirqs.CPU35.RCU
9719 ± 16% -31.8% 6625 ± 14% softirqs.CPU36.RCU
11099 ± 12% -33.2% 7414 ± 12% softirqs.CPU37.RCU
10338 ± 9% -25.6% 7690 ± 14% softirqs.CPU38.RCU
10238 ± 11% -27.1% 7461 ± 9% softirqs.CPU39.RCU
11660 ± 15% -35.5% 7516 ± 12% softirqs.CPU4.RCU
10552 ± 13% -31.6% 7220 ± 12% softirqs.CPU40.RCU
10552 ± 10% -31.1% 7273 ± 7% softirqs.CPU41.RCU
10103 ± 13% -31.8% 6891 ± 9% softirqs.CPU42.RCU
10974 ± 8% -36.9% 6921 ± 10% softirqs.CPU43.RCU
10730 ± 13% -37.2% 6739 ± 17% softirqs.CPU44.RCU
11205 ± 12% -35.4% 7233 ± 11% softirqs.CPU45.RCU
11136 ± 12% -39.4% 6751 ± 12% softirqs.CPU46.RCU
10649 ± 11% -33.6% 7073 ± 8% softirqs.CPU47.RCU
9988 ± 10% -36.5% 6346 ± 8% softirqs.CPU48.RCU
9801 ± 9% -36.9% 6180 ± 6% softirqs.CPU49.RCU
12102 ± 9% -37.5% 7563 ± 17% softirqs.CPU5.RCU
9884 ± 12% -36.2% 6303 ± 7% softirqs.CPU50.RCU
9347 ± 9% -34.8% 6096 ± 7% softirqs.CPU51.RCU
10164 ± 11% -35.3% 6575 ± 7% softirqs.CPU52.RCU
10518 ± 15% -37.2% 6609 ± 10% softirqs.CPU53.RCU
9857 ± 12% -32.5% 6655 ± 5% softirqs.CPU54.RCU
10795 ± 13% -44.0% 6047 ± 5% softirqs.CPU55.RCU
10397 ± 12% -38.9% 6350 ± 7% softirqs.CPU56.RCU
9513 ± 6% -30.5% 6615 ± 8% softirqs.CPU57.RCU
10400 ± 10% -37.6% 6492 ± 5% softirqs.CPU58.RCU
10434 ± 8% -39.1% 6351 ± 9% softirqs.CPU59.RCU
12055 ± 14% -32.8% 8102 ± 22% softirqs.CPU6.RCU
10580 ± 12% -40.1% 6340 ± 11% softirqs.CPU60.RCU
10099 ± 11% -41.4% 5915 ± 7% softirqs.CPU61.RCU
10021 ± 10% -35.8% 6436 ± 3% softirqs.CPU62.RCU
9856 ± 7% -31.3% 6774 ± 9% softirqs.CPU64.RCU
9963 ± 12% -36.0% 6372 ± 8% softirqs.CPU65.RCU
9664 ± 8% -30.1% 6752 ± 5% softirqs.CPU66.RCU
9673 ± 5% -33.2% 6463 ± 10% softirqs.CPU67.RCU
9910 ± 8% -36.4% 6307 ± 6% softirqs.CPU68.RCU
9589 ± 5% -34.2% 6310 ± 7% softirqs.CPU69.RCU
11733 ± 9% -42.0% 6809 ± 12% softirqs.CPU7.RCU
9603 ± 42% +105.6% 19745 ± 32% softirqs.CPU7.SCHED
9881 ± 9% -34.0% 6521 ± 7% softirqs.CPU70.RCU
9620 ± 6% -33.2% 6424 ± 2% softirqs.CPU71.RCU
35921 ± 13% -39.4% 21764 ± 30% softirqs.CPU71.SCHED
10659 ± 13% -38.8% 6524 ± 7% softirqs.CPU72.RCU
9917 ± 7% -38.9% 6055 ± 7% softirqs.CPU73.RCU
9572 ± 7% -40.0% 5741 ± 9% softirqs.CPU74.RCU
9683 ± 9% -36.2% 6176 ± 6% softirqs.CPU75.RCU
10099 ± 7% -38.4% 6220 ± 10% softirqs.CPU76.RCU
9726 ± 5% -28.6% 6946 ± 14% softirqs.CPU78.RCU
9463 ± 6% -37.1% 5956 ± 12% softirqs.CPU79.RCU
10789 ± 12% -34.1% 7105 ± 20% softirqs.CPU8.RCU
9917 ± 7% -35.1% 6439 ± 11% softirqs.CPU80.RCU
9821 ± 4% -34.5% 6430 ± 3% softirqs.CPU81.RCU
9938 ± 12% -38.6% 6098 ± 10% softirqs.CPU82.RCU
9838 ± 4% -35.2% 6370 ± 7% softirqs.CPU83.RCU
10401 ± 8% -40.1% 6229 ± 6% softirqs.CPU84.RCU
10051 ± 6% -36.4% 6396 ± 9% softirqs.CPU85.RCU
9792 ± 4% -35.3% 6339 ± 14% softirqs.CPU86.RCU
10059 ± 9% -36.3% 6408 ± 8% softirqs.CPU87.RCU
9972 ± 8% -39.2% 6059 ± 3% softirqs.CPU88.RCU
9447 ± 9% -30.8% 6534 ± 12% softirqs.CPU89.RCU
11511 ± 24% -37.0% 7246 ± 11% softirqs.CPU9.RCU
9563 ± 6% -30.9% 6612 ± 6% softirqs.CPU90.RCU
36244 ± 11% -29.7% 25496 ± 25% softirqs.CPU90.SCHED
9671 ± 8% -34.4% 6340 ± 7% softirqs.CPU91.RCU
9848 ± 7% -33.7% 6531 ± 5% softirqs.CPU92.RCU
9578 ± 8% -32.4% 6479 ± 5% softirqs.CPU93.RCU
9519 ± 5% -36.3% 6064 ± 7% softirqs.CPU94.RCU
9480 ± 9% -31.0% 6544 ± 12% softirqs.CPU95.RCU
9025 ± 8% -35.2% 5845 ± 5% softirqs.CPU96.RCU
9656 ± 19% -39.8% 5814 ± 8% softirqs.CPU97.RCU
10008 ± 7% -39.4% 6064 ± 9% softirqs.CPU98.RCU
9619 ± 6% -41.1% 5661 ± 3% softirqs.CPU99.RCU
1308899 ± 3% -36.2% 835466 ± 3% softirqs.RCU
47568 ± 2% +20.6% 57361 ± 4% softirqs.TIMER
10.02 ± 3% -4.9 5.08 ± 18% perf-profile.calltrace.cycles-pp.__entry_text_start.__libc_fcntl64
8.20 -3.8 4.38 ± 6% perf-profile.calltrace.cycles-pp._copy_from_user.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe
5.28 -2.7 2.58 ± 5% perf-profile.calltrace.cycles-pp.memset_erms.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait
4.78 -2.3 2.48 ± 7% perf-profile.calltrace.cycles-pp.security_file_lock.do_lock_file_wait.fcntl_setlk.do_fcntl.__x64_sys_fcntl
3.68 -1.8 1.88 ± 7% perf-profile.calltrace.cycles-pp.common_file_perm.security_file_lock.do_lock_file_wait.fcntl_setlk.do_fcntl
3.36 -1.4 1.93 ± 6% perf-profile.calltrace.cycles-pp.copy_user_generic_unrolled._copy_from_user.do_fcntl.__x64_sys_fcntl.do_syscall_64
2.98 -1.2 1.75 ± 6% perf-profile.calltrace.cycles-pp.__fget_light.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64
2.51 -1.2 1.30 ± 7% perf-profile.calltrace.cycles-pp.locks_delete_lock_ctx.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
2.49 -1.1 1.36 ± 6% perf-profile.calltrace.cycles-pp._raw_spin_lock.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
2.02 -1.0 1.05 ± 6% perf-profile.calltrace.cycles-pp.locks_unlink_lock_ctx.locks_delete_lock_ctx.posix_lock_inode.do_lock_file_wait.fcntl_setlk
2.02 -1.0 1.06 ± 7% perf-profile.calltrace.cycles-pp.locks_insert_lock_ctx.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
1.14 -0.8 0.37 ± 70% perf-profile.calltrace.cycles-pp.locks_release_private.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
1.70 -0.7 0.98 ± 7% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string._copy_from_user.do_fcntl.__x64_sys_fcntl.do_syscall_64
1.24 -0.6 0.64 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock.locks_insert_lock_ctx.posix_lock_inode.do_lock_file_wait.fcntl_setlk
2.15 -0.6 1.57 ± 8% perf-profile.calltrace.cycles-pp.memset_erms.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl
1.34 -0.6 0.77 ± 6% perf-profile.calltrace.cycles-pp.___might_sleep.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl
1.32 -0.6 0.75 ± 7% perf-profile.calltrace.cycles-pp.__might_fault._copy_from_user.do_fcntl.__x64_sys_fcntl.do_syscall_64
1.22 -0.5 0.68 ± 6% perf-profile.calltrace.cycles-pp._raw_spin_lock.locks_unlink_lock_ctx.locks_delete_lock_ctx.posix_lock_inode.do_lock_file_wait
1.21 -0.5 0.68 ± 7% perf-profile.calltrace.cycles-pp.aa_file_perm.common_file_perm.security_file_lock.do_lock_file_wait.fcntl_setlk
1.41 -0.5 0.90 ± 9% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64
1.21 -0.5 0.70 ± 6% perf-profile.calltrace.cycles-pp.syscall_enter_from_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64
1.08 -0.5 0.61 ± 7% perf-profile.calltrace.cycles-pp.flock64_to_posix_lock.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64
0.76 -0.4 0.35 ± 70% perf-profile.calltrace.cycles-pp.___might_sleep.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait
1.27 -0.4 0.86 ± 5% perf-profile.calltrace.cycles-pp.__might_sleep.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait
1.04 -0.4 0.66 ± 10% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.__libc_fcntl64
0.76 -0.1 0.63 ± 5% perf-profile.calltrace.cycles-pp._raw_spin_lock.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64
97.66 +0.4 98.07 perf-profile.calltrace.cycles-pp.__libc_fcntl64
0.00 +0.5 0.54 ± 4% perf-profile.calltrace.cycles-pp.refill_obj_stock.kmem_cache_free.fcntl_setlk.do_fcntl.__x64_sys_fcntl
0.00 +0.8 0.83 ± 7% perf-profile.calltrace.cycles-pp.mod_objcg_state.kmem_cache_free.fcntl_setlk.do_fcntl.__x64_sys_fcntl
0.00 +0.9 0.90 ± 7% perf-profile.calltrace.cycles-pp.mod_objcg_state.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl
0.00 +0.9 0.92 ± 5% perf-profile.calltrace.cycles-pp.refill_obj_stock.kmem_cache_free.posix_lock_inode.do_lock_file_wait.fcntl_setlk
0.00 +1.3 1.26 ± 7% perf-profile.calltrace.cycles-pp.mod_objcg_state.kmem_cache_free.posix_lock_inode.do_lock_file_wait.fcntl_setlk
2.15 +1.4 3.54 ± 14% perf-profile.calltrace.cycles-pp.locks_dispose_list.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
0.00 +1.6 1.59 ± 11% perf-profile.calltrace.cycles-pp.get_obj_cgroup_from_current.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl
1.14 +1.8 2.90 ± 18% perf-profile.calltrace.cycles-pp.kmem_cache_free.locks_dispose_list.posix_lock_inode.do_lock_file_wait.fcntl_setlk
0.00 +1.8 1.83 ± 6% perf-profile.calltrace.cycles-pp.mod_objcg_state.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait
0.00 +2.1 2.13 ± 29% perf-profile.calltrace.cycles-pp.propagate_protected_usage.page_counter_try_charge.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc
0.00 +2.2 2.16 ± 29% perf-profile.calltrace.cycles-pp.page_counter_cancel.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.fcntl_setlk
0.00 +2.4 2.42 ± 7% perf-profile.calltrace.cycles-pp.get_obj_cgroup_from_current.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait
0.00 +2.6 2.60 ± 28% perf-profile.calltrace.cycles-pp.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.fcntl_setlk.do_fcntl
0.00 +2.7 2.66 ± 27% perf-profile.calltrace.cycles-pp.obj_cgroup_uncharge_pages.kmem_cache_free.fcntl_setlk.do_fcntl.__x64_sys_fcntl
0.00 +3.0 3.04 ± 37% perf-profile.calltrace.cycles-pp.page_counter_cancel.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.posix_lock_inode
2.86 ± 2% +3.6 6.42 ± 10% perf-profile.calltrace.cycles-pp.kmem_cache_free.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64
0.00 +3.6 3.59 ± 33% perf-profile.calltrace.cycles-pp.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk
0.00 +3.6 3.65 ± 36% perf-profile.calltrace.cycles-pp.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.posix_lock_inode.do_lock_file_wait
0.00 +3.7 3.72 ± 36% perf-profile.calltrace.cycles-pp.obj_cgroup_uncharge_pages.kmem_cache_free.posix_lock_inode.do_lock_file_wait.fcntl_setlk
0.00 +4.3 4.29 ± 27% perf-profile.calltrace.cycles-pp.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl
3.76 +5.7 9.47 ± 12% perf-profile.calltrace.cycles-pp.kmem_cache_free.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
8.70 +6.2 14.88 ± 6% perf-profile.calltrace.cycles-pp.locks_alloc_lock.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64
7.40 +6.3 13.74 ± 7% perf-profile.calltrace.cycles-pp.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl.__x64_sys_fcntl
83.98 +6.8 90.74 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_fcntl64
82.41 +7.4 89.82 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64
0.00 +7.8 7.75 ± 29% perf-profile.calltrace.cycles-pp.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode
46.22 +7.9 54.10 ± 3% perf-profile.calltrace.cycles-pp.do_lock_file_wait.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64
78.68 +8.9 87.56 perf-profile.calltrace.cycles-pp.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64
0.00 +9.2 9.15 ± 23% perf-profile.calltrace.cycles-pp.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait
73.64 +11.0 84.60 perf-profile.calltrace.cycles-pp.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64
0.00 +11.2 11.21 ± 25% perf-profile.calltrace.cycles-pp.page_counter_try_charge.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock
38.04 +11.7 49.70 ± 4% perf-profile.calltrace.cycles-pp.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl.__x64_sys_fcntl
16.21 +11.8 28.04 ± 5% perf-profile.calltrace.cycles-pp.locks_alloc_lock.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl
13.60 +12.1 25.71 ± 6% perf-profile.calltrace.cycles-pp.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait.fcntl_setlk
63.80 +15.2 78.96 perf-profile.calltrace.cycles-pp.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe
7.76 -3.4 4.33 ± 6% perf-profile.children.cycles-pp.memset_erms
8.05 -3.4 4.62 ± 7% perf-profile.children.cycles-pp._copy_from_user
5.70 ± 2% -2.8 2.89 ± 18% perf-profile.children.cycles-pp.__entry_text_start
6.00 -2.5 3.47 ± 6% perf-profile.children.cycles-pp._raw_spin_lock
5.10 -2.4 2.66 ± 6% perf-profile.children.cycles-pp.security_file_lock
5.00 -2.2 2.75 ± 8% perf-profile.children.cycles-pp.syscall_return_via_sysret
3.90 -1.9 2.01 ± 7% perf-profile.children.cycles-pp.common_file_perm
3.94 -1.7 2.28 ± 6% perf-profile.children.cycles-pp.copy_user_generic_unrolled
3.74 -1.7 2.08 ± 5% perf-profile.children.cycles-pp.___might_sleep
3.95 -1.6 2.40 ± 6% perf-profile.children.cycles-pp.__might_sleep
2.72 -1.3 1.41 ± 6% perf-profile.children.cycles-pp.locks_delete_lock_ctx
2.58 -1.3 1.29 ± 5% perf-profile.children.cycles-pp.locks_release_private
3.10 -1.3 1.81 ± 6% perf-profile.children.cycles-pp.__fget_light
2.18 -1.0 1.14 ± 6% perf-profile.children.cycles-pp.locks_unlink_lock_ctx
2.18 -1.0 1.15 ± 7% perf-profile.children.cycles-pp.locks_insert_lock_ctx
2.03 -0.9 1.17 ± 7% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
2.19 -0.8 1.34 ± 5% perf-profile.children.cycles-pp.__cond_resched
1.54 -0.7 0.86 ± 7% perf-profile.children.cycles-pp.aa_file_perm
1.54 -0.7 0.87 ± 7% perf-profile.children.cycles-pp.__might_fault
1.68 -0.6 1.07 ± 9% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
1.32 -0.6 0.76 ± 6% perf-profile.children.cycles-pp.syscall_enter_from_user_mode
1.19 -0.5 0.67 ± 6% perf-profile.children.cycles-pp.flock64_to_posix_lock
1.10 -0.4 0.65 ± 5% perf-profile.children.cycles-pp.rcu_all_qs
0.81 -0.4 0.45 ± 7% perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack
0.94 -0.3 0.60 ± 6% perf-profile.children.cycles-pp.__init_waitqueue_head
0.74 -0.3 0.41 ± 4% perf-profile.children.cycles-pp.locks_delete_block
0.75 -0.3 0.42 ± 5% perf-profile.children.cycles-pp.locks_get_lock_context
0.70 -0.3 0.39 ± 7% perf-profile.children.cycles-pp.locks_copy_lock
0.53 -0.3 0.23 ± 5% perf-profile.children.cycles-pp.__list_del_entry_valid
0.78 ± 2% -0.3 0.49 ± 9% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.61 -0.3 0.35 ± 8% perf-profile.children.cycles-pp.security_file_fcntl
0.60 -0.2 0.35 ± 11% perf-profile.children.cycles-pp.memset
0.53 -0.2 0.29 ± 6% perf-profile.children.cycles-pp.apparmor_file_lock
0.43 ± 2% -0.2 0.24 ± 7% perf-profile.children.cycles-pp.__list_add_valid
0.43 ± 2% -0.2 0.25 ± 7% perf-profile.children.cycles-pp.vfs_lock_file
0.50 -0.2 0.33 ± 8% perf-profile.children.cycles-pp.testcase
0.37 -0.2 0.21 ± 6% perf-profile.children.cycles-pp.locks_copy_conflock
0.32 ± 2% -0.1 0.18 ± 7% perf-profile.children.cycles-pp.__fdget_raw
0.36 -0.1 0.24 ± 7% perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare
0.22 -0.1 0.12 ± 6% perf-profile.children.cycles-pp.locks_move_blocks
0.41 -0.1 0.32 ± 6% perf-profile.children.cycles-pp.should_failslab
0.20 ± 2% -0.1 0.13 ± 10% [email protected]
0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.get_mem_cgroup_from_objcg
0.00 +0.1 0.08 ± 11% perf-profile.children.cycles-pp.refill_stock
98.10 +0.1 98.23 perf-profile.children.cycles-pp.__libc_fcntl64
0.00 +0.3 0.30 ± 6% perf-profile.children.cycles-pp.obj_cgroup_uncharge
0.00 +0.5 0.53 ± 7% perf-profile.children.cycles-pp.mem_cgroup_from_task
2.41 +1.3 3.69 ± 14% perf-profile.children.cycles-pp.locks_dispose_list
0.00 +2.0 1.99 ± 5% perf-profile.children.cycles-pp.refill_obj_stock
0.32 ± 2% +2.1 2.40 ± 6% perf-profile.children.cycles-pp.rcu_read_unlock_strict
0.00 +3.4 3.39 ± 21% perf-profile.children.cycles-pp.propagate_protected_usage
0.00 +4.9 4.90 ± 8% perf-profile.children.cycles-pp.get_obj_cgroup_from_current
0.00 +5.6 5.60 ± 6% perf-profile.children.cycles-pp.mod_objcg_state
0.00 +5.9 5.94 ± 26% perf-profile.children.cycles-pp.page_counter_cancel
84.29 +6.7 90.98 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
0.00 +7.1 7.12 ± 24% perf-profile.children.cycles-pp.page_counter_uncharge
83.10 +7.2 90.30 perf-profile.children.cycles-pp.do_syscall_64
0.00 +7.3 7.27 ± 24% perf-profile.children.cycles-pp.obj_cgroup_uncharge_pages
46.87 +7.6 54.45 ± 3% perf-profile.children.cycles-pp.do_lock_file_wait
79.26 +8.6 87.90 perf-profile.children.cycles-pp.__x64_sys_fcntl
74.02 +10.8 84.84 perf-profile.children.cycles-pp.do_fcntl
39.59 +11.0 50.57 ± 4% perf-profile.children.cycles-pp.posix_lock_inode
0.00 +11.2 11.23 ± 25% perf-profile.children.cycles-pp.page_counter_try_charge
0.00 +11.4 11.37 ± 24% perf-profile.children.cycles-pp.obj_cgroup_charge_pages
8.04 +11.5 19.54 ± 6% perf-profile.children.cycles-pp.kmem_cache_free
0.00 +13.6 13.63 ± 19% perf-profile.children.cycles-pp.obj_cgroup_charge
64.58 +14.8 79.39 perf-profile.children.cycles-pp.fcntl_setlk
25.73 +17.7 43.45 ± 2% perf-profile.children.cycles-pp.locks_alloc_lock
22.71 +18.8 41.55 ± 3% perf-profile.children.cycles-pp.kmem_cache_alloc
7.42 -3.3 4.14 ± 6% perf-profile.self.cycles-pp.memset_erms
6.55 -3.2 3.35 ± 8% perf-profile.self.cycles-pp.__libc_fcntl64
5.72 -2.4 3.30 ± 6% perf-profile.self.cycles-pp._raw_spin_lock
5.14 -2.4 2.76 ± 5% perf-profile.self.cycles-pp.posix_lock_inode
5.00 -2.2 2.75 ± 8% perf-profile.self.cycles-pp.syscall_return_via_sysret
3.49 -1.7 1.77 ± 4% perf-profile.self.cycles-pp.fcntl_setlk
3.61 -1.5 2.09 ± 6% perf-profile.self.cycles-pp.copy_user_generic_unrolled
3.20 -1.4 1.77 ± 5% perf-profile.self.cycles-pp.___might_sleep
2.97 -1.2 1.74 ± 6% perf-profile.self.cycles-pp.__fget_light
2.35 -1.2 1.14 ± 7% perf-profile.self.cycles-pp.common_file_perm
3.02 -1.2 1.84 ± 6% perf-profile.self.cycles-pp.__might_sleep
2.25 -1.1 1.14 ± 5% perf-profile.self.cycles-pp.locks_release_private
2.38 -0.9 1.47 ± 8% perf-profile.self.cycles-pp.locks_alloc_lock
1.80 -0.8 1.04 ± 7% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
1.39 -0.7 0.71 ± 21% perf-profile.self.cycles-pp.__entry_text_start
1.61 -0.7 0.94 ± 7% perf-profile.self.cycles-pp.__x64_sys_fcntl
1.60 -0.6 0.95 ± 8% perf-profile.self.cycles-pp.do_fcntl
1.43 -0.6 0.79 ± 6% perf-profile.self.cycles-pp.do_lock_file_wait
1.40 -0.6 0.81 ± 7% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
1.31 -0.6 0.73 ± 7% perf-profile.self.cycles-pp.aa_file_perm
1.16 -0.5 0.67 ± 6% perf-profile.self.cycles-pp.syscall_enter_from_user_mode
1.08 -0.5 0.60 ± 6% perf-profile.self.cycles-pp.flock64_to_posix_lock
0.97 -0.4 0.56 ± 6% perf-profile.self.cycles-pp._copy_from_user
1.02 -0.4 0.61 ± 8% perf-profile.self.cycles-pp.do_syscall_64
1.04 -0.4 0.65 ± 4% perf-profile.self.cycles-pp.__cond_resched
0.81 -0.4 0.45 ± 7% perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack
0.76 -0.4 0.42 ± 5% perf-profile.self.cycles-pp.security_file_lock
0.71 -0.3 0.38 ± 8% perf-profile.self.cycles-pp.locks_insert_lock_ctx
0.64 -0.3 0.32 ± 6% perf-profile.self.cycles-pp.locks_unlink_lock_ctx
0.75 ± 2% -0.3 0.44 ± 6% perf-profile.self.cycles-pp.rcu_all_qs
0.70 -0.3 0.42 ± 10% perf-profile.self.cycles-pp.exit_to_user_mode_prepare
0.58 ± 2% -0.3 0.32 ± 5% perf-profile.self.cycles-pp.locks_dispose_list
0.43 -0.3 0.18 ± 7% perf-profile.self.cycles-pp.__list_del_entry_valid
0.52 -0.2 0.29 ± 5% perf-profile.self.cycles-pp.locks_delete_block
0.53 -0.2 0.30 ± 5% perf-profile.self.cycles-pp.locks_get_lock_context
0.63 ± 2% -0.2 0.42 ± 5% perf-profile.self.cycles-pp.__init_waitqueue_head
0.43 -0.2 0.23 ± 9% perf-profile.self.cycles-pp.locks_delete_lock_ctx
0.56 ± 2% -0.2 0.36 ± 11% perf-profile.self.cycles-pp.syscall_exit_to_user_mode
0.43 -0.2 0.25 ± 9% perf-profile.self.cycles-pp.security_file_fcntl
0.32 ± 2% -0.2 0.17 ± 7% perf-profile.self.cycles-pp.__list_add_valid
0.33 -0.2 0.18 ± 9% perf-profile.self.cycles-pp.locks_copy_lock
0.33 -0.1 0.18 ± 7% perf-profile.self.cycles-pp.__might_fault
0.42 ± 2% -0.1 0.27 ± 9% perf-profile.self.cycles-pp.testcase
0.33 ± 2% -0.1 0.18 ± 5% perf-profile.self.cycles-pp.vfs_lock_file
0.32 -0.1 0.18 ± 7% perf-profile.self.cycles-pp.apparmor_file_lock
0.32 ± 2% -0.1 0.18 ± 6% perf-profile.self.cycles-pp.locks_copy_conflock
0.30 ± 3% -0.1 0.18 ± 10% perf-profile.self.cycles-pp.memset
0.26 ± 3% -0.1 0.18 ± 7% perf-profile.self.cycles-pp.syscall_exit_to_user_mode_prepare
0.17 ± 2% -0.1 0.09 ± 7% perf-profile.self.cycles-pp.locks_move_blocks
0.11 ± 4% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.__fdget_raw
0.20 ± 3% -0.0 0.17 ± 6% perf-profile.self.cycles-pp.should_failslab
0.10 ± 4% -0.0 0.07 ± 14% [email protected]
0.00 +0.1 0.06 ± 6% perf-profile.self.cycles-pp.get_mem_cgroup_from_objcg
0.00 +0.1 0.08 ± 11% perf-profile.self.cycles-pp.refill_stock
0.00 +0.1 0.14 ± 10% perf-profile.self.cycles-pp.obj_cgroup_uncharge
0.00 +0.4 0.36 ± 7% perf-profile.self.cycles-pp.mem_cgroup_from_task
0.11 ± 3% +0.8 0.92 ± 5% perf-profile.self.cycles-pp.rcu_read_unlock_strict
0.00 +1.8 1.85 ± 5% perf-profile.self.cycles-pp.refill_obj_stock
0.00 +2.0 2.05 ± 7% perf-profile.self.cycles-pp.obj_cgroup_charge
9.35 +3.0 12.32 ± 4% perf-profile.self.cycles-pp.kmem_cache_alloc
0.00 +3.4 3.36 ± 21% perf-profile.self.cycles-pp.propagate_protected_usage
0.00 +4.0 4.01 ± 8% perf-profile.self.cycles-pp.get_obj_cgroup_from_current
0.00 +5.2 5.23 ± 7% perf-profile.self.cycles-pp.mod_objcg_state
0.00 +5.9 5.90 ± 26% perf-profile.self.cycles-pp.page_counter_cancel
0.00 +9.0 8.97 ± 25% perf-profile.self.cycles-pp.page_counter_try_charge
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang
2 months
[dm] 92986f6b4c: xfstests.generic.455.fail
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 92986f6b4c8a2c24d3a36b80140624f80fd93de4 ("dm: use bio_clone_fast in alloc_io/alloc_tio")
https://github.com/ammarfaizi2/linux-block axboe/linux-block/for-5.18/block
in testcase: xfstests
version: xfstests-x86_64-1de1db8-1_20220217
with following parameters:
disk: 4HDD
fs: xfs
test: generic-logwrites
ucode: 0xec
test-description: xfstests is a regression test suite for xfs and other files ystems.
test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git
on test machine: 4 threads Intel(R) Xeon(R) CPU E3-1225 v5 @ 3.30GHz with 16G memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
2022-03-13 14:24:40 export TEST_DIR=/fs/sda1
2022-03-13 14:24:40 export TEST_DEV=/dev/sda1
2022-03-13 14:24:40 export FSTYP=xfs
2022-03-13 14:24:40 export SCRATCH_MNT=/fs/scratch
2022-03-13 14:24:40 mkdir /fs/scratch -p
2022-03-13 14:24:40 export SCRATCH_DEV=/dev/sda4
2022-03-13 14:24:40 export SCRATCH_LOGDEV=/dev/sda2
2022-03-13 14:24:40 export LOGWRITES_DEV=/dev/sda2
2022-03-13 14:24:40 export MKFS_OPTIONS=-mreflink=1
2022-03-13 14:24:40 sed "s:^:generic/:" //lkp/benchmarks/xfstests/tests/generic-logwrites
2022-03-13 14:24:40 ./check generic/482 generic/457 generic/455
FSTYP -- xfs (debug)
PLATFORM -- Linux/x86_64 lkp-skl-d06 5.17.0-rc2-00044-g92986f6b4c8a #1 SMP Sun Mar 13 14:11:02 CST 2022
MKFS_OPTIONS -- -f -mreflink=1 /dev/sda4
MOUNT_OPTIONS -- /dev/sda4 /fs/scratch
generic/455 [failed, exit status 1]- output mismatch (see /lkp/benchmarks/xfstests/results//generic/455.out.bad)
--- tests/generic/455.out 2022-02-17 11:55:00.000000000 +0000
+++ /lkp/benchmarks/xfstests/results//generic/455.out.bad 2022-03-13 14:26:00.664268705 +0000
@@ -1,2 +1,3 @@
QA output created by 455
-Silence is golden
+testfile1.mark13 md5sum mismatched
+(see /lkp/benchmarks/xfstests/results//generic/455.full for details)
...
(Run 'diff -u /lkp/benchmarks/xfstests/tests/generic/455.out /lkp/benchmarks/xfstests/results//generic/455.out.bad' to see the entire diff)
generic/457 20s
generic/482 427s
Ran: generic/455 generic/457 generic/482
Failures: generic/455
Failed 1 of 3 tests
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
sudo bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
sudo bin/lkp run generated-yaml-file
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
---
0-DAY CI Kernel Test Service
https://lists.01.org/hyperkitty/list/[email protected]
Thanks,
Oliver Sang
2 months, 1 week
[perf vendor events] 3f5f0df7bf: perf-sanity-tests.perf_all_metrics_test.fail
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 3f5f0df7bf0f8c48d33d43454fc0b7d0f3ab9537 ("perf vendor events: Update metrics for Skylake")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: perf-sanity-tests
version: perf-x86_64-fb184c4af9b9-1_20220302
with following parameters:
perf_compiler: clang
ucode: 0xec
on test machine: 8 threads 1 sockets Intel(R) Core(TM) i7-7700 CPU @ 3.60GHz with 32G memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
2022-03-02 19:01:56 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-func-3f5f0df7bf0f8c48d33d43454fc0b7d0f3ab9537/tools/perf/perf test 89
89: perf all metricgroups test : Ok
2022-03-02 19:02:05 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-func-3f5f0df7bf0f8c48d33d43454fc0b7d0f3ab9537/tools/perf/perf test 90
90: perf all metrics test : FAILED!
2022-03-02 19:07:00 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-func-3f5f0df7bf0f8c48d33d43454fc0b7d0f3ab9537/tools/perf/perf test 91
91: perf all PMU test : Ok
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
sudo bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
sudo bin/lkp run generated-yaml-file
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang
2 months, 2 weeks
[sched/pelt] 2d02fa8cc2: stress-ng.pipeherd.ops_per_sec -9.7% regression
by kernel test robot
Greeting,
FYI, we noticed a -9.7% regression of stress-ng.pipeherd.ops_per_sec due to commit:
commit: 2d02fa8cc21a93da35cfba462bf8ab87bf2db651 ("sched/pelt: Relax the sync of load_sum with load_avg")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: stress-ng
on test machine: 128 threads 2 sockets Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz with 128G memory
with following parameters:
nr_threads: 100%
testtime: 60s
class: memory
test: pipeherd
cpufreq_governor: performance
ucode: 0xd000280
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
sudo bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
sudo bin/lkp run generated-yaml-file
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
=========================================================================================
class/compiler/cpufreq_governor/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
memory/gcc-9/performance/x86_64-rhel-8.3/100%/debian-10.4-x86_64-20200603.cgz/lkp-icl-2sp6/pipeherd/stress-ng/60s/0xd000280
commit:
95246d1ec8 ("sched/pelt: Relax the sync of runnable_sum with runnable_avg")
2d02fa8cc2 ("sched/pelt: Relax the sync of load_sum with load_avg")
95246d1ec80b8d19 2d02fa8cc21a93da35cfba462bf
---------------- ---------------------------
%stddev %change %stddev
\ | \
0.21 +11.0% 0.24 ± 2% stress-ng.pipeherd.context_switches_per_bogo_op
3.869e+09 -9.7% 3.494e+09 stress-ng.pipeherd.ops
64412021 -9.7% 58171101 stress-ng.pipeherd.ops_per_sec
442.37 -7.2% 410.54 stress-ng.time.user_time
5.49 ± 2% -0.5 4.94 ± 4% mpstat.cpu.all.usr%
80705 ± 7% +26.7% 102266 ± 17% numa-meminfo.node1.Active
80705 ± 7% +26.7% 102266 ± 17% numa-meminfo.node1.Active(anon)
12324 ± 3% -22.1% 9603 ± 25% softirqs.CPU106.RCU
12703 ± 4% -23.1% 9769 ± 24% softirqs.CPU27.RCU
4.814e+10 -7.8% 4.438e+10 ± 4% perf-stat.i.branch-instructions
1.58 +10.6% 1.75 ± 6% perf-stat.i.cpi
7.485e+10 -8.2% 6.869e+10 ± 4% perf-stat.i.dTLB-loads
4.451e+10 -8.7% 4.062e+10 ± 4% perf-stat.i.dTLB-stores
2.475e+11 -7.9% 2.28e+11 ± 4% perf-stat.i.instructions
0.64 -7.8% 0.59 ± 2% perf-stat.i.ipc
1305 -9.3% 1184 ± 5% perf-stat.i.metric.M/sec
0.57 +0.0 0.61 perf-stat.overall.branch-miss-rate%
1.58 +6.0% 1.67 perf-stat.overall.cpi
0.05 ± 2% +0.0 0.05 ± 8% perf-stat.overall.dTLB-load-miss-rate%
0.00 ± 18% +0.0 0.00 ± 8% perf-stat.overall.dTLB-store-miss-rate%
0.63 -5.7% 0.60 perf-stat.overall.ipc
4.719e+10 -7.3% 4.373e+10 ± 3% perf-stat.ps.branch-instructions
7.341e+10 -7.8% 6.77e+10 ± 3% perf-stat.ps.dTLB-loads
4.366e+10 -8.3% 4.004e+10 ± 3% perf-stat.ps.dTLB-stores
2.426e+11 -7.4% 2.247e+11 ± 3% perf-stat.ps.instructions
1.557e+13 -5.0% 1.479e+13 perf-stat.total.instructions
2.96 ± 2% -0.3 2.68 perf-profile.calltrace.cycles-pp.copy_page_to_iter.pipe_read.new_sync_read.vfs_read.ksys_read
2.80 -0.2 2.56 perf-profile.calltrace.cycles-pp.copy_page_from_iter.pipe_write.new_sync_write.vfs_write.ksys_write
1.81 -0.2 1.63 perf-profile.calltrace.cycles-pp.__entry_text_start.read
1.80 -0.2 1.65 perf-profile.calltrace.cycles-pp.__entry_text_start.write
1.93 -0.1 1.80 ± 2% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_read.new_sync_read.vfs_read.ksys_read
0.94 ± 2% -0.1 0.82 ± 2% perf-profile.calltrace.cycles-pp.security_file_permission.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.37 -0.1 1.25 ± 2% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_write.new_sync_write.vfs_write.ksys_write
1.23 ± 2% -0.1 1.12 ± 2% perf-profile.calltrace.cycles-pp.copyin.copy_page_from_iter.pipe_write.new_sync_write.vfs_write
1.46 ± 3% -0.1 1.36 ± 3% perf-profile.calltrace.cycles-pp.copyout.copy_page_to_iter.pipe_read.new_sync_read.vfs_read
1.40 -0.1 1.30 ± 2% perf-profile.calltrace.cycles-pp.__mutex_unlock_slowpath.pipe_read.new_sync_read.vfs_read.ksys_read
1.04 ± 2% -0.1 0.95 ± 3% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.copy_page_from_iter.pipe_write.new_sync_write
1.03 ± 2% -0.1 0.94 ± 2% perf-profile.calltrace.cycles-pp.__mutex_unlock_slowpath.pipe_write.new_sync_write.vfs_write.ksys_write
1.27 ± 3% -0.1 1.18 ± 3% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout.copy_page_to_iter.pipe_read.new_sync_read
0.92 -0.1 0.83 perf-profile.calltrace.cycles-pp.touch_atime.pipe_read.new_sync_read.vfs_read.ksys_read
1.07 ± 2% -0.1 0.98 perf-profile.calltrace.cycles-pp.security_file_permission.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.78 -0.1 0.70 perf-profile.calltrace.cycles-pp.atime_needs_update.touch_atime.pipe_read.new_sync_read.vfs_read
0.72 ± 2% -0.1 0.64 perf-profile.calltrace.cycles-pp.file_update_time.pipe_write.new_sync_write.vfs_write.ksys_write
0.60 ± 3% -0.1 0.52 ± 2% perf-profile.calltrace.cycles-pp.common_file_perm.security_file_permission.vfs_read.ksys_read.do_syscall_64
2.60 -0.1 2.54 perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common
0.68 -0.1 0.62 perf-profile.calltrace.cycles-pp.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
0.64 -0.1 0.58 ± 2% perf-profile.calltrace.cycles-pp.check_preempt_curr.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function.__wake_up_common
0.73 ± 2% -0.1 0.68 perf-profile.calltrace.cycles-pp.common_file_perm.security_file_permission.vfs_write.ksys_write.do_syscall_64
0.64 ± 3% -0.0 0.59 perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
0.59 ± 2% -0.0 0.54 ± 2% perf-profile.calltrace.cycles-pp.wake_up_q.__mutex_unlock_slowpath.pipe_read.new_sync_read.vfs_read
0.60 -0.0 0.56 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write
0.73 ± 3% -0.0 0.69 ± 3% perf-profile.calltrace.cycles-pp.update_rq_clock.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
0.57 ± 3% -0.0 0.53 perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.82 ± 3% +0.1 0.89 perf-profile.calltrace.cycles-pp.update_load_avg.dequeue_entity.dequeue_task_fair.__schedule.schedule
0.58 ± 2% +0.1 0.64 perf-profile.calltrace.cycles-pp.update_load_avg.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function
0.67 ± 2% +0.1 0.78 ± 3% perf-profile.calltrace.cycles-pp.update_load_avg.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up
40.69 +0.2 40.87 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
40.28 +0.2 40.52 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
50.44 +0.3 50.71 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
49.94 +0.3 50.23 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
39.38 +0.3 39.69 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
1.02 ± 15% +0.3 1.33 ± 14% perf-profile.calltrace.cycles-pp.set_task_cpu.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
48.24 +0.4 48.60 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
38.39 +0.4 38.78 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
47.40 +0.4 47.83 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
13.88 +0.5 14.42 perf-profile.calltrace.cycles-pp.schedule.pipe_read.new_sync_read.vfs_read.ksys_read
36.68 +0.5 37.22 perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
13.70 +0.5 14.25 perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_read.new_sync_read.vfs_read
45.72 +0.6 46.31 perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
35.80 +0.6 36.42 perf-profile.calltrace.cycles-pp.pipe_write.new_sync_write.vfs_write.ksys_write.do_syscall_64
44.85 +0.7 45.51 perf-profile.calltrace.cycles-pp.pipe_read.new_sync_read.vfs_read.ksys_read.do_syscall_64
6.15 +0.7 6.84 ± 2% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.pipe_read.new_sync_read
1.98 ± 9% +0.7 2.70 ± 9% perf-profile.calltrace.cycles-pp.update_cfs_group.dequeue_task_fair.__schedule.schedule.pipe_read
2.03 ± 8% +0.7 2.78 ± 9% perf-profile.calltrace.cycles-pp.update_cfs_group.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function
15.96 +1.0 16.95 perf-profile.calltrace.cycles-pp.prepare_to_wait_event.pipe_read.new_sync_read.vfs_read.ksys_read
6.67 +1.0 7.68 ± 2% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common
6.77 +1.0 7.79 ± 2% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
14.46 +1.0 15.48 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.pipe_read.new_sync_read.vfs_read
13.73 +1.1 14.79 ± 2% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.pipe_read.new_sync_read
26.95 +1.4 28.34 perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write.ksys_write
25.85 +1.5 27.32 perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write
25.18 +1.5 26.69 perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write.new_sync_write
24.61 +1.5 26.14 perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write
3.12 ± 2% -0.3 2.82 perf-profile.children.cycles-pp.copy_page_to_iter
2.98 -0.3 2.71 perf-profile.children.cycles-pp.copy_page_from_iter
3.47 -0.3 3.21 ± 2% perf-profile.children.cycles-pp.mutex_lock
2.25 -0.2 2.04 perf-profile.children.cycles-pp.syscall_return_via_sysret
2.10 ± 2% -0.2 1.89 perf-profile.children.cycles-pp.security_file_permission
2.60 ± 2% -0.2 2.40 ± 2% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
2.48 -0.2 2.29 ± 2% perf-profile.children.cycles-pp.__mutex_unlock_slowpath
2.08 -0.2 1.90 perf-profile.children.cycles-pp.__entry_text_start
1.86 -0.2 1.71 perf-profile.children.cycles-pp.__might_resched
1.45 ± 2% -0.1 1.31 ± 2% perf-profile.children.cycles-pp.common_file_perm
1.28 ± 2% -0.1 1.17 ± 2% perf-profile.children.cycles-pp.copyin
1.51 ± 3% -0.1 1.40 ± 3% perf-profile.children.cycles-pp.copyout
1.21 ± 2% -0.1 1.11 perf-profile.children.cycles-pp.__fdget_pos
1.07 ± 2% -0.1 0.96 ± 2% perf-profile.children.cycles-pp.__might_sleep
0.99 -0.1 0.89 perf-profile.children.cycles-pp.touch_atime
0.95 ± 2% -0.1 0.86 ± 2% perf-profile.children.cycles-pp.current_time
1.04 ± 2% -0.1 0.96 perf-profile.children.cycles-pp.__fget_light
0.83 -0.1 0.74 perf-profile.children.cycles-pp.atime_needs_update
0.90 -0.1 0.81 ± 2% perf-profile.children.cycles-pp.__cond_resched
1.00 ± 2% -0.1 0.91 ± 2% perf-profile.children.cycles-pp.wake_up_q
0.81 -0.1 0.73 ± 2% perf-profile.children.cycles-pp.__might_fault
0.78 ± 2% -0.1 0.71 ± 2% perf-profile.children.cycles-pp.file_update_time
1.24 -0.1 1.17 ± 2% perf-profile.children.cycles-pp.mutex_unlock
2.68 -0.1 2.61 perf-profile.children.cycles-pp.select_idle_sibling
1.81 ± 2% -0.1 1.74 perf-profile.children.cycles-pp.syscall_exit_to_user_mode
0.66 -0.1 0.60 perf-profile.children.cycles-pp.check_preempt_curr
1.15 -0.1 1.09 perf-profile.children.cycles-pp.available_idle_cpu
0.69 -0.1 0.63 perf-profile.children.cycles-pp.ttwu_do_wakeup
0.50 -0.1 0.44 ± 2% perf-profile.children.cycles-pp.check_preempt_wakeup
0.50 ± 3% -0.0 0.45 ± 11% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
0.58 ± 2% -0.0 0.53 ± 2% perf-profile.children.cycles-pp.wake_q_add
0.45 ± 2% -0.0 0.40 ± 2% perf-profile.children.cycles-pp.syscall_enter_from_user_mode
0.47 ± 3% -0.0 0.42 ± 2% perf-profile.children.cycles-pp.aa_file_perm
0.46 ± 3% -0.0 0.42 ± 3% perf-profile.children.cycles-pp.kill_fasync
1.82 -0.0 1.78 perf-profile.children.cycles-pp.select_idle_cpu
0.38 ± 2% -0.0 0.34 ± 2% perf-profile.children.cycles-pp.rcu_all_qs
0.35 ± 2% -0.0 0.32 ± 2% perf-profile.children.cycles-pp.timestamp_truncate
0.24 ± 2% -0.0 0.22 ± 2% perf-profile.children.cycles-pp.rw_verify_area
0.21 -0.0 0.19 perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack
0.19 ± 3% -0.0 0.16 ± 3% perf-profile.children.cycles-pp.iov_iter_init
0.23 -0.0 0.21 ± 3% perf-profile.children.cycles-pp.anon_pipe_buf_release
0.13 -0.0 0.12 ± 4% perf-profile.children.cycles-pp.apparmor_file_permission
0.15 -0.0 0.14 ± 2% perf-profile.children.cycles-pp.pick_next_entity
3.25 +0.2 3.49 perf-profile.children.cycles-pp.update_load_avg
39.46 +0.3 39.77 perf-profile.children.cycles-pp.ksys_write
1.03 ± 15% +0.3 1.35 ± 14% perf-profile.children.cycles-pp.set_task_cpu
48.31 +0.4 48.66 perf-profile.children.cycles-pp.ksys_read
38.52 +0.4 38.90 perf-profile.children.cycles-pp.vfs_write
47.48 +0.4 47.90 perf-profile.children.cycles-pp.vfs_read
91.24 +0.5 91.69 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
90.53 +0.5 91.04 perf-profile.children.cycles-pp.do_syscall_64
13.98 +0.5 14.51 perf-profile.children.cycles-pp.schedule
36.77 +0.5 37.30 perf-profile.children.cycles-pp.new_sync_write
13.88 +0.5 14.42 perf-profile.children.cycles-pp.__schedule
45.80 +0.6 46.39 perf-profile.children.cycles-pp.new_sync_read
36.10 +0.6 36.70 perf-profile.children.cycles-pp.pipe_write
45.16 +0.6 45.81 perf-profile.children.cycles-pp.pipe_read
6.21 +0.7 6.90 ± 2% perf-profile.children.cycles-pp.dequeue_task_fair
16.24 +1.0 17.22 perf-profile.children.cycles-pp._raw_spin_lock_irqsave
16.02 +1.0 17.01 perf-profile.children.cycles-pp.prepare_to_wait_event
6.74 +1.0 7.76 ± 2% perf-profile.children.cycles-pp.enqueue_task_fair
6.83 +1.0 7.86 ± 2% perf-profile.children.cycles-pp.ttwu_do_activate
15.12 +1.1 16.22 perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
27.07 +1.4 28.44 perf-profile.children.cycles-pp.__wake_up_common_lock
25.88 +1.5 27.35 perf-profile.children.cycles-pp.__wake_up_common
25.48 +1.5 26.96 perf-profile.children.cycles-pp.try_to_wake_up
4.24 ± 8% +1.5 5.73 ± 9% perf-profile.children.cycles-pp.update_cfs_group
25.19 +1.5 26.71 perf-profile.children.cycles-pp.autoremove_wake_function
2.24 -0.2 2.04 perf-profile.self.cycles-pp.syscall_return_via_sysret
2.54 ± 2% -0.2 2.34 ± 3% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
2.15 ± 2% -0.1 2.01 ± 3% perf-profile.self.cycles-pp.mutex_lock
1.70 -0.1 1.57 perf-profile.self.cycles-pp.__might_resched
1.44 -0.1 1.30 perf-profile.self.cycles-pp.pipe_write
2.08 -0.1 1.95 ± 2% perf-profile.self.cycles-pp.pipe_read
1.54 -0.1 1.44 ± 3% perf-profile.self.cycles-pp._raw_spin_lock_irq
1.02 ± 2% -0.1 0.91 ± 2% perf-profile.self.cycles-pp.common_file_perm
0.79 ± 2% -0.1 0.69 perf-profile.self.cycles-pp.copy_page_to_iter
2.24 -0.1 2.15 ± 3% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.99 ± 2% -0.1 0.91 perf-profile.self.cycles-pp.__fget_light
0.87 ± 2% -0.1 0.79 ± 2% perf-profile.self.cycles-pp.__might_sleep
0.78 -0.1 0.70 ± 3% perf-profile.self.cycles-pp.copy_page_from_iter
0.92 ± 2% -0.1 0.84 ± 3% perf-profile.self.cycles-pp.write
0.76 ± 2% -0.1 0.70 perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
1.17 -0.1 1.10 ± 2% perf-profile.self.cycles-pp.mutex_unlock
0.59 ± 2% -0.1 0.53 perf-profile.self.cycles-pp.vfs_write
1.02 -0.1 0.96 ± 2% perf-profile.self.cycles-pp._raw_spin_lock
1.10 -0.1 1.05 perf-profile.self.cycles-pp.available_idle_cpu
0.57 -0.1 0.52 perf-profile.self.cycles-pp.new_sync_write
0.89 ± 2% -0.1 0.83 ± 3% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.38 ± 2% -0.1 0.33 ± 2% perf-profile.self.cycles-pp.check_preempt_wakeup
0.59 ± 3% -0.1 0.53 perf-profile.self.cycles-pp.new_sync_read
0.57 ± 2% -0.1 0.51 perf-profile.self.cycles-pp.security_file_permission
0.66 -0.1 0.61 ± 2% perf-profile.self.cycles-pp.__mutex_unlock_slowpath
0.55 ± 2% -0.0 0.50 perf-profile.self.cycles-pp.__entry_text_start
0.53 ± 2% -0.0 0.49 ± 2% perf-profile.self.cycles-pp.do_syscall_64
0.47 -0.0 0.43 perf-profile.self.cycles-pp.__cond_resched
0.63 ± 2% -0.0 0.60 perf-profile.self.cycles-pp.vfs_read
0.55 ± 2% -0.0 0.51 ± 3% perf-profile.self.cycles-pp.wake_q_add
0.37 ± 4% -0.0 0.33 ± 5% perf-profile.self.cycles-pp.kill_fasync
0.39 ± 2% -0.0 0.36 ± 2% perf-profile.self.cycles-pp.aa_file_perm
0.38 ± 2% -0.0 0.35 ± 2% perf-profile.self.cycles-pp.syscall_enter_from_user_mode
0.34 ± 2% -0.0 0.30 ± 2% perf-profile.self.cycles-pp.atime_needs_update
0.36 ± 3% -0.0 0.32 ± 2% perf-profile.self.cycles-pp.current_time
0.31 ± 2% -0.0 0.28 ± 2% perf-profile.self.cycles-pp.timestamp_truncate
0.36 ± 3% -0.0 0.33 ± 2% perf-profile.self.cycles-pp.exit_to_user_mode_prepare
0.34 ± 2% -0.0 0.32 ± 2% perf-profile.self.cycles-pp.__wake_up_common_lock
0.30 -0.0 0.28 perf-profile.self.cycles-pp.file_update_time
0.37 ± 3% -0.0 0.34 ± 3% perf-profile.self.cycles-pp.enqueue_entity
0.33 ± 2% -0.0 0.31 ± 2% perf-profile.self.cycles-pp.wake_up_q
0.26 ± 2% -0.0 0.24 perf-profile.self.cycles-pp.rcu_all_qs
0.28 -0.0 0.26 perf-profile.self.cycles-pp.syscall_exit_to_user_mode
0.30 ± 2% -0.0 0.27 ± 2% perf-profile.self.cycles-pp.ksys_write
0.18 ± 2% -0.0 0.16 ± 2% perf-profile.self.cycles-pp.__fdget_pos
0.53 -0.0 0.51 perf-profile.self.cycles-pp.select_idle_sibling
0.18 ± 2% -0.0 0.16 ± 3% perf-profile.self.cycles-pp.rw_verify_area
0.18 ± 2% -0.0 0.16 ± 2% perf-profile.self.cycles-pp.touch_atime
0.20 ± 2% -0.0 0.18 ± 2% perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack
0.14 ± 4% -0.0 0.12 ± 3% perf-profile.self.cycles-pp.iov_iter_init
0.15 ± 4% -0.0 0.13 ± 4% perf-profile.self.cycles-pp.__might_fault
0.10 ± 5% -0.0 0.08 ± 4% perf-profile.self.cycles-pp.copyout
0.10 ± 5% -0.0 0.08 ± 4% perf-profile.self.cycles-pp.copyin
0.36 ± 2% +0.2 0.53 ± 2% perf-profile.self.cycles-pp.enqueue_task_fair
1.43 ± 2% +0.3 1.69 ± 2% perf-profile.self.cycles-pp.update_load_avg
0.85 ± 18% +0.3 1.17 ± 16% perf-profile.self.cycles-pp.set_task_cpu
9.31 ± 2% +0.5 9.81 perf-profile.self.cycles-pp.try_to_wake_up
15.10 +1.1 16.21 perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
4.21 ± 8% +1.5 5.71 ± 9% perf-profile.self.cycles-pp.update_cfs_group
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang
2 months, 3 weeks
[mm/slub] 555b8c8cb3: WARNING:at_lib/stackdepot.c:#stack_depot_fetch
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 555b8c8cb3f335ec8fd9d1ffd25e1395790d102d ("mm/slub: use stackdepot to save stack trace in objects")
https://git.kernel.org/cgit/linux/kernel/git/vbabka/linux.git slub-stackdepot-v3r1
in testcase: rcutorture
version:
with following parameters:
runtime: 300s
test: cpuhotplug
torture_type: tasks
test-description: rcutorture is rcutorture kernel module load/unload test.
test-url: https://www.kernel.org/doc/Documentation/RCU/torture.txt
on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 4G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
(please be noted the issue is random, we observed it 4 times out of 32 runs.
parent keeps clean on 32 runs.)
[ 318.532656][ T1741] WARNING: CPU: 0 PID: 1741 at lib/stackdepot.c:326 stack_depot_fetch (lib/stackdepot.c:326 (discriminator 1))
[ 318.534566][ T1741] Modules linked in: rcutorture(-) torture aesni_intel crypto_simd cryptd input_leds pcspkr qemu_fw_cfg tiny_power_button button
[ 318.537087][ T1741] CPU: 0 PID: 1741 Comm: rmmod Not tainted 5.17.0-rc1-00003-g555b8c8cb3f3 #1 1fcfbabccf3b829d5910183510efdc3cb11ab20b
[ 318.539366][ T1741] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014
[ 318.541093][ T1741] EIP: stack_depot_fetch (lib/stackdepot.c:326 (discriminator 1))
[ 318.542104][ T1741] Code: 66 81 e3 ff 03 85 c0 74 26 89 d6 89 c7 8b 15 f0 56 3e d5 81 e7 ff ff 1f 00 39 d7 7e 16 50 52 57 68 20 37 59 d4 e8 47 f4 50 00 <0f> 0b 83 c4 10 31 c0 eb 2f 81 ff ff 1f 00 00 76 0c 89 fa b8 04 bd
All code
========
0: 66 81 e3 ff 03 and $0x3ff,%bx
5: 85 c0 test %eax,%eax
7: 74 26 je 0x2f
9: 89 d6 mov %edx,%esi
b: 89 c7 mov %eax,%edi
d: 8b 15 f0 56 3e d5 mov -0x2ac1a910(%rip),%edx # 0xffffffffd53e5703
13: 81 e7 ff ff 1f 00 and $0x1fffff,%edi
19: 39 d7 cmp %edx,%edi
1b: 7e 16 jle 0x33
1d: 50 push %rax
1e: 52 push %rdx
1f: 57 push %rdi
20: 68 20 37 59 d4 pushq $0xffffffffd4593720
25: e8 47 f4 50 00 callq 0x50f471
2a:* 0f 0b ud2 <-- trapping instruction
2c: 83 c4 10 add $0x10,%esp
2f: 31 c0 xor %eax,%eax
31: eb 2f jmp 0x62
33: 81 ff ff 1f 00 00 cmp $0x1fff,%edi
39: 76 0c jbe 0x47
3b: 89 fa mov %edi,%edx
3d: b8 .byte 0xb8
3e: 04 bd add $0xbd,%al
Code starting with the faulting instruction
===========================================
0: 0f 0b ud2
2: 83 c4 10 add $0x10,%esp
5: 31 c0 xor %eax,%eax
7: eb 2f jmp 0x38
9: 81 ff ff 1f 00 00 cmp $0x1fff,%edi
f: 76 0c jbe 0x1d
11: 89 fa mov %edi,%edx
13: b8 .byte 0xb8
14: 04 bd add $0xbd,%al
[ 318.545357][ T1741] EAX: 0000003a EBX: 0000016d ECX: 00000027 EDX: d471aa3c
[ 318.546659][ T1741] ESI: f4a31e20 EDI: 000cafae EBP: f4a31e0c ESP: f4a31df0
[ 318.547930][ T1741] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 0068 EFLAGS: 00010296
[ 318.549302][ T1741] CR0: 80050033 CR2: b7234000 CR3: 3493c000 CR4: 000406d0
[ 318.550616][ T1741] Call Trace:
[ 318.551322][ T1741] kmem_obj_info (mm/slub.c:4365)
[ 318.552241][ T1741] kmem_dump_obj (mm/slab_common.c:594)
[ 318.553214][ T1741] mem_dump_obj (mm/util.c:1026)
[ 318.554068][ T1741] rcu_torture_cleanup+0x3be/0x613 rcutorture
[ 318.555861][ T1741] ? rcu_read_lock_sched_held (kernel/rcu/update.c:125)
[ 318.557037][ T1741] ? prepare_to_wait_exclusive (kernel/sched/wait.c:415)
[ 318.558077][ T1741] rcu_torture_cleanup (kernel/rcu/rcutorture.c:3008) rcutorture
[ 318.559763][ T1741] __ia32_sys_delete_module (kernel/module.c:969 kernel/module.c:912 kernel/module.c:912)
[ 318.560840][ T1741] ? lock_release (kernel/locking/lockdep.c:5315 kernel/locking/lockdep.c:5659)
[ 318.561769][ T1741] ? __might_fault (mm/memory.c:5272 mm/memory.c:5257)
[ 318.562605][ T1741] __do_fast_syscall_32 (arch/x86/entry/common.c:112 arch/x86/entry/common.c:178)
[ 318.563575][ T1741] do_fast_syscall_32 (arch/x86/entry/common.c:203)
[ 318.564559][ T1741] do_SYSENTER_32 (arch/x86/entry/common.c:247)
[ 318.565406][ T1741] entry_SYSENTER_32 (arch/x86/entry/entry_32.S:869)
[ 318.566306][ T1741] EIP: 0xb7edb549
[ 318.567141][ T1741] Code: 03 74 c0 01 10 05 03 74 b8 01 10 06 03 74 b4 01 10 07 03 74 b0 01 10 08 03 74 d8 01 00 00 00 00 00 51 52 55 89 e5 0f 34 cd 80 <5d> 5a 59 c3 90 90 90 90 8d b4 26 00 00 00 00 8d b4 26 00 00 00 00
All code
========
0: 03 74 c0 01 add 0x1(%rax,%rax,8),%esi
4: 10 05 03 74 b8 01 adc %al,0x1b87403(%rip) # 0x1b8740d
a: 10 06 adc %al,(%rsi)
c: 03 74 b4 01 add 0x1(%rsp,%rsi,4),%esi
10: 10 07 adc %al,(%rdi)
12: 03 74 b0 01 add 0x1(%rax,%rsi,4),%esi
16: 10 08 adc %cl,(%rax)
18: 03 74 d8 01 add 0x1(%rax,%rbx,8),%esi
1c: 00 00 add %al,(%rax)
1e: 00 00 add %al,(%rax)
20: 00 51 52 add %dl,0x52(%rcx)
23: 55 push %rbp
24: 89 e5 mov %esp,%ebp
26: 0f 34 sysenter
28: cd 80 int $0x80
2a:* 5d pop %rbp <-- trapping instruction
2b: 5a pop %rdx
2c: 59 pop %rcx
2d: c3 retq
2e: 90 nop
2f: 90 nop
30: 90 nop
31: 90 nop
32: 8d b4 26 00 00 00 00 lea 0x0(%rsi,%riz,1),%esi
39: 8d b4 26 00 00 00 00 lea 0x0(%rsi,%riz,1),%esi
Code starting with the faulting instruction
===========================================
0: 5d pop %rbp
1: 5a pop %rdx
2: 59 pop %rcx
3: c3 retq
4: 90 nop
5: 90 nop
6: 90 nop
7: 90 nop
8: 8d b4 26 00 00 00 00 lea 0x0(%rsi,%riz,1),%esi
f: 8d b4 26 00 00 00 00 lea 0x0(%rsi,%riz,1),%esi
[ 318.570837][ T1741] EAX: ffffffda EBX: b7f2ee44 ECX: 00000800 EDX: b7f15949
[ 318.572303][ T1741] ESI: b7f2ee08 EDI: b7f2ee08 EBP: bfedfe99 ESP: bfede158
[ 318.573645][ T1741] DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 007b EFLAGS: 00000202
[ 318.575211][ T1741] irq event stamp: 4771
[ 318.576062][ T1741] hardirqs last enabled at (4779): __up_console_sem (arch/x86/include/asm/irqflags.h:45 (discriminator 1) arch/x86/include/asm/irqflags.h:80 (discriminator 1) arch/x86/include/asm/irqflags.h:138 (discriminator 1) kernel/printk/printk.c:256 (discriminator 1))
[ 318.578008][ T1741] hardirqs last disabled at (4788): __up_console_sem (kernel/printk/printk.c:254 (discriminator 3))
[ 318.579667][ T1741] softirqs last enabled at (4654): __do_softirq (arch/x86/include/asm/preempt.h:27 kernel/softirq.c:402 kernel/softirq.c:587)
[ 318.581320][ T1741] softirqs last disabled at (4645): do_softirq_own_stack (arch/x86/kernel/irq_32.c:60 arch/x86/kernel/irq_32.c:150)
[ 318.583074][ T1741] ---[ end trace 0000000000000000 ]---
[ 318.584139][ T1741] ------------[ cut here ]------------
[ 318.585205][ T1741] slab index 568234 out of bounds (73) for stack id a9a8abaa
To reproduce:
# build kernel
cd linux
cp config-5.17.0-rc1-00003-g555b8c8cb3f3 .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
--
0-DAY CI Kernel Test Service
https://01.org/lkp
2 months, 4 weeks
[sched/fair] ddb3b1126f: hackbench.throughput -25.9% regression
by kernel test robot
Greeting,
FYI, we noticed a -25.9% regression of hackbench.throughput due to commit:
commit: ddb3b1126fe93e8d6e05960048840e6d6edbb7b6 ("[PATCH 2/2] sched/fair: Simple runqueue order on migrate")
url: https://github.com/intel-lab-lkp/linux/commits/Tim-Chen/sched-fair-Fix-st...
base: https://git.kernel.org/cgit/linux/kernel/git/tip/tip.git ffea9fb319360b9ead8befac6bb2db2b54fd53e6
patch link: https://lore.kernel.org/lkml/f59f1dfeec4692e7a373cc810168912a2d2f8f3c.164...
in testcase: hackbench
on test machine: 16 threads 1 sockets Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz with 32G memory
with following parameters:
nr_threads: 100%
iterations: 4
mode: threads
ipc: socket
cpufreq_governor: performance
ucode: 0xec
test-description: Hackbench is both a benchmark and a stress test for the Linux kernel scheduler.
test-url: https://github.com/linux-test-project/ltp/blob/master/testcases/kernel/sc...
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
sudo bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
sudo bin/lkp run generated-yaml-file
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
=========================================================================================
compiler/cpufreq_governor/ipc/iterations/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode:
gcc-9/performance/socket/4/x86_64-rhel-8.3/threads/100%/debian-10.4-x86_64-20200603.cgz/lkp-cfl-e1/hackbench/0xec
commit:
d9ad181b93 ("sched/fair: Don't rely on ->exec_start for migration")
ddb3b1126f ("sched/fair: Simple runqueue order on migrate")
d9ad181b93f83b36 ddb3b1126fe93e8d6e059600488
---------------- ---------------------------
%stddev %change %stddev
\ | \
92566 -25.9% 68598 ± 2% hackbench.throughput
85.50 +40.8% 120.35 ± 2% hackbench.time.elapsed_time
85.50 +40.8% 120.35 ± 2% hackbench.time.elapsed_time.max
9674391 ± 2% +466.2% 54780205 ± 2% hackbench.time.involuntary_context_switches
1240 +42.6% 1768 ± 3% hackbench.time.system_time
89.58 +20.4% 107.85 hackbench.time.user_time
36626407 +270.2% 1.356e+08 ± 2% hackbench.time.voluntary_context_switches
2500490 ± 3% +78.2% 4456808 ± 3% cpuidle..usage
118.45 ± 2% +29.2% 153.02 ± 2% uptime.boot
0.93 -0.1 0.81 mpstat.cpu.all.irq%
6.61 ± 2% -0.7 5.87 ± 2% mpstat.cpu.all.usr%
2512245 +20.5% 3026652 ± 7% vmstat.memory.cache
544441 +186.6% 1560098 ± 2% vmstat.system.cs
119990 +178.6% 334293 ± 3% vmstat.system.in
2304 +1133.2% 28422 ± 41% meminfo.Active
2304 +1133.2% 28422 ± 41% meminfo.Active(anon)
88024 ± 4% +29.7% 114209 meminfo.AnonHugePages
2435281 +20.2% 2927665 ± 7% meminfo.Cached
350654 +141.0% 844991 ± 26% meminfo.Committed_AS
8189952 ± 11% +14.8% 9398954 ± 5% meminfo.DirectMap2M
250813 +187.6% 721280 ± 29% meminfo.Inactive
250813 +187.6% 721280 ± 29% meminfo.Inactive(anon)
31549 +263.8% 114791 ± 46% meminfo.Mapped
3074603 +15.8% 3560302 ± 6% meminfo.Memused
10473 +4701.4% 502857 ± 43% meminfo.Shmem
3077682 +16.2% 3576435 ± 5% meminfo.max_used_kB
1130190 ± 3% +42.8% 1614074 ± 3% turbostat.C1
0.60 ± 3% -0.2 0.42 ± 3% turbostat.C1%
20997 ± 75% -83.4% 3478 ± 25% turbostat.C1E
0.12 ±109% -0.1 0.01 ± 82% turbostat.C1E%
2.15 ± 6% -39.0% 1.31 ± 20% turbostat.CPU%c1
64.33 ± 5% +12.7% 72.50 ± 3% turbostat.CoreTmp
30.91 ±150% -99.3% 0.21 ± 8% turbostat.IPC
10771253 +288.2% 41809146 ± 2% turbostat.IRQ
1259955 ± 5% +116.5% 2728148 ± 5% turbostat.POLL
0.24 ± 4% +0.1 0.32 ± 6% turbostat.POLL%
0.59 ± 26% -88.4% 0.07 ±134% turbostat.Pkg%pc2
1.03 ± 90% -95.5% 0.05 ± 90% turbostat.Pkg%pc3
62.50 ± 4% +15.2% 72.00 ± 5% turbostat.PkgTmp
3.60 -24.0% 2.73 turbostat.RAMWatt
575.17 +1065.8% 6705 ± 49% proc-vmstat.nr_active_anon
60709 +1.4% 61578 proc-vmstat.nr_anon_pages
729380 -1.6% 717382 proc-vmstat.nr_dirty_background_threshold
1460544 -1.6% 1436519 proc-vmstat.nr_dirty_threshold
608819 +20.0% 730638 ± 7% proc-vmstat.nr_file_pages
7370339 -1.6% 7250228 proc-vmstat.nr_free_pages
62712 +186.1% 179444 ± 29% proc-vmstat.nr_inactive_anon
8133 +250.3% 28494 ± 46% proc-vmstat.nr_mapped
2617 +4654.3% 124436 ± 44% proc-vmstat.nr_shmem
19224 +1.3% 19478 proc-vmstat.nr_slab_reclaimable
20146 -7.5% 18626 proc-vmstat.nr_slab_unreclaimable
575.17 +1065.8% 6705 ± 49% proc-vmstat.nr_zone_active_anon
62712 +186.1% 179444 ± 29% proc-vmstat.nr_zone_inactive_anon
337848 +273.7% 1262543 ± 22% proc-vmstat.numa_hit
337954 +273.6% 1262732 ± 22% proc-vmstat.numa_local
290.17 ± 6% +17333.2% 50585 ±178% proc-vmstat.pgactivate
337910 +273.6% 1262506 ± 22% proc-vmstat.pgalloc_normal
208172 +47.8% 307671 ± 6% proc-vmstat.pgfault
341803 +31.1% 448267 ± 23% proc-vmstat.pgfree
11963 ± 3% +22.2% 14624 ± 2% proc-vmstat.pgreuse
41.33 ± 7% +38.8% 57.35 perf-stat.i.MPKI
9.472e+09 -10.1% 8.515e+09 ± 2% perf-stat.i.branch-instructions
76415175 +10.9% 84779467 ± 2% perf-stat.i.branch-misses
15.99 -9.9 6.04 ± 4% perf-stat.i.cache-miss-rate%
3.093e+08 -54.1% 1.421e+08 ± 3% perf-stat.i.cache-misses
1.95e+09 +24.7% 2.433e+09 ± 2% perf-stat.i.cache-references
560253 ± 2% +185.0% 1596715 ± 2% perf-stat.i.context-switches
1.27 ± 4% +15.2% 1.47 ± 3% perf-stat.i.cpi
63663 +9.0% 69379 ± 5% perf-stat.i.cpu-migrations
220.61 ± 13% +270.2% 816.61 ± 15% perf-stat.i.cycles-between-cache-misses
1.441e+10 -12.8% 1.257e+10 ± 2% perf-stat.i.dTLB-loads
8.621e+09 -12.9% 7.505e+09 ± 2% perf-stat.i.dTLB-stores
40563294 ± 2% -18.9% 32876799 ± 3% perf-stat.i.iTLB-load-misses
384404 ± 2% +4.7% 402492 perf-stat.i.iTLB-loads
4.879e+10 -11.4% 4.323e+10 ± 2% perf-stat.i.instructions
1218 +13.2% 1379 ± 7% perf-stat.i.instructions-per-iTLB-miss
0.80 -12.2% 0.70 ± 2% perf-stat.i.ipc
0.05 ± 77% +483.0% 0.30 ± 6% perf-stat.i.major-faults
0.03 ± 20% -100.0% 0.00 perf-stat.i.metric.G/sec
932.18 ± 2% -32.9% 625.58 ± 2% perf-stat.i.metric.K/sec
2127 -9.6% 1923 ± 2% perf-stat.i.metric.M/sec
1654 ± 2% +20.7% 1996 ± 5% perf-stat.i.minor-faults
13758518 ± 2% -55.8% 6082651 ± 3% perf-stat.i.node-loads
52659547 -57.3% 22477918 ± 4% perf-stat.i.node-stores
1654 ± 2% +20.7% 1997 ± 5% perf-stat.i.page-faults
39.96 +40.7% 56.22 perf-stat.overall.MPKI
0.81 +0.2 0.99 perf-stat.overall.branch-miss-rate%
15.86 -10.2 5.71 ± 3% perf-stat.overall.cache-miss-rate%
1.25 +14.6% 1.43 ± 2% perf-stat.overall.cpi
196.89 +126.5% 446.05 ± 4% perf-stat.overall.cycles-between-cache-misses
1203 ± 2% +10.0% 1323 ± 2% perf-stat.overall.instructions-per-iTLB-miss
0.80 -12.7% 0.70 ± 2% perf-stat.overall.ipc
9.364e+09 -10.1% 8.414e+09 ± 2% perf-stat.ps.branch-instructions
75547552 +10.1% 83192410 ± 2% perf-stat.ps.branch-misses
3.058e+08 -55.2% 1.369e+08 ± 4% perf-stat.ps.cache-misses
1.928e+09 +24.3% 2.396e+09 ± 2% perf-stat.ps.cache-references
553796 ± 2% +185.8% 1582541 ± 2% perf-stat.ps.context-switches
62898 +7.0% 67281 ± 5% perf-stat.ps.cpu-migrations
1.425e+10 -13.3% 1.235e+10 ± 2% perf-stat.ps.dTLB-loads
8.522e+09 -13.5% 7.371e+09 ± 2% perf-stat.ps.dTLB-stores
40098951 ± 2% -19.6% 32229848 ± 3% perf-stat.ps.iTLB-load-misses
4.824e+10 -11.6% 4.263e+10 ± 2% perf-stat.ps.instructions
0.05 ± 77% +509.9% 0.31 ± 6% perf-stat.ps.major-faults
1635 ± 2% +17.9% 1927 ± 5% perf-stat.ps.minor-faults
13602325 ± 2% -57.0% 5850907 ± 3% perf-stat.ps.node-loads
52060595 -58.3% 21688976 ± 5% perf-stat.ps.node-stores
1635 ± 2% +17.9% 1928 ± 5% perf-stat.ps.page-faults
4.241e+12 +23.4% 5.233e+12 perf-stat.total.instructions
34.13 ± 17% -33.7 0.41 ± 72% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
33.70 ± 16% -33.4 0.31 ±101% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
33.70 ± 16% -33.4 0.31 ±101% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
33.70 ± 16% -33.4 0.31 ±101% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
33.28 ± 16% -33.2 0.08 ±223% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
33.28 ± 16% -33.2 0.08 ±223% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
31.16 ± 13% -31.2 0.00 perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
16.93 ± 42% -16.9 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
16.93 ± 42% -16.9 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
12.61 ± 47% -12.6 0.00 perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.61 ± 47% -12.6 0.00 perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.61 ± 47% -12.6 0.00 perf-profile.calltrace.cycles-pp.arch_do_signal_or_restart.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.61 ± 47% -12.6 0.00 perf-profile.calltrace.cycles-pp.get_signal.arch_do_signal_or_restart.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
12.61 ± 47% -12.6 0.00 perf-profile.calltrace.cycles-pp.do_group_exit.get_signal.arch_do_signal_or_restart.exit_to_user_mode_prepare.syscall_exit_to_user_mode
12.61 ± 47% -12.6 0.00 perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.get_signal.arch_do_signal_or_restart.exit_to_user_mode_prepare
9.73 ± 82% -9.7 0.00 perf-profile.calltrace.cycles-pp.mmput.do_exit.do_group_exit.get_signal.arch_do_signal_or_restart
9.73 ± 82% -9.7 0.00 perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.do_group_exit.get_signal
9.25 ±102% -9.3 0.00 perf-profile.calltrace.cycles-pp._dl_catch_error
4.97 ± 97% -5.0 0.00 perf-profile.calltrace.cycles-pp.tlb_finish_mmu.exit_mmap.mmput.do_exit.do_group_exit
4.97 ± 97% -5.0 0.00 perf-profile.calltrace.cycles-pp.tlb_flush_mmu.tlb_finish_mmu.exit_mmap.mmput.do_exit
4.52 ±115% -4.5 0.00 perf-profile.calltrace.cycles-pp.__get_cpu_features
4.38 ±118% -4.4 0.00 perf-profile.calltrace.cycles-pp.release_pages.tlb_flush_mmu.tlb_finish_mmu.exit_mmap.mmput
0.00 +0.6 0.62 ± 18% perf-profile.calltrace.cycles-pp.select_idle_cpu.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function
0.00 +0.6 0.62 ± 17% perf-profile.calltrace.cycles-pp.ttwu_do_wakeup.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
0.00 +0.6 0.62 ± 11% perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.6 0.63 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
0.00 +0.6 0.64 ± 12% perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
0.00 +0.7 0.67 ± 7% perf-profile.calltrace.cycles-pp.mutex_lock.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
0.00 +0.7 0.72 ± 24% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.schedule_timeout.unix_stream_read_generic
0.00 +0.8 0.75 ± 12% perf-profile.calltrace.cycles-pp.security_socket_recvmsg.sock_recvmsg.sock_read_iter.new_sync_read.vfs_read
0.00 +0.8 0.83 ± 19% perf-profile.calltrace.cycles-pp.skb_queue_tail.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
0.00 +0.8 0.84 ± 13% perf-profile.calltrace.cycles-pp.sock_recvmsg.sock_read_iter.new_sync_read.vfs_read.ksys_read
0.00 +0.8 0.84 ± 17% perf-profile.calltrace.cycles-pp.__check_object_size.skb_copy_datagram_from_iter.unix_stream_sendmsg.sock_sendmsg.sock_write_iter
0.00 +0.9 0.86 ± 19% perf-profile.calltrace.cycles-pp.skb_set_owner_w.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter
0.00 +0.9 0.89 ± 4% perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
0.00 +1.0 0.98 ± 5% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
0.00 +1.0 1.04 ± 18% perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common
0.00 +1.0 1.04 ± 14% perf-profile.calltrace.cycles-pp.__slab_free.skb_release_data.consume_skb.unix_stream_read_generic.unix_stream_recvmsg
0.00 +1.1 1.06 ± 13% perf-profile.calltrace.cycles-pp.__slab_free.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
0.00 +1.3 1.26 ± 14% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
0.00 +1.3 1.29 ± 17% perf-profile.calltrace.cycles-pp._copy_from_iter.skb_copy_datagram_from_iter.unix_stream_sendmsg.sock_sendmsg.sock_write_iter
0.00 +1.4 1.36 ± 40% perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_switch.__schedule.schedule.exit_to_user_mode_prepare
0.00 +1.4 1.39 ± 14% perf-profile.calltrace.cycles-pp.__check_object_size.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor
0.00 +1.4 1.42 ± 39% perf-profile.calltrace.cycles-pp.perf_trace_sched_switch.__schedule.schedule.exit_to_user_mode_prepare.syscall_exit_to_user_mode
0.00 +1.5 1.45 ± 14% perf-profile.calltrace.cycles-pp.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic
0.00 +1.5 1.47 ± 19% perf-profile.calltrace.cycles-pp._raw_spin_lock.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
0.00 +1.6 1.61 ± 16% perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +1.6 1.63 ± 17% perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
0.00 +1.6 1.64 ± 20% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter
0.00 +1.7 1.69 ± 20% perf-profile.calltrace.cycles-pp.sock_wfree.unix_destruct_scm.skb_release_head_state.skb_release_all.consume_skb
0.00 +1.7 1.72 ± 16% perf-profile.calltrace.cycles-pp.kmem_cache_free.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
0.00 +1.7 1.74 ± 20% perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor
0.00 +1.8 1.77 ± 25% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__schedule.schedule.schedule_timeout
0.00 +1.8 1.83 ± 20% perf-profile.calltrace.cycles-pp.unix_destruct_scm.skb_release_head_state.skb_release_all.consume_skb.unix_stream_read_generic
0.00 +1.9 1.87 ± 25% perf-profile.calltrace.cycles-pp._raw_spin_lock.__schedule.schedule.schedule_timeout.unix_stream_read_generic
0.00 +1.9 1.88 ± 20% perf-profile.calltrace.cycles-pp.skb_release_head_state.skb_release_all.consume_skb.unix_stream_read_generic.unix_stream_recvmsg
0.00 +1.9 1.91 ± 20% perf-profile.calltrace.cycles-pp.skb_release_all.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
0.00 +2.0 1.96 ± 15% perf-profile.calltrace.cycles-pp.kfree.skb_release_data.consume_skb.unix_stream_read_generic.unix_stream_recvmsg
0.00 +2.2 2.18 ± 18% perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic
0.00 +2.3 2.28 ± 17% perf-profile.calltrace.cycles-pp.skb_copy_datagram_from_iter.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
0.00 +2.5 2.49 ± 41% perf-profile.calltrace.cycles-pp.__schedule.schedule.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
0.00 +2.5 2.52 ± 40% perf-profile.calltrace.cycles-pp.schedule.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +2.8 2.75 ± 38% perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
0.00 +2.8 2.76 ± 17% perf-profile.calltrace.cycles-pp.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg
0.00 +2.8 2.85 ± 37% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
0.00 +3.2 3.19 ± 15% perf-profile.calltrace.cycles-pp.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb
0.00 +3.2 3.19 ± 15% perf-profile.calltrace.cycles-pp.skb_release_data.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
0.00 +3.3 3.33 ± 15% perf-profile.calltrace.cycles-pp.kmalloc_reserve.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg
0.00 +3.7 3.70 ± 23% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common
0.00 +3.7 3.75 ± 16% perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg
0.00 +3.8 3.79 ± 16% perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
0.00 +3.8 3.83 ± 16% perf-profile.calltrace.cycles-pp.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
0.00 +3.9 3.88 ± 22% perf-profile.calltrace.cycles-pp._raw_spin_lock.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
0.00 +4.8 4.77 ± 25% perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_switch.__schedule.schedule.schedule_timeout
0.00 +5.0 4.96 ± 25% perf-profile.calltrace.cycles-pp.perf_trace_sched_switch.__schedule.schedule.schedule_timeout.unix_stream_read_generic
0.00 +5.2 5.21 ± 22% perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_wakeup_template
0.00 +5.2 5.24 ± 22% perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_wakeup_template.try_to_wake_up
0.00 +5.2 5.25 ± 22% perf-profile.calltrace.cycles-pp.perf_swevent_overflow.perf_tp_event.perf_trace_sched_wakeup_template.try_to_wake_up.autoremove_wake_function
0.00 +5.3 5.32 ± 23% perf-profile.calltrace.cycles-pp.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.dequeue_entity
0.00 +5.4 5.38 ± 17% perf-profile.calltrace.cycles-pp.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
0.00 +5.4 5.39 ± 24% perf-profile.calltrace.cycles-pp.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.enqueue_entity
0.43 ±223% +5.5 5.88 ± 27% perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_switch
0.00 +5.5 5.48 ± 23% perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.dequeue_entity.dequeue_task_fair
0.43 ±223% +5.5 5.92 ± 27% perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_switch.__schedule
0.00 +5.5 5.54 ± 24% perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.enqueue_entity.enqueue_task_fair
0.00 +5.6 5.57 ± 21% perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_wakeup_template.try_to_wake_up.autoremove_wake_function.__wake_up_common
0.00 +5.6 5.60 ± 23% perf-profile.calltrace.cycles-pp.perf_trace_sched_stat_runtime.update_curr.dequeue_entity.dequeue_task_fair.__schedule
0.00 +5.7 5.72 ± 24% perf-profile.calltrace.cycles-pp.perf_trace_sched_stat_runtime.update_curr.enqueue_entity.enqueue_task_fair.ttwu_do_activate
0.00 +5.7 5.74 ± 21% perf-profile.calltrace.cycles-pp.perf_trace_sched_wakeup_template.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
0.00 +5.8 5.80 ± 30% perf-profile.calltrace.cycles-pp.unwind_next_frame.__unwind_start.perf_callchain_kernel.get_perf_callchain.perf_callchain
0.00 +5.9 5.93 ± 27% perf-profile.calltrace.cycles-pp.perf_swevent_overflow.perf_tp_event.perf_trace_sched_switch.__schedule.schedule
0.00 +6.0 6.02 ± 22% perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__schedule.schedule
0.00 +6.2 6.19 ± 23% perf-profile.calltrace.cycles-pp.update_curr.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up
0.43 ±223% +6.3 6.71 ± 29% perf-profile.calltrace.cycles-pp.unwind_next_frame.perf_callchain_kernel.get_perf_callchain.perf_callchain.perf_prepare_sample
0.00 +6.4 6.44 ± 22% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.schedule_timeout
0.00 +6.7 6.65 ± 29% perf-profile.calltrace.cycles-pp.__unwind_start.perf_callchain_kernel.get_perf_callchain.perf_callchain.perf_prepare_sample
0.00 +6.9 6.86 ± 33% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.sock_def_readable.unix_stream_sendmsg
0.00 +7.1 7.07 ± 32% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.sock_def_readable.unix_stream_sendmsg.sock_sendmsg
0.00 +7.2 7.19 ± 22% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function
0.00 +7.2 7.21 ± 16% perf-profile.calltrace.cycles-pp.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg
0.00 +7.3 7.34 ± 21% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.schedule_timeout.unix_stream_read_generic
0.00 +7.3 7.35 ± 16% perf-profile.calltrace.cycles-pp.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter
0.00 +8.1 8.08 ± 22% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common
0.00 +8.1 8.13 ± 22% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
0.00 +9.2 9.20 ± 17% perf-profile.calltrace.cycles-pp.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
0.00 +10.6 10.62 ± 23% perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime
0.00 +10.7 10.68 ± 23% perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_swevent_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr
0.00 +16.2 16.16 ± 22% perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg
0.00 +16.3 16.26 ± 22% perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter
0.00 +16.4 16.40 ± 22% perf-profile.calltrace.cycles-pp.schedule_timeout.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read
0.43 ±223% +17.1 17.53 ± 27% perf-profile.calltrace.cycles-pp.perf_callchain_kernel.get_perf_callchain.perf_callchain.perf_prepare_sample.perf_event_output_forward
0.43 ±223% +18.4 18.82 ± 27% perf-profile.calltrace.cycles-pp.get_perf_callchain.perf_callchain.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow
0.43 ±223% +18.5 18.93 ± 27% perf-profile.calltrace.cycles-pp.perf_callchain.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow
0.43 ±223% +19.7 20.08 ± 27% perf-profile.calltrace.cycles-pp.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_swevent_overflow.perf_tp_event
0.00 +20.9 20.85 ± 20% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sock_def_readable
0.00 +21.0 21.00 ± 20% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sock_def_readable.unix_stream_sendmsg
0.00 +21.2 21.22 ± 20% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sock_def_readable.unix_stream_sendmsg.sock_sendmsg
0.00 +28.8 28.83 ± 10% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sock_def_readable.unix_stream_sendmsg.sock_sendmsg.sock_write_iter
0.00 +29.6 29.63 ± 9% perf-profile.calltrace.cycles-pp.sock_def_readable.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write
5.71 ±153% +30.5 36.18 ± 3% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
5.71 ±153% +31.5 37.18 ± 3% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
5.71 ±153% +32.7 38.42 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
0.00 +32.8 32.80 ± 4% perf-profile.calltrace.cycles-pp.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read.vfs_read
5.71 ±153% +32.9 38.64 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
0.00 +33.1 33.11 ± 4% perf-profile.calltrace.cycles-pp.unix_stream_recvmsg.sock_read_iter.new_sync_read.vfs_read.ksys_read
1.02 ±144% +33.9 34.90 ± 3% perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +34.5 34.47 ± 4% perf-profile.calltrace.cycles-pp.sock_read_iter.new_sync_read.vfs_read.ksys_read.do_syscall_64
5.71 ±153% +34.7 40.45 ± 2% perf-profile.calltrace.cycles-pp.read
3.61 ± 80% +44.6 48.16 ± 2% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +45.6 45.63 ± 2% perf-profile.calltrace.cycles-pp.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write.vfs_write
3.61 ± 80% +46.2 49.86 ± 2% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
0.00 +46.4 46.45 ± 2% perf-profile.calltrace.cycles-pp.sock_sendmsg.sock_write_iter.new_sync_write.vfs_write.ksys_write
0.00 +47.1 47.11 ± 2% perf-profile.calltrace.cycles-pp.sock_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
3.61 ± 80% +48.4 52.04 ± 3% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
3.61 ± 80% +51.6 55.17 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
3.61 ± 80% +51.8 55.43 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
3.61 ± 80% +53.2 56.77 perf-profile.calltrace.cycles-pp.write
34.13 ± 17% -33.6 0.51 ± 37% perf-profile.children.cycles-pp.do_idle
34.13 ± 17% -33.6 0.51 ± 37% perf-profile.children.cycles-pp.secondary_startup_64_no_verify
34.13 ± 17% -33.6 0.51 ± 37% perf-profile.children.cycles-pp.cpu_startup_entry
33.70 ± 16% -33.2 0.49 ± 37% perf-profile.children.cycles-pp.start_secondary
33.28 ± 16% -33.0 0.33 ± 38% perf-profile.children.cycles-pp.cpuidle_enter_state
33.28 ± 16% -32.9 0.33 ± 38% perf-profile.children.cycles-pp.cpuidle_enter
31.16 ± 13% -31.0 0.19 ± 36% perf-profile.children.cycles-pp.intel_idle
16.93 ± 42% -16.9 0.00 perf-profile.children.cycles-pp.do_group_exit
16.93 ± 42% -16.9 0.00 perf-profile.children.cycles-pp.do_exit
14.48 ± 62% -14.5 0.00 perf-profile.children.cycles-pp.mmput
14.48 ± 62% -14.5 0.00 perf-profile.children.cycles-pp.exit_mmap
12.61 ± 47% -12.6 0.00 perf-profile.children.cycles-pp.arch_do_signal_or_restart
12.61 ± 47% -12.6 0.00 perf-profile.children.cycles-pp.get_signal
12.58 ±116% -12.6 0.00 perf-profile.children.cycles-pp._dl_catch_error
14.84 ± 36% -11.0 3.87 ± 26% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
14.41 ± 36% -10.7 3.68 ± 27% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
8.25 ±115% -8.3 0.00 perf-profile.children.cycles-pp.do_mmap
8.25 ±115% -8.3 0.00 perf-profile.children.cycles-pp.mmap_region
8.25 ±115% -8.3 0.00 perf-profile.children.cycles-pp.vm_mmap_pgoff
7.28 ±119% -7.3 0.00 perf-profile.children.cycles-pp.asm_exc_page_fault
5.40 ± 83% -5.4 0.00 perf-profile.children.cycles-pp.ksys_mmap_pgoff
4.97 ± 97% -5.0 0.00 perf-profile.children.cycles-pp.tlb_finish_mmu
4.97 ± 97% -5.0 0.00 perf-profile.children.cycles-pp.tlb_flush_mmu
4.52 ±115% -4.5 0.00 perf-profile.children.cycles-pp.__get_cpu_features
4.38 ±118% -4.4 0.00 perf-profile.children.cycles-pp.release_pages
4.19 ±122% -4.2 0.00 perf-profile.children.cycles-pp.walk_component
0.00 +0.1 0.06 ± 19% perf-profile.children.cycles-pp.cgroup_rstat_updated
0.00 +0.1 0.06 ± 19% perf-profile.children.cycles-pp.is_ftrace_trampoline
0.00 +0.1 0.06 ± 11% perf-profile.children.cycles-pp.__cgroup_account_cputime
0.00 +0.1 0.07 ± 28% perf-profile.children.cycles-pp.rb_next
0.00 +0.1 0.07 ± 31% perf-profile.children.cycles-pp.perf_swevent_get_recursion_context
0.00 +0.1 0.07 ± 21% perf-profile.children.cycles-pp.iov_iter_init
0.00 +0.1 0.07 ± 18% perf-profile.children.cycles-pp.apparmor_socket_recvmsg
0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.put_pid
0.00 +0.1 0.07 ± 25% perf-profile.children.cycles-pp.__x2apic_send_IPI_dest
0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.resched_curr
0.00 +0.1 0.08 ± 18% perf-profile.children.cycles-pp.apparmor_file_permission
0.00 +0.1 0.08 ± 22% perf-profile.children.cycles-pp.cpumask_next
0.00 +0.1 0.08 ± 20% perf-profile.children.cycles-pp.get_stack_info_noinstr
0.00 +0.1 0.08 ± 17% perf-profile.children.cycles-pp.refill_stock
0.00 +0.1 0.09 ± 8% perf-profile.children.cycles-pp.maybe_add_creds
0.00 +0.1 0.09 ± 15% perf-profile.children.cycles-pp.__x64_sys_read
0.00 +0.1 0.09 ± 15% perf-profile.children.cycles-pp.__wrgsbase_inactive
0.00 +0.1 0.09 ± 21% perf-profile.children.cycles-pp.finish_wait
0.00 +0.1 0.09 ± 11% perf-profile.children.cycles-pp.__x64_sys_write
0.00 +0.1 0.10 ± 10% perf-profile.children.cycles-pp.start_thread
0.00 +0.1 0.10 ± 22% perf-profile.children.cycles-pp.__is_insn_slot_addr
0.00 +0.1 0.10 ± 23% perf-profile.children.cycles-pp.perf_instruction_pointer
0.00 +0.1 0.10 ± 13% perf-profile.children.cycles-pp.try_charge_memcg
0.00 +0.1 0.10 ± 12% perf-profile.children.cycles-pp.cpumask_next_wrap
0.00 +0.1 0.10 ± 16% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.00 +0.1 0.10 ± 32% perf-profile.children.cycles-pp.sysvec_reschedule_ipi
0.00 +0.1 0.11 ± 21% perf-profile.children.cycles-pp.__build_skb_around
0.00 +0.1 0.11 ± 20% perf-profile.children.cycles-pp._find_next_bit
0.00 +0.1 0.11 ± 11% perf-profile.children.cycles-pp.perf_misc_flags
0.00 +0.1 0.11 ± 11% perf-profile.children.cycles-pp.rb_insert_color
0.00 +0.1 0.11 ± 9% perf-profile.children.cycles-pp.get_mem_cgroup_from_objcg
0.00 +0.1 0.12 ± 10% perf-profile.children.cycles-pp.apparmor_socket_getpeersec_dgram
0.00 +0.1 0.12 ± 21% perf-profile.children.cycles-pp.kmalloc_slab
0.00 +0.1 0.12 ± 31% perf-profile.children.cycles-pp.in_gate_area_no_mm
0.00 +0.1 0.12 ± 31% perf-profile.children.cycles-pp.__unfreeze_partials
0.00 +0.1 0.13 ± 21% perf-profile.children.cycles-pp.propagate_protected_usage
0.00 +0.1 0.13 ± 16% perf-profile.children.cycles-pp.syscall_enter_from_user_mode
0.00 +0.1 0.14 ± 20% perf-profile.children.cycles-pp.mem_cgroup_from_task
0.00 +0.1 0.14 ± 21% perf-profile.children.cycles-pp.get_stack_info
0.00 +0.1 0.14 ± 20% perf-profile.children.cycles-pp.tracing_gen_ctx_irq_test
0.00 +0.1 0.14 ± 22% perf-profile.children.cycles-pp.set_next_buddy
0.00 +0.1 0.15 ± 29% perf-profile.children.cycles-pp.rb_erase
0.00 +0.2 0.15 ± 30% perf-profile.children.cycles-pp.get_partial_node
0.00 +0.2 0.15 ± 28% perf-profile.children.cycles-pp.get_callchain_entry
0.00 +0.2 0.16 ± 21% perf-profile.children.cycles-pp.pick_next_entity
0.00 +0.2 0.16 ± 17% perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack
0.00 +0.2 0.17 ± 16% perf-profile.children.cycles-pp.check_stack_object
0.00 +0.2 0.17 ± 24% perf-profile.children.cycles-pp.perf_trace_buf_alloc
0.00 +0.2 0.17 ± 51% perf-profile.children.cycles-pp.bpf_ksym_find
0.00 +0.2 0.18 ± 14% perf-profile.children.cycles-pp.refill_obj_stock
0.00 +0.2 0.18 ± 18% perf-profile.children.cycles-pp.__ksize
0.00 +0.2 0.18 ± 17% perf-profile.children.cycles-pp.___perf_sw_event
0.00 +0.2 0.20 ± 17% perf-profile.children.cycles-pp.kvm_guest_state
0.00 +0.2 0.21 ± 46% perf-profile.children.cycles-pp.is_bpf_text_address
0.00 +0.2 0.22 ± 8% perf-profile.children.cycles-pp.task_tick_fair
0.00 +0.2 0.22 ± 24% perf-profile.children.cycles-pp.put_prev_entity
0.00 +0.2 0.22 ± 26% perf-profile.children.cycles-pp.__calc_delta
0.00 +0.2 0.22 ± 30% perf-profile.children.cycles-pp.perf_tp_event_match
0.00 +0.2 0.23 ± 22% perf-profile.children.cycles-pp.perf_trace_buf_update
0.00 +0.2 0.24 ± 16% perf-profile.children.cycles-pp.update_min_vruntime
0.00 +0.2 0.24 ± 9% perf-profile.children.cycles-pp.security_socket_getpeersec_dgram
0.00 +0.2 0.24 ± 24% perf-profile.children.cycles-pp.save_fpregs_to_fpstate
0.00 +0.3 0.25 ± 72% perf-profile.children.cycles-pp.process_simple
0.00 +0.3 0.26 ± 18% perf-profile.children.cycles-pp.__switch_to
0.00 +0.3 0.26 ± 19% perf-profile.children.cycles-pp.update_cfs_group
0.00 +0.3 0.26 ± 6% perf-profile.children.cycles-pp.scheduler_tick
0.00 +0.3 0.27 ± 14% perf-profile.children.cycles-pp.rcu_all_qs
0.00 +0.3 0.27 ± 14% perf-profile.children.cycles-pp.perf_trace_sched_migrate_task
0.00 +0.3 0.28 ± 71% perf-profile.children.cycles-pp.record__finish_output
0.00 +0.3 0.28 ± 71% perf-profile.children.cycles-pp.perf_session__process_events
0.00 +0.3 0.29 ± 69% perf-profile.children.cycles-pp.__libc_start_main
0.00 +0.3 0.29 ± 69% perf-profile.children.cycles-pp.main
0.00 +0.3 0.29 ± 69% perf-profile.children.cycles-pp.run_builtin
0.00 +0.3 0.29 ± 69% perf-profile.children.cycles-pp.cmd_record
0.00 +0.3 0.29 ± 69% perf-profile.children.cycles-pp.cmd_sched
0.00 +0.3 0.29 ± 5% perf-profile.children.cycles-pp.update_process_times
0.00 +0.3 0.30 ± 6% perf-profile.children.cycles-pp.tick_sched_handle
0.00 +0.3 0.30 ± 14% perf-profile.children.cycles-pp.finish_task_switch
0.00 +0.3 0.31 ± 6% perf-profile.children.cycles-pp.tick_sched_timer
0.00 +0.3 0.31 ± 12% perf-profile.children.cycles-pp.set_task_cpu
0.00 +0.3 0.32 ± 22% perf-profile.children.cycles-pp.cpuacct_charge
0.00 +0.3 0.32 ± 10% perf-profile.children.cycles-pp.preempt_schedule_common
0.00 +0.3 0.33 ± 21% perf-profile.children.cycles-pp.native_sched_clock
0.00 +0.3 0.34 ± 15% perf-profile.children.cycles-pp.available_idle_cpu
0.00 +0.3 0.34 ± 18% perf-profile.children.cycles-pp.aa_file_perm
0.00 +0.3 0.35 ± 26% perf-profile.children.cycles-pp.__task_pid_nr_ns
0.00 +0.4 0.35 ± 20% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.00 +0.4 0.36 ± 5% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.00 +0.4 0.37 ± 24% perf-profile.children.cycles-pp.asm_sysvec_reschedule_ipi
0.00 +0.4 0.37 ± 21% perf-profile.children.cycles-pp.sched_clock_cpu
0.00 +0.4 0.38 ± 23% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
0.00 +0.4 0.39 ± 16% perf-profile.children.cycles-pp.wait_for_unix_gc
0.00 +0.4 0.41 ± 25% perf-profile.children.cycles-pp.perf_event_pid_type
0.00 +0.4 0.41 ± 23% perf-profile.children.cycles-pp.__update_load_avg_se
0.00 +0.4 0.42 ± 16% perf-profile.children.cycles-pp.__might_fault
0.00 +0.4 0.43 ± 15% perf-profile.children.cycles-pp.__switch_to_asm
0.00 +0.4 0.43 ± 5% perf-profile.children.cycles-pp.hrtimer_interrupt
0.00 +0.4 0.44 ± 28% perf-profile.children.cycles-pp.__enqueue_entity
0.00 +0.4 0.44 ± 20% perf-profile.children.cycles-pp.restore_fpregs_from_fpstate
0.00 +0.4 0.45 ± 16% perf-profile.children.cycles-pp.__pthread_enable_asynccancel
0.00 +0.5 0.45 ± 12% perf-profile.children.cycles-pp.skb_unlink
0.00 +0.5 0.46 ± 29% perf-profile.children.cycles-pp.perf_output_begin_forward
0.00 +0.5 0.48 ± 23% perf-profile.children.cycles-pp.ftrace_graph_ret_addr
0.00 +0.5 0.49 ± 26% perf-profile.children.cycles-pp.__get_user_nocheck_8
0.00 +0.5 0.49 ± 18% perf-profile.children.cycles-pp.update_rq_clock
0.00 +0.5 0.49 ± 18% perf-profile.children.cycles-pp.check_preempt_wakeup
0.00 +0.5 0.52 ± 11% perf-profile.children.cycles-pp.__virt_addr_valid
0.00 +0.5 0.53 ± 13% perf-profile.children.cycles-pp.__might_sleep
0.00 +0.5 0.54 ± 24% perf-profile.children.cycles-pp.set_next_entity
0.00 +0.5 0.54 ± 18% perf-profile.children.cycles-pp.page_counter_cancel
0.00 +0.6 0.56 ± 20% perf-profile.children.cycles-pp.page_counter_charge
0.00 +0.6 0.60 ± 18% perf-profile.children.cycles-pp.switch_fpu_return
0.00 +0.6 0.60 ± 16% perf-profile.children.cycles-pp.check_preempt_curr
0.00 +0.6 0.60 ± 22% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.00 +0.6 0.61 ± 23% perf-profile.children.cycles-pp.reweight_entity
0.00 +0.6 0.62 ± 12% perf-profile.children.cycles-pp.__pthread_disable_asynccancel
0.00 +0.6 0.62 ± 18% perf-profile.children.cycles-pp.page_counter_uncharge
0.00 +0.6 0.64 ± 17% perf-profile.children.cycles-pp.ttwu_do_wakeup
0.00 +0.6 0.64 ± 17% perf-profile.children.cycles-pp.select_idle_cpu
0.00 +0.7 0.65 ± 12% perf-profile.children.cycles-pp.security_socket_sendmsg
0.00 +0.7 0.66 ± 37% perf-profile.children.cycles-pp.memcpy_erms
0.00 +0.7 0.68 ± 26% perf-profile.children.cycles-pp.core_kernel_text
0.00 +0.7 0.68 ± 23% perf-profile.children.cycles-pp.___slab_alloc
0.00 +0.7 0.71 ± 8% perf-profile.children.cycles-pp.mutex_lock
0.00 +0.7 0.73 ± 37% perf-profile.children.cycles-pp.perf_output_copy
0.00 +0.7 0.74 ± 26% perf-profile.children.cycles-pp.__perf_event_header__init_id
0.00 +0.7 0.74 ± 23% perf-profile.children.cycles-pp.__slab_alloc
0.00 +0.7 0.75 ± 17% perf-profile.children.cycles-pp.obj_cgroup_charge_pages
0.00 +0.7 0.75 ± 17% perf-profile.children.cycles-pp.obj_cgroup_uncharge_pages
0.00 +0.7 0.75 ± 26% perf-profile.children.cycles-pp.perf_callchain_user
0.00 +0.8 0.76 ± 13% perf-profile.children.cycles-pp.security_socket_recvmsg
0.00 +0.8 0.80 ± 27% perf-profile.children.cycles-pp.unix_write_space
0.00 +0.8 0.82 ± 8% perf-profile.children.cycles-pp.prepare_to_wait
0.00 +0.8 0.84 ± 19% perf-profile.children.cycles-pp.skb_queue_tail
0.00 +0.8 0.85 ± 13% perf-profile.children.cycles-pp.sock_recvmsg
0.00 +0.9 0.86 ± 19% perf-profile.children.cycles-pp.skb_set_owner_w
0.00 +1.0 0.96 ± 13% perf-profile.children.cycles-pp.get_obj_cgroup_from_current
0.00 +1.0 1.00 ± 19% perf-profile.children.cycles-pp.obj_cgroup_charge
0.00 +1.1 1.07 ± 37% perf-profile.children.cycles-pp.perf_output_sample
0.00 +1.1 1.07 ± 20% perf-profile.children.cycles-pp.mod_objcg_state
0.00 +1.1 1.07 ± 17% perf-profile.children.cycles-pp.select_idle_sibling
0.00 +1.1 1.08 ± 14% perf-profile.children.cycles-pp.common_file_perm
0.00 +1.1 1.15 ± 12% perf-profile.children.cycles-pp.aa_sk_perm
0.00 +1.2 1.19 ± 13% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.00 +1.2 1.22 ± 17% perf-profile.children.cycles-pp.update_load_avg
0.00 +1.3 1.30 ± 17% perf-profile.children.cycles-pp._copy_from_iter
0.00 +1.3 1.30 ± 13% perf-profile.children.cycles-pp.select_task_rq_fair
0.00 +1.3 1.31 ± 14% perf-profile.children.cycles-pp.security_file_permission
0.00 +1.4 1.38 ± 22% perf-profile.children.cycles-pp.pick_next_task_fair
0.00 +1.5 1.46 ± 14% perf-profile.children.cycles-pp.simple_copy_to_iter
0.00 +1.5 1.51 ± 26% perf-profile.children.cycles-pp.stack_access_ok
0.00 +1.7 1.68 ± 28% perf-profile.children.cycles-pp.kernel_text_address
0.00 +1.7 1.69 ± 20% perf-profile.children.cycles-pp.sock_wfree
0.00 +1.7 1.74 ± 20% perf-profile.children.cycles-pp.copyout
0.00 +1.8 1.85 ± 20% perf-profile.children.cycles-pp.unix_destruct_scm
0.00 +1.9 1.89 ± 20% perf-profile.children.cycles-pp.skb_release_head_state
0.00 +1.9 1.91 ± 20% perf-profile.children.cycles-pp.skb_release_all
0.00 +2.0 2.04 ± 27% perf-profile.children.cycles-pp.__kernel_text_address
0.00 +2.1 2.12 ± 13% perf-profile.children.cycles-pp.__slab_free
0.00 +2.2 2.19 ± 18% perf-profile.children.cycles-pp._copy_to_iter
0.00 +2.2 2.24 ± 15% perf-profile.children.cycles-pp.__fget_light
0.00 +2.3 2.30 ± 17% perf-profile.children.cycles-pp.skb_copy_datagram_from_iter
0.00 +2.3 2.31 ± 15% perf-profile.children.cycles-pp.__fdget_pos
0.00 +2.4 2.35 ± 24% perf-profile.children.cycles-pp.orc_find
0.00 +2.5 2.50 ± 27% perf-profile.children.cycles-pp.unwind_get_return_address
0.00 +2.8 2.82 ± 17% perf-profile.children.cycles-pp.kmem_cache_alloc_node
0.00 +3.2 3.20 ± 15% perf-profile.children.cycles-pp.skb_release_data
0.00 +3.3 3.26 ± 15% perf-profile.children.cycles-pp.__kmalloc_node_track_caller
0.00 +3.4 3.35 ± 15% perf-profile.children.cycles-pp.kmalloc_reserve
0.00 +3.7 3.70 ± 23% perf-profile.children.cycles-pp.__orc_find
0.00 +3.8 3.76 ± 16% perf-profile.children.cycles-pp.__skb_datagram_iter
0.00 +3.8 3.80 ± 16% perf-profile.children.cycles-pp.skb_copy_datagram_iter
0.00 +3.8 3.83 ± 16% perf-profile.children.cycles-pp.unix_stream_read_actor
0.00 +5.4 5.38 ± 17% perf-profile.children.cycles-pp.consume_skb
0.00 +5.9 5.91 ± 20% perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
0.43 ±223% +6.4 6.86 ± 24% perf-profile.children.cycles-pp.perf_trace_sched_switch
0.00 +6.6 6.61 ± 20% perf-profile.children.cycles-pp.dequeue_entity
0.00 +7.2 7.24 ± 16% perf-profile.children.cycles-pp.__alloc_skb
0.00 +7.4 7.36 ± 16% perf-profile.children.cycles-pp.alloc_skb_with_frags
0.00 +7.4 7.39 ± 24% perf-profile.children.cycles-pp.__unwind_start
0.00 +7.4 7.40 ± 21% perf-profile.children.cycles-pp.enqueue_entity
0.00 +7.5 7.53 ± 20% perf-profile.children.cycles-pp.dequeue_task_fair
0.43 ±223% +8.0 8.41 ± 13% perf-profile.children.cycles-pp._raw_spin_lock
0.00 +8.3 8.31 ± 20% perf-profile.children.cycles-pp.enqueue_task_fair
0.00 +8.4 8.36 ± 20% perf-profile.children.cycles-pp.ttwu_do_activate
0.00 +9.2 9.21 ± 17% perf-profile.children.cycles-pp.sock_alloc_send_pskb
0.00 +9.2 9.22 ± 27% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.00 +11.8 11.81 ± 22% perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime
0.00 +13.2 13.17 ± 21% perf-profile.children.cycles-pp.update_curr
0.00 +13.5 13.47 ± 10% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.43 ±223% +13.9 14.30 ± 24% perf-profile.children.cycles-pp.unwind_next_frame
0.00 +16.8 16.80 ± 21% perf-profile.children.cycles-pp.schedule_timeout
0.43 ±223% +18.3 18.72 ± 24% perf-profile.children.cycles-pp.perf_callchain_kernel
0.86 ±223% +19.0 19.87 ± 22% perf-profile.children.cycles-pp.__schedule
0.43 ±223% +19.5 19.91 ± 24% perf-profile.children.cycles-pp.get_perf_callchain
0.00 +19.5 19.55 ± 22% perf-profile.children.cycles-pp.schedule
0.43 ±223% +19.6 20.04 ± 24% perf-profile.children.cycles-pp.perf_callchain
0.43 ±223% +20.9 21.29 ± 24% perf-profile.children.cycles-pp.perf_prepare_sample
0.48 ±223% +21.3 21.75 ± 19% perf-profile.children.cycles-pp.__wake_up_common
0.00 +21.4 21.38 ± 19% perf-profile.children.cycles-pp.try_to_wake_up
0.00 +21.5 21.54 ± 19% perf-profile.children.cycles-pp.autoremove_wake_function
0.43 ±223% +22.6 23.01 ± 22% perf-profile.children.cycles-pp.perf_event_output_forward
0.43 ±223% +22.7 23.13 ± 22% perf-profile.children.cycles-pp.__perf_event_overflow
0.43 ±223% +22.8 23.18 ± 22% perf-profile.children.cycles-pp.perf_swevent_overflow
0.43 ±223% +23.6 24.06 ± 22% perf-profile.children.cycles-pp.perf_tp_event
0.48 ±223% +28.9 29.38 ± 9% perf-profile.children.cycles-pp.__wake_up_common_lock
0.00 +29.6 29.64 ± 9% perf-profile.children.cycles-pp.sock_def_readable
5.71 ±153% +30.5 36.21 ± 3% perf-profile.children.cycles-pp.vfs_read
5.71 ±153% +31.5 37.22 ± 3% perf-profile.children.cycles-pp.ksys_read
0.00 +32.9 32.85 ± 4% perf-profile.children.cycles-pp.unix_stream_read_generic
0.00 +33.1 33.12 ± 4% perf-profile.children.cycles-pp.unix_stream_recvmsg
1.02 ±144% +33.9 34.93 ± 3% perf-profile.children.cycles-pp.new_sync_read
0.00 +34.5 34.48 ± 4% perf-profile.children.cycles-pp.sock_read_iter
5.71 ±153% +35.1 40.85 ± 2% perf-profile.children.cycles-pp.read
3.61 ± 80% +44.6 48.20 ± 2% perf-profile.children.cycles-pp.new_sync_write
0.00 +45.7 45.70 ± 2% perf-profile.children.cycles-pp.unix_stream_sendmsg
47.86 ± 25% +45.9 93.73 perf-profile.children.cycles-pp.do_syscall_64
3.61 ± 80% +46.3 49.90 ± 2% perf-profile.children.cycles-pp.vfs_write
47.86 ± 25% +46.3 94.19 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
0.00 +46.5 46.49 ± 2% perf-profile.children.cycles-pp.sock_sendmsg
0.00 +47.1 47.12 ± 2% perf-profile.children.cycles-pp.sock_write_iter
3.61 ± 80% +48.5 52.08 ± 3% perf-profile.children.cycles-pp.ksys_write
3.61 ± 80% +53.6 57.18 perf-profile.children.cycles-pp.write
31.16 ± 13% -31.0 0.19 ± 36% perf-profile.self.cycles-pp.intel_idle
0.00 +0.1 0.06 ± 16% perf-profile.self.cycles-pp.cpumask_next_wrap
0.00 +0.1 0.06 ± 14% perf-profile.self.cycles-pp.autoremove_wake_function
0.00 +0.1 0.06 ± 17% perf-profile.self.cycles-pp.apparmor_socket_recvmsg
0.00 +0.1 0.07 ± 16% perf-profile.self.cycles-pp.skb_unlink
0.00 +0.1 0.07 ± 23% perf-profile.self.cycles-pp.rb_next
0.00 +0.1 0.07 ± 11% perf-profile.self.cycles-pp.try_charge_memcg
0.00 +0.1 0.07 ± 23% perf-profile.self.cycles-pp.get_stack_info
0.00 +0.1 0.07 ± 25% perf-profile.self.cycles-pp.__x2apic_send_IPI_dest
0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.resched_curr
0.00 +0.1 0.08 ± 12% perf-profile.self.cycles-pp.__list_add_valid
0.00 +0.1 0.08 ± 27% perf-profile.self.cycles-pp.__perf_event_overflow
0.00 +0.1 0.08 ± 31% perf-profile.self.cycles-pp.perf_trace_buf_update
0.00 +0.1 0.08 ± 9% perf-profile.self.cycles-pp.maybe_add_creds
0.00 +0.1 0.08 ± 14% perf-profile.self.cycles-pp.__x64_sys_read
0.00 +0.1 0.08 ± 11% perf-profile.self.cycles-pp.__x64_sys_write
0.00 +0.1 0.09 ± 21% perf-profile.self.cycles-pp.__fdget_pos
0.00 +0.1 0.09 ± 17% perf-profile.self.cycles-pp.kmalloc_reserve
0.00 +0.1 0.09 ± 18% perf-profile.self.cycles-pp.switch_mm_irqs_off
0.00 +0.1 0.09 ± 28% perf-profile.self.cycles-pp.__is_insn_slot_addr
0.00 +0.1 0.09 ± 15% perf-profile.self.cycles-pp.__wrgsbase_inactive
0.00 +0.1 0.09 ± 20% perf-profile.self.cycles-pp.skb_release_data
0.00 +0.1 0.09 ± 17% perf-profile.self.cycles-pp.sock_recvmsg
0.00 +0.1 0.10 ± 22% perf-profile.self.cycles-pp.perf_trace_buf_alloc
0.00 +0.1 0.10 ± 22% perf-profile.self.cycles-pp._find_next_bit
0.00 +0.1 0.10 ± 20% perf-profile.self.cycles-pp.set_next_entity
0.00 +0.1 0.10 ± 11% perf-profile.self.cycles-pp.__skb_datagram_iter
0.00 +0.1 0.10 ± 34% perf-profile.self.cycles-pp.in_gate_area_no_mm
0.00 +0.1 0.10 ± 7% perf-profile.self.cycles-pp.apparmor_socket_getpeersec_dgram
0.00 +0.1 0.10 ± 18% perf-profile.self.cycles-pp.check_preempt_curr
0.00 +0.1 0.10 ± 21% perf-profile.self.cycles-pp.__build_skb_around
0.00 +0.1 0.11 ± 17% perf-profile.self.cycles-pp.security_socket_recvmsg
0.00 +0.1 0.11 ± 17% perf-profile.self.cycles-pp.kmalloc_slab
0.00 +0.1 0.11 ± 8% perf-profile.self.cycles-pp.get_mem_cgroup_from_objcg
0.00 +0.1 0.11 ± 16% perf-profile.self.cycles-pp.wait_for_unix_gc
0.00 +0.1 0.11 ± 18% perf-profile.self.cycles-pp.__wake_up_common_lock
0.00 +0.1 0.11 ± 17% perf-profile.self.cycles-pp.schedule
0.00 +0.1 0.11 ± 11% perf-profile.self.cycles-pp.rb_insert_color
0.00 +0.1 0.12 ± 10% perf-profile.self.cycles-pp.alloc_skb_with_frags
0.00 +0.1 0.12 ± 14% perf-profile.self.cycles-pp.finish_task_switch
0.00 +0.1 0.12 ± 11% perf-profile.self.cycles-pp.syscall_exit_to_user_mode
0.00 +0.1 0.12 ± 19% perf-profile.self.cycles-pp.pick_next_entity
0.00 +0.1 0.12 ± 17% perf-profile.self.cycles-pp.perf_event_output_forward
0.00 +0.1 0.12 ± 17% perf-profile.self.cycles-pp.syscall_enter_from_user_mode
0.00 +0.1 0.12 ± 23% perf-profile.self.cycles-pp.perf_callchain
0.00 +0.1 0.12 ± 14% perf-profile.self.cycles-pp.perf_trace_sched_wakeup_template
0.00 +0.1 0.12 ± 10% perf-profile.self.cycles-pp.security_socket_getpeersec_dgram
0.00 +0.1 0.12 ± 21% perf-profile.self.cycles-pp.mem_cgroup_from_task
0.00 +0.1 0.13 ± 24% perf-profile.self.cycles-pp.propagate_protected_usage
0.00 +0.1 0.13 ± 26% perf-profile.self.cycles-pp.__perf_event_header__init_id
0.00 +0.1 0.13 ± 14% perf-profile.self.cycles-pp.skb_copy_datagram_from_iter
0.00 +0.1 0.13 ± 14% perf-profile.self.cycles-pp.ksys_read
0.00 +0.1 0.13 ± 19% perf-profile.self.cycles-pp.dequeue_entity
0.00 +0.1 0.14 ± 19% perf-profile.self.cycles-pp.set_next_buddy
0.00 +0.1 0.14 ± 22% perf-profile.self.cycles-pp.unix_destruct_scm
0.00 +0.1 0.14 ± 20% perf-profile.self.cycles-pp.schedule_timeout
0.00 +0.1 0.14 ± 27% perf-profile.self.cycles-pp.rb_erase
0.00 +0.1 0.14 ± 18% perf-profile.self.cycles-pp.check_stack_object
0.00 +0.1 0.14 ± 20% perf-profile.self.cycles-pp.tracing_gen_ctx_irq_test
0.00 +0.1 0.15 ± 29% perf-profile.self.cycles-pp.get_callchain_entry
0.00 +0.2 0.15 ± 16% perf-profile.self.cycles-pp.ksys_write
0.00 +0.2 0.15 ± 14% perf-profile.self.cycles-pp.switch_fpu_return
0.00 +0.2 0.16 ± 16% perf-profile.self.cycles-pp.___perf_sw_event
0.00 +0.2 0.16 ± 18% perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack
0.00 +0.2 0.16 ± 9% perf-profile.self.cycles-pp.sock_sendmsg
0.00 +0.2 0.17 ± 5% perf-profile.self.cycles-pp.select_task_rq_fair
0.00 +0.2 0.17 ± 16% perf-profile.self.cycles-pp.security_file_permission
0.00 +0.2 0.17 ± 51% perf-profile.self.cycles-pp.bpf_ksym_find
0.00 +0.2 0.17 ± 12% perf-profile.self.cycles-pp.prepare_to_wait
0.00 +0.2 0.18 ± 17% perf-profile.self.cycles-pp.__ksize
0.00 +0.2 0.18 ± 14% perf-profile.self.cycles-pp.refill_obj_stock
0.00 +0.2 0.18 ± 22% perf-profile.self.cycles-pp.dequeue_task_fair
0.00 +0.2 0.19 ± 18% perf-profile.self.cycles-pp.kvm_guest_state
0.00 +0.2 0.20 ± 35% perf-profile.self.cycles-pp.perf_output_sample
0.00 +0.2 0.20 ± 25% perf-profile.self.cycles-pp.perf_trace_sched_switch
0.00 +0.2 0.20 ± 27% perf-profile.self.cycles-pp.perf_callchain_user
0.00 +0.2 0.21 ± 16% perf-profile.self.cycles-pp.sock_alloc_send_pskb
0.00 +0.2 0.21 ± 7% perf-profile.self.cycles-pp.do_syscall_64
0.00 +0.2 0.21 ± 37% perf-profile.self.cycles-pp.perf_output_copy
0.00 +0.2 0.22 ± 14% perf-profile.self.cycles-pp.rcu_all_qs
0.00 +0.2 0.22 ± 12% perf-profile.self.cycles-pp.check_preempt_wakeup
0.00 +0.2 0.22 ± 11% perf-profile.self.cycles-pp.enqueue_task_fair
0.00 +0.2 0.22 ± 24% perf-profile.self.cycles-pp.__calc_delta
0.00 +0.2 0.22 ± 30% perf-profile.self.cycles-pp.perf_tp_event_match
0.00 +0.2 0.23 ± 17% perf-profile.self.cycles-pp.update_min_vruntime
0.00 +0.2 0.23 ± 23% perf-profile.self.cycles-pp.perf_trace_sched_stat_runtime
0.00 +0.2 0.23 ± 25% perf-profile.self.cycles-pp.obj_cgroup_charge
0.00 +0.2 0.24 ± 18% perf-profile.self.cycles-pp.select_idle_sibling
0.00 +0.2 0.24 ± 25% perf-profile.self.cycles-pp.save_fpregs_to_fpstate
0.00 +0.2 0.24 ± 22% perf-profile.self.cycles-pp.reweight_entity
0.00 +0.2 0.25 ± 18% perf-profile.self.cycles-pp.__switch_to
0.00 +0.3 0.26 ± 17% perf-profile.self.cycles-pp.consume_skb
0.00 +0.3 0.26 ± 19% perf-profile.self.cycles-pp.update_cfs_group
0.00 +0.3 0.26 ± 20% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.00 +0.3 0.26 ± 14% perf-profile.self.cycles-pp.enqueue_entity
0.00 +0.3 0.27 ± 8% perf-profile.self.cycles-pp.unix_stream_recvmsg
0.00 +0.3 0.27 ± 21% perf-profile.self.cycles-pp.select_idle_cpu
0.00 +0.3 0.28 ± 10% perf-profile.self.cycles-pp.unix_write_space
0.00 +0.3 0.28 ± 13% perf-profile.self.cycles-pp._copy_to_iter
0.00 +0.3 0.29 ± 23% perf-profile.self.cycles-pp.get_perf_callchain
0.00 +0.3 0.30 ± 17% perf-profile.self.cycles-pp.pick_next_task_fair
0.00 +0.3 0.30 ± 15% perf-profile.self.cycles-pp._copy_from_iter
0.00 +0.3 0.31 ± 23% perf-profile.self.cycles-pp.cpuacct_charge
0.00 +0.3 0.32 ± 21% perf-profile.self.cycles-pp.native_sched_clock
0.00 +0.3 0.32 ± 17% perf-profile.self.cycles-pp.aa_file_perm
0.00 +0.3 0.32 ± 32% perf-profile.self.cycles-pp.perf_prepare_sample
0.00 +0.3 0.33 ± 24% perf-profile.self.cycles-pp.__kernel_text_address
0.00 +0.3 0.33 ± 15% perf-profile.self.cycles-pp.available_idle_cpu
0.00 +0.3 0.34 ± 21% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.00 +0.3 0.34 ± 24% perf-profile.self.cycles-pp.__mod_memcg_lruvec_state
0.00 +0.3 0.35 ± 25% perf-profile.self.cycles-pp.__task_pid_nr_ns
0.00 +0.4 0.36 ± 18% perf-profile.self.cycles-pp.update_rq_clock
0.00 +0.4 0.39 ± 24% perf-profile.self.cycles-pp.core_kernel_text
0.00 +0.4 0.39 ± 25% perf-profile.self.cycles-pp.ftrace_graph_ret_addr
0.00 +0.4 0.39 ± 7% perf-profile.self.cycles-pp.mutex_lock
0.00 +0.4 0.41 ± 23% perf-profile.self.cycles-pp.__update_load_avg_se
0.00 +0.4 0.41 ± 6% perf-profile.self.cycles-pp.new_sync_read
0.00 +0.4 0.42 ± 22% perf-profile.self.cycles-pp.perf_tp_event
0.00 +0.4 0.43 ± 15% perf-profile.self.cycles-pp.__switch_to_asm
0.00 +0.4 0.43 ± 28% perf-profile.self.cycles-pp.__enqueue_entity
0.00 +0.4 0.44 ± 16% perf-profile.self.cycles-pp.__pthread_enable_asynccancel
0.00 +0.4 0.44 ± 20% perf-profile.self.cycles-pp.restore_fpregs_from_fpstate
0.00 +0.4 0.44 ± 27% perf-profile.self.cycles-pp.perf_output_begin_forward
0.00 +0.5 0.46 ± 9% perf-profile.self.cycles-pp.update_load_avg
0.00 +0.5 0.46 ± 10% perf-profile.self.cycles-pp.try_to_wake_up
0.00 +0.5 0.46 ± 26% perf-profile.self.cycles-pp.unwind_get_return_address
0.00 +0.5 0.46 ± 13% perf-profile.self.cycles-pp.__might_sleep
0.00 +0.5 0.47 ± 10% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.00 +0.5 0.48 ± 27% perf-profile.self.cycles-pp.__get_user_nocheck_8
0.00 +0.5 0.49 ± 13% perf-profile.self.cycles-pp.new_sync_write
0.00 +0.5 0.49 ± 19% perf-profile.self.cycles-pp.page_counter_charge
0.00 +0.5 0.50 ± 11% perf-profile.self.cycles-pp.__virt_addr_valid
0.00 +0.5 0.51 ± 14% perf-profile.self.cycles-pp.sock_read_iter
0.00 +0.5 0.52 ± 23% perf-profile.self.cycles-pp.___slab_alloc
0.00 +0.5 0.54 ± 18% perf-profile.self.cycles-pp.page_counter_cancel
0.00 +0.5 0.54 perf-profile.self.cycles-pp.vfs_read
0.00 +0.6 0.55 ± 17% perf-profile.self.cycles-pp.update_curr
0.00 +0.6 0.55 ± 18% perf-profile.self.cycles-pp.aa_sk_perm
0.00 +0.6 0.58 ± 13% perf-profile.self.cycles-pp.write
0.00 +0.6 0.59 ± 13% perf-profile.self.cycles-pp.read
0.00 +0.6 0.60 ± 12% perf-profile.self.cycles-pp.__pthread_disable_asynccancel
0.00 +0.6 0.63 ± 9% perf-profile.self.cycles-pp.sock_write_iter
0.00 +0.6 0.63 ± 25% perf-profile.self.cycles-pp.__unwind_start
0.00 +0.6 0.65 ± 36% perf-profile.self.cycles-pp.memcpy_erms
0.00 +0.7 0.69 ± 18% perf-profile.self.cycles-pp.mod_objcg_state
0.00 +0.7 0.70 ± 25% perf-profile.self.cycles-pp.kernel_text_address
0.00 +0.7 0.74 ± 14% perf-profile.self.cycles-pp.common_file_perm
0.00 +0.8 0.77 ± 16% perf-profile.self.cycles-pp.sock_def_readable
0.00 +0.8 0.78 ± 16% perf-profile.self.cycles-pp.__alloc_skb
0.00 +0.8 0.79 ± 14% perf-profile.self.cycles-pp.get_obj_cgroup_from_current
0.00 +0.8 0.82 ± 18% perf-profile.self.cycles-pp.__schedule
0.00 +0.9 0.85 ± 19% perf-profile.self.cycles-pp.skb_set_owner_w
0.00 +0.9 0.87 ± 16% perf-profile.self.cycles-pp.__check_object_size
0.00 +0.9 0.88 ± 15% perf-profile.self.cycles-pp.sock_wfree
0.00 +1.0 0.97 ± 17% perf-profile.self.cycles-pp.kmem_cache_alloc_node
0.00 +1.0 1.03 ± 15% perf-profile.self.cycles-pp.vfs_write
0.00 +1.2 1.16 ± 13% perf-profile.self.cycles-pp.__kmalloc_node_track_caller
0.00 +1.2 1.18 ± 13% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.00 +1.3 1.28 ± 26% perf-profile.self.cycles-pp.stack_access_ok
0.00 +1.4 1.37 ± 23% perf-profile.self.cycles-pp.perf_callchain_kernel
0.00 +1.4 1.38 ± 14% perf-profile.self.cycles-pp.unix_stream_sendmsg
0.00 +1.6 1.58 ± 12% perf-profile.self.cycles-pp.unix_stream_read_generic
0.00 +1.9 1.94 ± 8% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.00 +2.1 2.10 ± 13% perf-profile.self.cycles-pp.__slab_free
0.00 +2.2 2.19 ± 15% perf-profile.self.cycles-pp.__fget_light
0.00 +2.2 2.24 ± 24% perf-profile.self.cycles-pp.orc_find
0.00 +3.7 3.69 ± 23% perf-profile.self.cycles-pp.__orc_find
0.43 ±223% +6.1 6.55 ± 25% perf-profile.self.cycles-pp.unwind_next_frame
0.00 +13.4 13.45 ± 10% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
--
0-DAY CI Kernel Test Service
https://01.org/lkp
3 months
[lib] 66f83a960c: BUG:kernel_failed_in_early-boot_stage,last_printk:Decompressing_Linux
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 66f83a960c53a371d0cf4dda0e02005cd4d6ddda ("lib: zstd: Fix Wstringop-overflow warning")
https://git.kernel.org/cgit/linux/kernel/git/gustavoars/linux.git testing/kspp-stringop-overflow
in testcase: boot
on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 4G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-----------------------------------------------------------------------+------------+------------+
| | d3becb16bb | 66f83a960c |
+-----------------------------------------------------------------------+------------+------------+
| boot_successes | 50 | 0 |
| boot_failures | 0 | 10 |
| BUG:kernel_failed_in_early-boot_stage,last_printk:Decompressing_Linux | 0 | 10 |
+-----------------------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
output_len: 0x01674fcc
kernel_total_size: 0x01f1a000
needed_size: 0x01f1a000
Decompressing Linux... convert early boot stage from hang to failed
BUG: kernel failed in early-boot stage, last printk: Decompressing Linux...
Linux version 5.17.0-10758-g66f83a960c53 #1
Command line: ip=::::vm-snb-i386-70::dhcp root=/dev/ram0 RESULT_ROOT=/result/boot/1/vm-snb-i386/quantal-i386-core-20190426.cgz/i386-randconfig-a004-20220328/gcc-9/66f83a960c53a371d0cf4dda0e02005cd4d6ddda/3 BOOT_IMAGE=/pkg/linux/i386-randconfig-a004-20220328/gcc-9/66f83a960c53a371d0cf4dda0e02005cd4d6ddda/vmlinuz-5.17.0-10758-g66f83a960c53 branch=gustavoars/testing/kspp-stringop-overflow job=/lkp/jobs/scheduled/vm-snb-i386-70/boot-1-quantal-i386-core-20190426.cgz-66f83a960c53a371d0cf4dda0e02005cd4d6ddda-20220330-52737-16gsfnn-3.yaml user=lkp ARCH=i386 kconfig=i386-randconfig-a004-20220328 commit=66f83a960c53a371d0cf4dda0e02005cd4d6ddda vmalloc=128M initramfs_async=0 page_owner=on max_uptime=600 LKP_SERVER=internal-lkp-server selinux=0 debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 net.ifnames=0 printk.devkmsg=on panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 drbd.minor_count=8 systemd.log_level=err ignore_loglevel console=tty0 earlyprintk=ttyS0,115200 console=ttyS0,115200 vga=normal rw rcuperf.shutdown=0 watchdog_thresh=240
Kboot worker: lkp-worker34
Elapsed time: 480
To reproduce:
# build kernel
cd linux
cp config-5.17.0-10758-g66f83a960c53 .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
--
0-DAY CI Kernel Test Service
https://01.org/lkp
3 months