April 2022 - LKP - Ml01.01.Org

[net] 5aa32dd9bd: netperf.Throughput_tps -23.5% regression

by kernel test robot

Greeting, FYI, we noticed a -23.5% regression of netperf.Throughput_tps due to commit: commit: 5aa32dd9bdb57e4a26143216df5e90f5e5c3dd2c ("net: add support for fast socket release") https://github.com/ammarfaizi2/linux-block axboe/linux-block/sock-nolock.2 in testcase: netperf on test machine: 128 threads 2 sockets Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz with 128G memory with following parameters: ip: ipv4 runtime: 300s nr_threads: 50% cluster: cs-localhost test: SCTP_RR cpufreq_governor: performance ucode: 0xd000331 test-description: Netperf is a benchmark that can be use to measure various aspect of networking performance. test-url: http://www.netperf.org/netperf/ In addition to that, the commit also has significant impact on the following tests: +------------------+-------------------------------------------------------------------------------------+ | testcase: change | netperf: netperf.Throughput_Mbps -89.4% regression | | test machine | 128 threads 2 sockets Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz with 128G memory | | test parameters | cluster=cs-localhost | | | cpufreq_governor=performance | | | ip=ipv4 | | | nr_threads=1 | | | runtime=300s | | | send_size=10K | | | test=SCTP_STREAM_MANY | | | ucode=0xd000331 | +------------------+-------------------------------------------------------------------------------------+ | testcase: change | netperf: netperf.Throughput_Mbps -86.8% regression | | test machine | 128 threads 2 sockets Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz with 128G memory | | test parameters | cluster=cs-localhost | | | cpufreq_governor=performance | | | ip=ipv4 | | | nr_threads=25% | | | runtime=300s | | | send_size=10K | | | test=SCTP_STREAM_MANY | | | ucode=0xd000331 | +------------------+-------------------------------------------------------------------------------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. ========================================================================================= cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/tbox_group/test/testcase/ucode: cs-localhost/gcc-11/performance/ipv4/x86_64-rhel-8.3/50%/debian-10.4-x86_64-20200603.cgz/300s/lkp-icl-2sp4/SCTP_RR/netperf/0xd000331 commit: 4033d677de ("Merge branch 'for-5.19/io_uring-socket' into sock-nolock.2") 5aa32dd9bd ("net: add support for fast socket release") 4033d677de27560d 5aa32dd9bdb57e4a26143216df5 ---------------- --------------------------- %stddev %change %stddev \ | \ 3433333 -23.5% 2626482 ± 2% netperf.Throughput_total_tps 53645 -23.5% 41038 ± 2% netperf.Throughput_tps 26529 +220.7% 85082 ± 2% netperf.time.involuntary_context_switches 20836 +15.6% 24085 netperf.time.minor_page_faults 2728 -33.4% 1818 ± 3% netperf.time.percent_of_cpu_this_job_got 8062 -33.4% 5372 ± 3% netperf.time.system_time 261.11 -32.8% 175.44 ± 3% netperf.time.user_time 1.03e+09 -23.5% 7.879e+08 ± 2% netperf.time.voluntary_context_switches 1.03e+09 -23.5% 7.879e+08 ± 2% netperf.workload 18864 +42.3% 26841 uptime.idle 1.414e+10 +57.9% 2.232e+10 ± 2% cpuidle..time 2.069e+09 -22.2% 1.609e+09 ± 2% cpuidle..usage 36.85 +20.0 56.90 ± 2% mpstat.cpu.all.idle% 20.45 -6.6 13.85 ± 3% mpstat.cpu.all.soft% 40.36 -13.0 27.40 ± 3% mpstat.cpu.all.sys% 1.60 -0.4 1.19 ± 2% mpstat.cpu.all.usr% 37.00 +53.6% 56.83 ± 2% vmstat.cpu.id 10728248 +30.2% 13968645 vmstat.memory.cache 81.83 -33.8% 54.17 ± 3% vmstat.procs.r 13355055 -23.4% 10223620 ± 2% vmstat.system.cs 270894 -1.9% 265686 vmstat.system.in 2570 ± 20% +129.0% 5886 ± 37% numa-meminfo.node0.Active 2233 ± 13% +157.1% 5741 ± 38% numa-meminfo.node0.Active(anon) 357686 ± 23% +374.5% 1697374 ± 61% numa-meminfo.node0.Inactive 356300 ± 23% +376.3% 1697227 ± 61% numa-meminfo.node0.Inactive(anon) 55002 ±155% +2490.2% 1424655 ± 74% numa-meminfo.node0.Shmem 158899 ± 2% -60.1% 63469 ± 5% numa-meminfo.node1.Active 158875 ± 2% -60.2% 63227 ± 5% numa-meminfo.node1.Active(anon) 558.50 ± 13% +157.2% 1436 ± 38% numa-vmstat.node0.nr_active_anon 89148 ± 23% +376.9% 425139 ± 61% numa-vmstat.node0.nr_inactive_anon 13801 ±155% +2486.8% 357010 ± 74% numa-vmstat.node0.nr_shmem 558.50 ± 13% +157.2% 1436 ± 38% numa-vmstat.node0.nr_zone_active_anon 89148 ± 23% +376.9% 425139 ± 61% numa-vmstat.node0.nr_zone_inactive_anon 39849 ± 2% -60.2% 15855 ± 4% numa-vmstat.node1.nr_active_anon 39849 ± 2% -60.2% 15855 ± 4% numa-vmstat.node1.nr_zone_active_anon 161692 ± 2% -57.0% 69501 ± 3% meminfo.Active 161330 ± 3% -57.2% 69113 ± 3% meminfo.Active(anon) 10573214 +30.3% 13781428 meminfo.Cached 8859541 ± 2% +36.1% 12057551 ± 2% meminfo.Committed_AS 8504943 ± 2% +38.7% 11795316 ± 2% meminfo.Inactive 8503533 ± 2% +38.7% 11793931 ± 2% meminfo.Inactive(anon) 12718214 +25.2% 15927055 meminfo.Memused 8309280 ± 2% +38.6% 11517491 ± 2% meminfo.Shmem 12745350 +25.2% 15956173 meminfo.max_used_kB 2241 -30.4% 1560 ± 3% turbostat.Avg_MHz 69.91 -22.3 47.58 ± 3% turbostat.Busy% 3212 +2.3% 3287 turbostat.Bzy_MHz 1.321e+09 -13.0% 1.149e+09 turbostat.C1 20.90 -5.0 15.86 ± 2% turbostat.C1% 7.435e+08 -39.4% 4.508e+08 ± 4% turbostat.C1E 29.50 ± 2% +69.9% 50.11 ± 7% turbostat.CPU%c1 149.34 -102.7 46.64 ± 16% turbostat.PKG_% 4171491 -22.1% 3248601 ± 2% turbostat.POLL 0.12 -0.0 0.08 ± 5% turbostat.POLL% 493.52 -2.6% 480.46 turbostat.PkgWatt 46.41 +16.5% 54.05 turbostat.RAMWatt 40372 ± 3% -57.3% 17245 ± 3% proc-vmstat.nr_active_anon 88810 -2.6% 86525 proc-vmstat.nr_anon_pages 2954748 -2.7% 2874535 proc-vmstat.nr_dirty_background_threshold 5916722 -2.7% 5756100 proc-vmstat.nr_dirty_threshold 2637514 +30.4% 3440467 proc-vmstat.nr_file_pages 29744635 -2.7% 28941332 proc-vmstat.nr_free_pages 2119986 ± 2% +38.9% 2943612 ± 2% proc-vmstat.nr_inactive_anon 2071529 ± 2% +38.8% 2874482 ± 2% proc-vmstat.nr_shmem 33158 +5.3% 34918 proc-vmstat.nr_slab_reclaimable 40372 ± 3% -57.3% 17245 ± 3% proc-vmstat.nr_zone_active_anon 2119986 ± 2% +38.9% 2943612 ± 2% proc-vmstat.nr_zone_inactive_anon 6354131 ± 2% +33.8% 8498909 ± 2% proc-vmstat.numa_hit 6243316 ± 2% +34.4% 8388940 ± 2% proc-vmstat.numa_local 53928 ± 5% -65.7% 18516 ± 2% proc-vmstat.pgactivate 6302302 +32.4% 8344162 proc-vmstat.pgalloc_normal 75331 +6.8% 80462 proc-vmstat.pgreuse 485653 ± 6% -70.0% 145855 ± 16% sched_debug.cfs_rq:/.MIN_vruntime.avg 4889101 -58.2% 2043999 ± 11% sched_debug.cfs_rq:/.MIN_vruntime.max 1435112 ± 3% -65.2% 499003 ± 13% sched_debug.cfs_rq:/.MIN_vruntime.stddev 0.61 ± 2% -28.4% 0.43 ± 6% sched_debug.cfs_rq:/.h_nr_running.avg 1.58 ± 8% -36.8% 1.00 sched_debug.cfs_rq:/.h_nr_running.max 3.61 ± 9% -100.0% 0.00 sched_debug.cfs_rq:/.load_avg.min 485653 ± 6% -70.0% 145855 ± 16% sched_debug.cfs_rq:/.max_vruntime.avg 4889101 -58.2% 2043999 ± 11% sched_debug.cfs_rq:/.max_vruntime.max 1435112 ± 3% -65.2% 499003 ± 13% sched_debug.cfs_rq:/.max_vruntime.stddev 4779886 -60.8% 1875015 ± 11% sched_debug.cfs_rq:/.min_vruntime.avg 5195166 ± 2% -59.2% 2121407 ± 11% sched_debug.cfs_rq:/.min_vruntime.max 4718128 -65.7% 1617047 ± 11% sched_debug.cfs_rq:/.min_vruntime.min 54838 ± 17% +123.7% 122676 ± 9% sched_debug.cfs_rq:/.min_vruntime.stddev 0.59 ± 3% -27.2% 0.43 ± 5% sched_debug.cfs_rq:/.nr_running.avg 170.67 +130.0% 392.53 ± 38% sched_debug.cfs_rq:/.removed.load_avg.max 89.36 ± 4% +125.3% 201.32 ± 36% sched_debug.cfs_rq:/.removed.runnable_avg.max 89.36 ± 4% +125.3% 201.32 ± 36% sched_debug.cfs_rq:/.removed.util_avg.max 528.93 -27.5% 383.41 ± 4% sched_debug.cfs_rq:/.runnable_avg.avg 1181 ± 6% -19.5% 950.95 ± 3% sched_debug.cfs_rq:/.runnable_avg.max 142.14 ± 25% -100.0% 0.00 sched_debug.cfs_rq:/.runnable_avg.min 145.62 ± 5% +77.3% 258.24 ± 3% sched_debug.cfs_rq:/.runnable_avg.stddev 1064 ±1490% +22998.7% 245807 ± 23% sched_debug.cfs_rq:/.spread0.avg -60742 -80.1% -12113 sched_debug.cfs_rq:/.spread0.min 54851 ± 17% +123.6% 122647 ± 9% sched_debug.cfs_rq:/.spread0.stddev 527.04 -27.3% 382.97 ± 4% sched_debug.cfs_rq:/.util_avg.avg 1177 ± 7% -19.3% 949.82 ± 3% sched_debug.cfs_rq:/.util_avg.max 142.25 ± 25% -100.0% 0.00 sched_debug.cfs_rq:/.util_avg.min 145.27 ± 5% +77.5% 257.90 ± 3% sched_debug.cfs_rq:/.util_avg.stddev 317.21 ± 2% -29.5% 223.78 ± 6% sched_debug.cfs_rq:/.util_est_enqueued.avg 946.06 ± 10% -18.0% 775.41 ± 2% sched_debug.cfs_rq:/.util_est_enqueued.max 153421 +53.6% 235687 ± 4% sched_debug.cpu.avg_idle.avg 265800 ± 7% +301.8% 1068044 ± 8% sched_debug.cpu.avg_idle.max 3500 ± 5% -9.6% 3163 ± 3% sched_debug.cpu.avg_idle.min 34824 ± 6% +545.9% 224936 ± 8% sched_debug.cpu.avg_idle.stddev 185175 -13.3% 160515 ± 6% sched_debug.cpu.clock.avg 185182 -13.3% 160520 ± 6% sched_debug.cpu.clock.max 185168 -13.3% 160509 ± 6% sched_debug.cpu.clock.min 3.72 ± 4% -20.3% 2.96 ± 5% sched_debug.cpu.clock.stddev 571.80 ± 30% +126.1% 1292 ± 9% sched_debug.cpu.clock_task.stddev 3426 -34.1% 2256 ± 4% sched_debug.cpu.curr->pid.avg 0.59 ± 2% -33.4% 0.39 ± 5% sched_debug.cpu.nr_running.avg 1.56 ± 10% -33.6% 1.03 ± 7% sched_debug.cpu.nr_running.max 16149103 -36.7% 10228798 ± 9% sched_debug.cpu.nr_switches.avg 16701556 -30.4% 11624015 ± 8% sched_debug.cpu.nr_switches.max 14782067 ± 2% -43.0% 8430068 ± 10% sched_debug.cpu.nr_switches.min 351193 ± 9% +136.9% 831814 ± 10% sched_debug.cpu.nr_switches.stddev 185169 -13.3% 160510 ± 6% sched_debug.cpu_clk 184449 -13.4% 159790 ± 6% sched_debug.ktime 10.22 ± 2% +24.4% 12.71 ± 2% perf-stat.i.MPKI 4.027e+10 -24.3% 3.047e+10 ± 2% perf-stat.i.branch-instructions 4.187e+08 -25.8% 3.105e+08 ± 2% perf-stat.i.branch-misses 1.24 ± 12% +6.7 7.92 ± 5% perf-stat.i.cache-miss-rate% 20998336 ± 11% +557.9% 1.381e+08 ± 4% perf-stat.i.cache-misses 1.989e+09 -9.2% 1.805e+09 perf-stat.i.cache-references 13504754 -23.5% 10324651 ± 2% perf-stat.i.context-switches 1.59 -5.7% 1.50 perf-stat.i.cpi 3.15e+11 -30.1% 2.201e+11 ± 2% perf-stat.i.cpu-cycles 45199 -95.1% 2197 ± 3% perf-stat.i.cpu-migrations 19508 ± 25% -90.9% 1767 ± 5% perf-stat.i.cycles-between-cache-misses 0.04 ± 14% +0.0 0.06 ± 11% perf-stat.i.dTLB-load-miss-rate% 5.827e+10 -24.7% 4.39e+10 ± 2% perf-stat.i.dTLB-loads 3.517e+10 -24.7% 2.65e+10 ± 2% perf-stat.i.dTLB-stores 2.03e+11 -24.5% 1.533e+11 ± 2% perf-stat.i.instructions 0.64 +8.2% 0.69 perf-stat.i.ipc 2.46 -30.1% 1.72 ± 2% perf-stat.i.metric.GHz 220.84 ± 4% +212.3% 689.61 ± 3% perf-stat.i.metric.K/sec 1060 -24.3% 802.22 ± 2% perf-stat.i.metric.M/sec 85.79 +6.8 92.57 perf-stat.i.node-load-miss-rate% 6746106 ± 9% +565.5% 44893575 ± 4% perf-stat.i.node-load-misses 1469235 ± 9% +95.2% 2868455 ± 6% perf-stat.i.node-loads 63.12 ± 3% +6.4 69.52 perf-stat.i.node-store-miss-rate% 3224894 ± 8% +535.6% 20495885 ± 4% perf-stat.i.node-store-misses 2375887 ± 7% +276.1% 8935513 ± 4% perf-stat.i.node-stores 9.80 +20.2% 11.78 perf-stat.overall.MPKI 1.04 -0.0 1.02 perf-stat.overall.branch-miss-rate% 1.06 ± 11% +6.6 7.65 ± 5% perf-stat.overall.cache-miss-rate% 1.55 -7.5% 1.44 perf-stat.overall.cpi 15203 ± 12% -89.5% 1596 ± 5% perf-stat.overall.cycles-between-cache-misses 0.01 ± 3% +0.0 0.02 ± 5% perf-stat.overall.dTLB-load-miss-rate% 0.64 +8.1% 0.70 perf-stat.overall.ipc 82.03 ± 2% +12.0 93.98 perf-stat.overall.node-load-miss-rate% 57.54 ± 2% +12.1 69.62 perf-stat.overall.node-store-miss-rate% 60057 -1.1% 59408 perf-stat.overall.path-length 4.014e+10 -24.3% 3.038e+10 ± 2% perf-stat.ps.branch-instructions 4.173e+08 -25.8% 3.095e+08 ± 2% perf-stat.ps.branch-misses 20930523 ± 11% +557.8% 1.377e+08 ± 4% perf-stat.ps.cache-misses 1.982e+09 -9.2% 1.799e+09 perf-stat.ps.cache-references 13459625 -23.5% 10290156 ± 2% perf-stat.ps.context-switches 3.14e+11 -30.1% 2.193e+11 ± 2% perf-stat.ps.cpu-cycles 45141 -95.1% 2190 ± 3% perf-stat.ps.cpu-migrations 5.808e+10 -24.7% 4.376e+10 ± 2% perf-stat.ps.dTLB-loads 3.505e+10 -24.7% 2.641e+10 ± 2% perf-stat.ps.dTLB-stores 2.023e+11 -24.5% 1.528e+11 ± 2% perf-stat.ps.instructions 6723213 ± 9% +565.4% 44738975 ± 4% perf-stat.ps.node-load-misses 1463122 ± 9% +95.4% 2859072 ± 6% perf-stat.ps.node-loads 3214426 ± 8% +535.4% 20425091 ± 4% perf-stat.ps.node-store-misses 2369833 ± 7% +275.9% 8907536 ± 4% perf-stat.ps.node-stores 6.186e+13 -24.3% 4.681e+13 ± 2% perf-stat.total.instructions 51.77 -4.7 47.02 perf-profile.calltrace.cycles-pp.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe 52.57 -4.6 47.94 perf-profile.calltrace.cycles-pp.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe.sendmsg 49.67 -4.4 45.27 perf-profile.calltrace.cycles-pp.sock_sendmsg.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg.do_syscall_64 49.15 -4.3 44.80 perf-profile.calltrace.cycles-pp.sctp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg 48.34 -4.3 44.09 perf-profile.calltrace.cycles-pp.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg 43.17 -3.7 39.49 perf-profile.calltrace.cycles-pp.sctp_primitive_SEND.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg 42.04 -3.6 38.42 perf-profile.calltrace.cycles-pp.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND.sctp_sendmsg_to_asoc 34.99 -3.5 31.47 perf-profile.calltrace.cycles-pp.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND 30.32 -3.4 26.90 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm 29.73 -3.3 26.39 perf-profile.calltrace.cycles-pp.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter 28.05 -3.1 24.92 perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit 28.17 -3.1 25.04 perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush 27.90 -3.1 24.78 perf-profile.calltrace.cycles-pp.__softirqentry_text_start.do_softirq.__local_bh_enable_ip.ip_finish_output2.__ip_queue_xmit 26.60 -3.0 23.64 perf-profile.calltrace.cycles-pp.process_backlog.__napi_poll.net_rx_action.__softirqentry_text_start.do_softirq 26.90 -2.9 23.96 perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.do_softirq.__local_bh_enable_ip.ip_finish_output2 26.68 -2.9 23.74 perf-profile.calltrace.cycles-pp.__napi_poll.net_rx_action.__softirqentry_text_start.do_softirq.__local_bh_enable_ip 25.86 -2.9 22.96 perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.__napi_poll.net_rx_action.__softirqentry_text_start 26.87 -2.8 24.08 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.sendmsg.process_requests.spawn_child.accept_connection 26.76 -2.8 24.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.sendmsg.process_requests.spawn_child 26.63 -2.7 23.88 perf-profile.calltrace.cycles-pp.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe.sendmsg.process_requests 25.32 -2.7 22.60 perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog.__napi_poll.net_rx_action 25.22 -2.7 22.54 perf-profile.calltrace.cycles-pp.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog.__napi_poll 25.02 -2.6 22.44 perf-profile.calltrace.cycles-pp.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog 26.78 -2.1 24.66 perf-profile.calltrace.cycles-pp.sendmsg.main.__libc_start_main 26.54 -2.1 24.43 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.sendmsg.main.__libc_start_main 21.68 -2.1 19.59 ± 2% perf-profile.calltrace.cycles-pp.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core 26.44 -2.1 24.35 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.sendmsg.main.__libc_start_main 23.76 -2.1 21.68 perf-profile.calltrace.cycles-pp.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND.sctp_sendmsg_to_asoc.sctp_sendmsg 15.78 -2.0 13.76 perf-profile.calltrace.cycles-pp.____sys_recvmsg.___sys_recvmsg.__sys_recvmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe 5.56 ± 4% -2.0 3.57 ± 3% perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg 5.47 ± 4% -2.0 3.48 ± 3% perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg 16.64 -2.0 14.66 perf-profile.calltrace.cycles-pp.___sys_recvmsg.__sys_recvmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe.recvmsg 26.31 -2.0 24.33 perf-profile.calltrace.cycles-pp.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe.sendmsg.main 16.95 -2.0 14.97 perf-profile.calltrace.cycles-pp.__sys_recvmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe.recvmsg 15.17 -1.9 13.25 perf-profile.calltrace.cycles-pp.inet_recvmsg.____sys_recvmsg.___sys_recvmsg.__sys_recvmsg.do_syscall_64 15.10 -1.9 13.20 perf-profile.calltrace.cycles-pp.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg.__sys_recvmsg 18.73 -1.9 16.85 perf-profile.calltrace.cycles-pp.recvmsg 17.27 -1.8 15.43 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.recvmsg 5.87 ± 4% -1.8 4.06 ± 2% perf-profile.calltrace.cycles-pp.schedule_timeout.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 17.50 -1.8 15.70 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.recvmsg 8.28 ± 2% -1.7 6.54 perf-profile.calltrace.cycles-pp.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg 22.16 -1.7 20.48 perf-profile.calltrace.cycles-pp.sctp_do_sm.sctp_primitive_SEND.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg 18.42 -1.4 16.99 ± 2% perf-profile.calltrace.cycles-pp.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish 17.64 -1.3 16.34 ± 2% perf-profile.calltrace.cycles-pp.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu 8.26 ± 2% -1.0 7.29 perf-profile.calltrace.cycles-pp.consume_skb.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm 8.61 ± 2% -1.0 7.65 perf-profile.calltrace.cycles-pp.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv 2.06 ± 2% -0.9 1.18 ± 5% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 2.01 ± 2% -0.9 1.13 ± 5% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common 6.98 ± 2% -0.8 6.19 perf-profile.calltrace.cycles-pp.sctp_wfree.skb_release_head_state.consume_skb.sctp_chunk_put.sctp_outq_sack 7.08 ± 2% -0.8 6.30 perf-profile.calltrace.cycles-pp.skb_release_head_state.consume_skb.sctp_chunk_put.sctp_outq_sack.sctp_cmd_interpreter 2.18 -0.7 1.46 ± 3% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule_idle.do_idle.cpu_startup_entry 5.32 ± 2% -0.7 4.65 perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.__sctp_write_space.sctp_wfree 5.23 ± 2% -0.6 4.59 perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.__sctp_write_space 4.06 -0.6 3.43 ± 2% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 4.19 -0.6 3.56 ± 2% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 5.76 ± 2% -0.6 5.14 perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.__sctp_write_space.sctp_wfree.skb_release_head_state 13.51 -0.6 12.92 perf-profile.calltrace.cycles-pp.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv 5.91 ± 2% -0.6 5.33 perf-profile.calltrace.cycles-pp.__wake_up_common_lock.__sctp_write_space.sctp_wfree.skb_release_head_state.consume_skb 2.63 ± 2% -0.6 2.08 perf-profile.calltrace.cycles-pp.sctp_make_datafrag_empty.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg 2.17 ± 2% -0.5 1.64 perf-profile.calltrace.cycles-pp._sctp_make_chunk.sctp_make_datafrag_empty.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg 6.23 ± 2% -0.5 5.75 perf-profile.calltrace.cycles-pp.__sctp_write_space.sctp_wfree.skb_release_head_state.consume_skb.sctp_chunk_put 1.82 -0.4 1.38 ± 2% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.schedule_timeout.sctp_skb_recv_datagram 2.29 ± 2% -0.4 1.87 ± 2% perf-profile.calltrace.cycles-pp.sctp_do_sm.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv 4.10 ± 2% -0.4 3.69 perf-profile.calltrace.cycles-pp.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg 1.57 -0.4 1.20 ± 2% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.schedule_timeout 1.86 ± 3% -0.3 1.52 ± 4% perf-profile.calltrace.cycles-pp.sctp_ulpq_tail_data.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv 3.60 ± 2% -0.3 3.26 ± 2% perf-profile.calltrace.cycles-pp.sctp_packet_append_chunk.sctp_packet_transmit_chunk.sctp_outq_flush_data.sctp_outq_flush.sctp_cmd_interpreter 3.63 ± 2% -0.3 3.30 ± 2% perf-profile.calltrace.cycles-pp.sctp_packet_transmit_chunk.sctp_outq_flush_data.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm 1.33 -0.3 1.05 ± 3% perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__schedule.schedule_idle.do_idle 0.71 -0.3 0.43 ± 44% perf-profile.calltrace.cycles-pp.kmem_cache_free.sctp_ulpevent_free.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 2.48 -0.2 2.25 perf-profile.calltrace.cycles-pp.sctp_ulpevent_free.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg 0.63 -0.2 0.43 ± 44% perf-profile.calltrace.cycles-pp.update_rq_clock.__schedule.schedule.schedule_timeout.sctp_skb_recv_datagram 2.18 ± 2% -0.2 1.99 perf-profile.calltrace.cycles-pp.sctp_make_sack.sctp_packet_append_chunk.sctp_packet_transmit_chunk.sctp_outq_flush_data.sctp_outq_flush 1.32 -0.2 1.16 perf-profile.calltrace.cycles-pp.sctp_cmd_interpreter.sctp_do_sm.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv 1.54 ± 3% -0.1 1.40 ± 2% perf-profile.calltrace.cycles-pp.__sctp_rcv_lookup.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core 1.22 ± 2% -0.1 1.08 ± 4% perf-profile.calltrace.cycles-pp.__dev_queue_xmit.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush 1.50 ± 3% -0.1 1.36 ± 2% perf-profile.calltrace.cycles-pp.sctp_addrs_lookup_transport.__sctp_rcv_lookup.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish 0.78 -0.1 0.66 ± 3% perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.cpuidle_idle_call 1.27 ± 3% -0.1 1.15 ± 3% perf-profile.calltrace.cycles-pp.__rhashtable_lookup.sctp_addrs_lookup_transport.__sctp_rcv_lookup.sctp_rcv.ip_protocol_deliver_rcu 0.67 -0.1 0.58 ± 2% perf-profile.calltrace.cycles-pp.tick_nohz_idle_exit.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 0.88 -0.1 0.81 ± 3% perf-profile.calltrace.cycles-pp.kfree_skb_reason.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg 0.73 ± 2% -0.0 0.69 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock_bh.lock_sock_nested.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg 0.81 +0.0 0.85 ± 2% perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg 0.63 +0.0 0.67 perf-profile.calltrace.cycles-pp.prepare_to_wait_exclusive.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 0.60 +0.0 0.65 ± 2% perf-profile.calltrace.cycles-pp.sctp_inet_skb_msgname.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg 0.56 ± 4% +0.1 0.61 ± 2% perf-profile.calltrace.cycles-pp.dst_release.skb_release_head_state.consume_skb.sctp_chunk_put.sctp_ulpevent_free 0.69 +0.1 0.74 ± 2% perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg 0.66 +0.1 0.72 ± 2% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter 1.57 +0.1 1.64 ± 2% perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg 1.54 +0.1 1.62 ± 2% perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 0.61 ± 4% +0.1 0.68 ± 3% perf-profile.calltrace.cycles-pp.skb_release_head_state.consume_skb.sctp_chunk_put.sctp_ulpevent_free.sctp_recvmsg 0.90 ± 2% +0.1 1.00 ± 2% perf-profile.calltrace.cycles-pp.consume_skb.sctp_chunk_put.sctp_ulpevent_free.sctp_recvmsg.inet_recvmsg 1.14 ± 2% +0.2 1.29 perf-profile.calltrace.cycles-pp.__alloc_skb.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm 1.72 ± 2% +0.2 1.95 perf-profile.calltrace.cycles-pp.sctp_packet_pack.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm 1.83 ± 2% +0.4 2.20 ± 3% perf-profile.calltrace.cycles-pp.sctp_outq_select_transport.sctp_outq_flush_data.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm 0.96 ± 20% +0.4 1.34 ± 2% perf-profile.calltrace.cycles-pp.sctp_chunk_put.sctp_packet_pack.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter 0.08 ±223% +0.5 0.56 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_exclusive.sctp_skb_recv_datagram.sctp_recvmsg.inet_recvmsg 0.00 +1.0 0.96 ± 12% perf-profile.calltrace.cycles-pp.sched_ttwu_pending.flush_smp_call_function_from_idle.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 2.12 +1.0 3.12 ± 3% perf-profile.calltrace.cycles-pp.sctp_check_transmitted.sctp_outq_sack.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv 0.00 +1.2 1.18 ± 32% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call 0.00 +1.4 1.35 ± 31% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle 0.08 ±223% +1.4 1.44 ± 2% perf-profile.calltrace.cycles-pp.sctp_packet_config.sctp_outq_select_transport.sctp_outq_flush_data.sctp_outq_flush.sctp_cmd_interpreter 0.00 +1.4 1.44 ± 12% perf-profile.calltrace.cycles-pp.flush_smp_call_function_from_idle.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 15.63 +4.5 20.17 ± 2% perf-profile.calltrace.cycles-pp.mwait_idle_with_hints.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call 15.89 +4.6 20.48 ± 2% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle 16.90 +6.1 22.97 ± 3% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry 16.97 +6.2 23.18 ± 4% perf-profile.calltrace.cycles-pp.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 19.28 +6.3 25.55 ± 3% perf-profile.calltrace.cycles-pp.cpuidle_idle_call.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 24.93 +7.0 31.98 ± 2% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 25.02 +7.1 32.07 ± 2% perf-profile.calltrace.cycles-pp.cpu_startup_entry.secondary_startup_64_no_verify 25.26 +7.1 32.37 ± 2% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify 71.34 -6.8 64.49 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 70.91 -6.8 64.09 perf-profile.children.cycles-pp.do_syscall_64 54.38 -5.1 49.29 perf-profile.children.cycles-pp.sendmsg 52.12 -5.0 47.12 perf-profile.children.cycles-pp.____sys_sendmsg 53.30 -5.0 48.31 perf-profile.children.cycles-pp.__sys_sendmsg 52.93 -4.9 48.05 perf-profile.children.cycles-pp.___sys_sendmsg 50.00 -4.6 45.36 perf-profile.children.cycles-pp.sock_sendmsg 49.80 -4.6 45.19 perf-profile.children.cycles-pp.sctp_sendmsg 48.69 -4.5 44.21 perf-profile.children.cycles-pp.sctp_sendmsg_to_asoc 43.46 -3.8 39.65 perf-profile.children.cycles-pp.sctp_primitive_SEND 43.31 -3.8 39.54 perf-profile.children.cycles-pp.sctp_do_sm 42.46 -3.8 38.70 perf-profile.children.cycles-pp.sctp_outq_flush 43.13 -3.7 39.38 perf-profile.children.cycles-pp.sctp_cmd_interpreter 35.24 -3.6 31.62 perf-profile.children.cycles-pp.sctp_packet_transmit 30.53 -3.5 27.02 perf-profile.children.cycles-pp.__ip_queue_xmit 29.94 -3.4 26.51 perf-profile.children.cycles-pp.ip_finish_output2 28.50 -3.3 25.21 perf-profile.children.cycles-pp.__local_bh_enable_ip 28.25 -3.2 25.02 perf-profile.children.cycles-pp.do_softirq 28.19 -3.1 25.10 perf-profile.children.cycles-pp.__softirqentry_text_start 26.78 -3.0 23.74 perf-profile.children.cycles-pp.process_backlog 26.86 -3.0 23.85 perf-profile.children.cycles-pp.__napi_poll 27.09 -3.0 24.10 perf-profile.children.cycles-pp.net_rx_action 26.04 -3.0 23.07 perf-profile.children.cycles-pp.__netif_receive_skb_one_core 27.54 -2.9 24.68 perf-profile.children.cycles-pp.accept_connection 27.54 -2.9 24.68 perf-profile.children.cycles-pp.spawn_child 27.54 -2.9 24.68 perf-profile.children.cycles-pp.process_requests 25.50 -2.8 22.70 perf-profile.children.cycles-pp.ip_local_deliver_finish 25.39 -2.8 22.64 perf-profile.children.cycles-pp.ip_protocol_deliver_rcu 25.23 -2.7 22.56 perf-profile.children.cycles-pp.sctp_rcv 9.66 ± 2% -2.6 7.02 ± 2% perf-profile.children.cycles-pp.__schedule 21.85 -2.2 19.69 perf-profile.children.cycles-pp.sctp_assoc_bh_rcv 3.77 ± 6% -2.1 1.71 ± 3% perf-profile.children.cycles-pp.pick_next_task_fair 15.79 -2.0 13.77 perf-profile.children.cycles-pp.____sys_recvmsg 16.66 -2.0 14.68 perf-profile.children.cycles-pp.___sys_recvmsg 5.56 ± 4% -2.0 3.58 ± 3% perf-profile.children.cycles-pp.schedule 16.97 -2.0 14.99 perf-profile.children.cycles-pp.__sys_recvmsg 15.46 -1.9 13.53 perf-profile.children.cycles-pp.sctp_recvmsg 15.18 -1.9 13.26 perf-profile.children.cycles-pp.inet_recvmsg 18.87 -1.9 16.98 perf-profile.children.cycles-pp.recvmsg 5.89 ± 4% -1.8 4.08 ± 2% perf-profile.children.cycles-pp.schedule_timeout 8.32 ± 2% -1.7 6.59 perf-profile.children.cycles-pp.sctp_skb_recv_datagram 1.50 ± 16% -1.3 0.17 ± 10% perf-profile.children.cycles-pp.newidle_balance 9.61 -1.1 8.54 perf-profile.children.cycles-pp.consume_skb 7.16 -0.9 6.22 perf-profile.children.cycles-pp.sctp_wfree 8.16 -0.9 7.25 perf-profile.children.cycles-pp.skb_release_head_state 11.66 -0.9 10.76 perf-profile.children.cycles-pp.sctp_chunk_put 5.47 -0.8 4.68 perf-profile.children.cycles-pp.autoremove_wake_function 13.75 -0.8 13.00 perf-profile.children.cycles-pp.sctp_outq_sack 5.91 -0.7 5.17 perf-profile.children.cycles-pp.__wake_up_common 5.40 -0.7 4.65 perf-profile.children.cycles-pp.try_to_wake_up 6.07 -0.7 5.36 perf-profile.children.cycles-pp.__wake_up_common_lock 1.56 -0.7 0.86 perf-profile.children.cycles-pp.kmem_cache_alloc 3.38 -0.7 2.69 perf-profile.children.cycles-pp._sctp_make_chunk 1.61 -0.6 0.98 perf-profile.children.cycles-pp.sctp_chunkify 4.24 -0.6 3.62 perf-profile.children.cycles-pp.schedule_idle 6.40 -0.6 5.78 perf-profile.children.cycles-pp.__sctp_write_space 2.71 -0.6 2.09 perf-profile.children.cycles-pp.sctp_make_datafrag_empty 0.73 ± 18% -0.6 0.11 ± 17% perf-profile.children.cycles-pp.load_balance 0.61 ± 17% -0.5 0.09 ± 12% perf-profile.children.cycles-pp.find_busiest_group 4.22 -0.5 3.72 perf-profile.children.cycles-pp.sctp_datamsg_from_user 2.94 -0.5 2.45 ± 2% perf-profile.children.cycles-pp.__slab_free 0.56 ± 16% -0.5 0.08 ± 11% perf-profile.children.cycles-pp.update_sd_lb_stats 1.83 -0.4 1.40 ± 2% perf-profile.children.cycles-pp.dequeue_task_fair 1.17 ± 3% -0.4 0.74 ± 5% perf-profile.children.cycles-pp.sctp_ulpevent_make_rcvmsg 1.61 -0.4 1.20 perf-profile.children.cycles-pp.enqueue_entity 3.72 -0.4 3.32 ± 2% perf-profile.children.cycles-pp.sctp_packet_transmit_chunk 3.70 -0.4 3.30 ± 2% perf-profile.children.cycles-pp.sctp_packet_append_chunk 0.47 ± 18% -0.4 0.07 ± 29% perf-profile.children.cycles-pp.update_blocked_averages 0.77 -0.4 0.37 ± 9% perf-profile.children.cycles-pp.sock_kmalloc 2.08 -0.4 1.68 perf-profile.children.cycles-pp.enqueue_task_fair 0.46 ± 16% -0.4 0.07 ± 8% perf-profile.children.cycles-pp.update_sg_lb_stats 1.93 -0.4 1.54 ± 4% perf-profile.children.cycles-pp.sctp_ulpq_tail_data 2.12 -0.4 1.74 perf-profile.children.cycles-pp.ttwu_do_activate 1.62 -0.4 1.24 ± 2% perf-profile.children.cycles-pp.dequeue_entity 2.32 -0.3 1.98 ± 3% perf-profile.children.cycles-pp.skb_release_data 0.51 ± 9% -0.3 0.17 ± 8% perf-profile.children.cycles-pp.__skb_clone 1.06 ± 2% -0.3 0.73 ± 3% perf-profile.children.cycles-pp.sctp_sf_eat_data_6_2 3.00 -0.3 2.67 ± 3% perf-profile.children.cycles-pp.kfree 0.41 ± 11% -0.3 0.09 ± 7% perf-profile.children.cycles-pp.__copy_skb_header 3.11 -0.3 2.82 perf-profile.children.cycles-pp.kmem_cache_free 1.38 -0.3 1.10 ± 3% perf-profile.children.cycles-pp.set_next_entity 1.09 ± 2% -0.3 0.82 ± 2% perf-profile.children.cycles-pp._raw_spin_lock_bh 0.93 ± 2% -0.3 0.67 ± 3% perf-profile.children.cycles-pp.sctp_sf_do_no_pending_tsn 0.91 ± 3% -0.3 0.66 ± 3% perf-profile.children.cycles-pp.sctp_ulpevent_make_sender_dry_event 0.92 -0.3 0.67 ± 3% perf-profile.children.cycles-pp.kmalloc_reserve 0.80 -0.3 0.55 ± 2% perf-profile.children.cycles-pp.update_curr 0.54 -0.2 0.30 ± 11% perf-profile.children.cycles-pp.resched_curr 0.84 -0.2 0.60 ± 3% perf-profile.children.cycles-pp.__kmalloc_node_track_caller 1.11 -0.2 0.88 ± 2% perf-profile.children.cycles-pp.__list_del_entry_valid 2.24 -0.2 2.01 perf-profile.children.cycles-pp.sctp_make_sack 2.61 -0.2 2.38 perf-profile.children.cycles-pp.sctp_ulpevent_free 0.88 -0.2 0.66 ± 3% perf-profile.children.cycles-pp.sctp_addto_chunk 0.45 -0.2 0.25 ± 4% perf-profile.children.cycles-pp.skb_put 1.16 -0.2 0.96 ± 3% perf-profile.children.cycles-pp.sctp_make_control 0.85 -0.2 0.65 ± 3% perf-profile.children.cycles-pp.sctp_eat_data 0.91 ± 2% -0.2 0.72 ± 3% perf-profile.children.cycles-pp.do_ulpq_tail_event 0.55 ± 3% -0.2 0.36 ± 18% perf-profile.children.cycles-pp.enqueue_timer 0.22 ± 4% -0.2 0.04 ± 71% perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime 1.58 ± 2% -0.2 1.40 ± 2% perf-profile.children.cycles-pp.__sctp_rcv_lookup 1.55 ± 2% -0.2 1.38 ± 3% perf-profile.children.cycles-pp.sctp_addrs_lookup_transport 1.27 ± 3% -0.2 1.10 ± 4% perf-profile.children.cycles-pp.__dev_queue_xmit 0.60 -0.2 0.44 ± 8% perf-profile.children.cycles-pp.check_preempt_curr 0.64 -0.2 0.48 ± 7% perf-profile.children.cycles-pp.ttwu_do_wakeup 3.48 -0.2 3.31 perf-profile.children.cycles-pp.__alloc_skb 0.57 -0.2 0.41 ± 5% perf-profile.children.cycles-pp.finish_task_switch 0.69 -0.2 0.53 ± 3% perf-profile.children.cycles-pp.kmem_cache_alloc_node 0.46 -0.1 0.31 ± 6% perf-profile.children.cycles-pp.pick_next_entity 0.39 -0.1 0.24 ± 2% perf-profile.children.cycles-pp.__cond_resched 0.70 -0.1 0.57 ± 2% perf-profile.children.cycles-pp.__might_resched 1.30 ± 3% -0.1 1.17 ± 3% perf-profile.children.cycles-pp.__rhashtable_lookup 0.79 -0.1 0.66 ± 4% perf-profile.children.cycles-pp.prepare_task_switch 0.52 -0.1 0.38 ± 5% perf-profile.children.cycles-pp.___perf_sw_event 0.55 -0.1 0.42 ± 3% perf-profile.children.cycles-pp.__next_timer_interrupt 0.80 -0.1 0.67 ± 3% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.30 ± 11% -0.1 0.17 ± 10% perf-profile.children.cycles-pp.sctp_outq_tail 0.35 ± 2% -0.1 0.24 ± 3% perf-profile.children.cycles-pp._find_next_bit 1.46 -0.1 1.35 perf-profile.children.cycles-pp.sctp_ulpq_tail_event 1.12 -0.1 1.01 ± 2% perf-profile.children.cycles-pp.kfree_skb_reason 0.83 -0.1 0.72 perf-profile.children.cycles-pp.skb_set_owner_w 0.27 ± 8% -0.1 0.17 ± 10% perf-profile.children.cycles-pp.validate_xmit_skb 0.26 ± 2% -0.1 0.15 ± 4% perf-profile.children.cycles-pp.ip_rcv 0.75 ± 2% -0.1 0.64 ± 3% perf-profile.children.cycles-pp.sctp_queue_purge_ulpevents 0.54 -0.1 0.44 ± 2% perf-profile.children.cycles-pp.__list_add_valid 0.26 -0.1 0.16 ± 3% perf-profile.children.cycles-pp.security_socket_recvmsg 0.41 ± 2% -0.1 0.31 ± 3% perf-profile.children.cycles-pp.sockfd_lookup_light 0.28 -0.1 0.18 ± 2% perf-profile.children.cycles-pp.sock_recvmsg 1.22 -0.1 1.13 ± 2% perf-profile.children.cycles-pp.update_load_avg 0.53 -0.1 0.44 ± 4% perf-profile.children.cycles-pp.sctp_association_put 0.36 -0.1 0.27 ± 2% perf-profile.children.cycles-pp.aa_sk_perm 0.33 ± 3% -0.1 0.24 ± 4% perf-profile.children.cycles-pp.release_sock 0.18 ± 6% -0.1 0.10 ± 5% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 0.77 -0.1 0.68 perf-profile.children.cycles-pp.import_iovec 0.68 -0.1 0.59 ± 2% perf-profile.children.cycles-pp.tick_nohz_idle_exit 1.14 -0.1 1.05 perf-profile.children.cycles-pp._copy_from_user 0.27 ± 11% -0.1 0.18 ± 12% perf-profile.children.cycles-pp.sctp_v4_xmit 0.74 -0.1 0.66 perf-profile.children.cycles-pp.__import_iovec 0.17 ± 5% -0.1 0.09 ± 5% perf-profile.children.cycles-pp.sctp_cmp_addr_exact 0.36 -0.1 0.28 ± 2% perf-profile.children.cycles-pp.__update_load_avg_se 0.35 -0.1 0.28 ± 3% perf-profile.children.cycles-pp.security_socket_sendmsg 0.50 -0.1 0.43 ± 3% perf-profile.children.cycles-pp.nr_iowait_cpu 0.32 ± 2% -0.1 0.25 ± 2% perf-profile.children.cycles-pp.__fget_light 0.30 ± 2% -0.1 0.23 perf-profile.children.cycles-pp.memcg_slab_post_alloc_hook 0.56 -0.1 0.49 ± 3% perf-profile.children.cycles-pp.sctp_sf_eat_sack_6_2 0.70 -0.1 0.63 ± 4% perf-profile.children.cycles-pp.irqtime_account_irq 0.63 -0.1 0.57 ± 2% perf-profile.children.cycles-pp.iovec_from_user 0.11 ± 9% -0.1 0.06 ± 9% perf-profile.children.cycles-pp.sctp_validate_data 0.44 -0.1 0.39 ± 5% perf-profile.children.cycles-pp.switch_mm_irqs_off 0.60 -0.1 0.54 perf-profile.children.cycles-pp.memset_erms 0.39 ± 4% -0.1 0.34 ± 5% perf-profile.children.cycles-pp.__switch_to_asm 0.74 ± 2% -0.0 0.69 perf-profile.children.cycles-pp.memcg_slab_free_hook 0.28 ± 3% -0.0 0.23 ± 3% perf-profile.children.cycles-pp.recv_sctp_rr 0.39 ± 2% -0.0 0.34 ± 3% perf-profile.children.cycles-pp.__might_fault 0.15 ± 2% -0.0 0.11 ± 4% perf-profile.children.cycles-pp.__netif_receive_skb_core 0.27 ± 2% -0.0 0.22 ± 2% perf-profile.children.cycles-pp.send_sctp_rr 0.10 -0.0 0.06 ± 8% perf-profile.children.cycles-pp.sk_filter_trim_cap 0.12 ± 3% -0.0 0.08 ± 4% perf-profile.children.cycles-pp.ip_output 0.30 ± 5% -0.0 0.26 ± 2% perf-profile.children.cycles-pp.sctp_chunk_hold 0.19 ± 10% -0.0 0.15 ± 4% perf-profile.children.cycles-pp.sctp_datamsg_put 0.16 ± 5% -0.0 0.13 ± 5% perf-profile.children.cycles-pp.update_cfs_group 0.15 ± 3% -0.0 0.12 ± 4% perf-profile.children.cycles-pp.perf_tp_event 0.17 ± 2% -0.0 0.14 ± 4% perf-profile.children.cycles-pp.__virt_addr_valid 0.08 ± 6% -0.0 0.04 ± 47% perf-profile.children.cycles-pp.sctp_sm_lookup_event 0.24 ± 2% -0.0 0.22 ± 5% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore 0.21 ± 2% -0.0 0.18 ± 2% perf-profile.children.cycles-pp.skb_dequeue 0.17 ± 6% -0.0 0.14 ± 7% perf-profile.children.cycles-pp.sctp_ulpevent_init 0.07 ± 5% -0.0 0.04 ± 44% perf-profile.children.cycles-pp.put_prev_task_fair 0.10 ± 4% -0.0 0.08 ± 4% perf-profile.children.cycles-pp.update_min_vruntime 0.24 -0.0 0.22 ± 3% perf-profile.children.cycles-pp.__sctp_packet_append_chunk 0.10 ± 5% -0.0 0.07 ± 8% perf-profile.children.cycles-pp.pick_next_task_idle 0.09 ± 5% -0.0 0.07 ± 8% perf-profile.children.cycles-pp.kmalloc_slab 0.23 ± 2% -0.0 0.21 ± 2% perf-profile.children.cycles-pp.sctp_inq_pop 0.09 ± 9% -0.0 0.07 ± 8% perf-profile.children.cycles-pp.__ip_finish_output 0.09 ± 4% -0.0 0.07 ± 11% perf-profile.children.cycles-pp.should_failslab 0.08 ± 5% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.check_stack_object 0.08 ± 6% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.__update_idle_core 0.13 ± 2% -0.0 0.11 ± 4% perf-profile.children.cycles-pp.__put_user_nocheck_4 0.24 ± 2% -0.0 0.22 ± 4% perf-profile.children.cycles-pp.save_fpregs_to_fpstate 0.11 ± 3% -0.0 0.09 ± 9% perf-profile.children.cycles-pp.update_irq_load_avg 0.10 ± 7% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.sctp_bind_addr_match 0.18 ± 2% -0.0 0.16 ± 6% perf-profile.children.cycles-pp.memcpy_erms 0.17 ± 2% -0.0 0.16 ± 4% perf-profile.children.cycles-pp.copyin 0.10 ± 3% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.sctp_ulpq_order 0.10 ± 9% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.ip_rcv_core 0.08 ± 6% -0.0 0.06 perf-profile.children.cycles-pp.perf_trace_buf_update 0.11 -0.0 0.10 ± 8% perf-profile.children.cycles-pp.__build_skb_around 0.12 ± 4% -0.0 0.10 ± 4% perf-profile.children.cycles-pp.sctp_sock_rfree 0.32 +0.0 0.35 ± 3% perf-profile.children.cycles-pp.__entry_text_start 0.11 ± 3% +0.0 0.13 ± 3% perf-profile.children.cycles-pp.call_cpuidle 0.14 ± 3% +0.0 0.17 ± 4% perf-profile.children.cycles-pp.sock_wfree 0.11 ± 4% +0.0 0.14 ± 7% perf-profile.children.cycles-pp.rcu_dynticks_inc 0.82 +0.0 0.86 ± 2% perf-profile.children.cycles-pp._copy_to_iter 0.30 ± 3% +0.0 0.34 ± 3% perf-profile.children.cycles-pp._copy_from_iter 0.08 ± 5% +0.0 0.12 ± 12% perf-profile.children.cycles-pp.rebalance_domains 0.64 +0.0 0.68 perf-profile.children.cycles-pp.prepare_to_wait_exclusive 1.55 +0.0 1.59 perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 0.60 +0.0 0.65 ± 2% perf-profile.children.cycles-pp.sctp_inet_skb_msgname 0.69 +0.1 0.74 ± 2% perf-profile.children.cycles-pp.copyout 0.44 ± 2% +0.1 0.50 ± 4% perf-profile.children.cycles-pp.select_task_rq_fair 0.77 +0.1 0.83 ± 3% perf-profile.children.cycles-pp.select_task_rq 1.59 +0.1 1.66 perf-profile.children.cycles-pp.__check_object_size 0.00 +0.1 0.06 ± 11% perf-profile.children.cycles-pp.arch_cpu_idle_enter 0.00 +0.1 0.06 ± 7% perf-profile.children.cycles-pp.sctp_v4_ecn_capable 0.00 +0.1 0.07 ± 33% perf-profile.children.cycles-pp.tick_nohz_irq_exit 0.14 ± 7% +0.1 0.21 ± 9% perf-profile.children.cycles-pp.clockevents_program_event 0.14 ± 14% +0.1 0.21 ± 13% perf-profile.children.cycles-pp.rcu_eqs_exit 1.58 +0.1 1.65 ± 2% perf-profile.children.cycles-pp.skb_copy_datagram_iter 0.00 +0.1 0.07 ± 12% perf-profile.children.cycles-pp.lapic_next_deadline 1.55 +0.1 1.62 ± 2% perf-profile.children.cycles-pp.__skb_datagram_iter 0.52 +0.1 0.59 ± 4% perf-profile.children.cycles-pp.sctp_data_ready 0.38 +0.1 0.46 ± 2% perf-profile.children.cycles-pp.read_tsc 0.23 ± 2% +0.1 0.31 ± 4% perf-profile.children.cycles-pp.sctp_association_hold 0.00 +0.1 0.08 ± 35% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.00 +0.1 0.08 ± 14% perf-profile.children.cycles-pp.llist_add_batch 0.00 +0.1 0.09 ± 40% perf-profile.children.cycles-pp.timekeeping_max_deferment 0.00 +0.1 0.09 ± 11% perf-profile.children.cycles-pp.__smp_call_single_queue 0.07 ± 6% +0.1 0.17 ± 32% perf-profile.children.cycles-pp.scheduler_tick 0.00 +0.1 0.10 ± 8% perf-profile.children.cycles-pp.native_irq_return_iret 0.36 +0.1 0.46 ± 2% perf-profile.children.cycles-pp._raw_spin_lock_irq 0.31 ± 5% +0.1 0.41 ± 7% perf-profile.children.cycles-pp.rcu_idle_exit 0.26 ± 3% +0.1 0.36 ± 4% perf-profile.children.cycles-pp.available_idle_cpu 0.27 ± 3% +0.1 0.37 ± 3% perf-profile.children.cycles-pp.wake_affine 0.69 +0.1 0.81 perf-profile.children.cycles-pp.sendmsg_copy_msghdr 0.61 +0.1 0.74 ± 2% perf-profile.children.cycles-pp.sctp_transport_hold 0.00 +0.1 0.14 ± 32% perf-profile.children.cycles-pp.tick_irq_enter 0.00 +0.1 0.14 ± 2% perf-profile.children.cycles-pp.sctp_auth_send_cid 0.00 +0.1 0.15 ± 32% perf-profile.children.cycles-pp.irq_enter_rcu 0.30 ± 7% +0.2 0.45 ± 3% perf-profile.children.cycles-pp.syscall_exit_to_user_mode 0.57 +0.2 0.73 ± 2% perf-profile.children.cycles-pp.__copy_msghdr_from_user 0.12 ± 6% +0.2 0.28 ± 20% perf-profile.children.cycles-pp.__irq_exit_rcu 0.13 ± 3% +0.2 0.30 ± 3% perf-profile.children.cycles-pp.exit_to_user_mode_prepare 0.08 +0.2 0.25 ± 4% perf-profile.children.cycles-pp.switch_fpu_return 0.48 +0.2 0.66 perf-profile.children.cycles-pp.sctp_chunk_abandoned 0.70 +0.2 0.88 ± 5% perf-profile.children.cycles-pp.ktime_get 0.10 ± 4% +0.2 0.30 ± 39% perf-profile.children.cycles-pp.update_process_times 1.80 +0.2 1.99 perf-profile.children.cycles-pp.sctp_packet_pack 0.32 +0.2 0.52 ± 6% perf-profile.children.cycles-pp.sctp_transport_put 0.00 +0.2 0.21 ± 11% perf-profile.children.cycles-pp.llist_reverse_order 0.11 ± 6% +0.2 0.32 ± 43% perf-profile.children.cycles-pp.tick_sched_handle 0.14 ± 3% +0.2 0.38 ± 37% perf-profile.children.cycles-pp.tick_sched_timer 0.22 ± 10% +0.2 0.46 ± 2% perf-profile.children.cycles-pp.ipv4_dst_check 0.15 ± 3% +0.3 0.42 ± 6% perf-profile.children.cycles-pp.sctp_tsnmap_check 1.10 +0.3 1.39 ± 4% perf-profile.children.cycles-pp.del_timer 0.85 +0.3 1.16 ± 4% perf-profile.children.cycles-pp._raw_spin_lock 0.00 +0.3 0.32 ± 13% perf-profile.children.cycles-pp.flush_smp_call_function_queue 1.89 +0.3 2.22 ± 2% perf-profile.children.cycles-pp.sctp_outq_select_transport 0.00 +0.3 0.34 ± 13% perf-profile.children.cycles-pp.send_call_function_single_ipi 1.13 +0.4 1.51 ± 2% perf-profile.children.cycles-pp.__ksize 0.17 ± 2% +0.4 0.56 ± 40% perf-profile.children.cycles-pp.__hrtimer_run_queues 1.30 ± 4% +0.5 1.76 perf-profile.children.cycles-pp.lock_timer_base 0.98 ± 2% +0.5 1.45 ± 2% perf-profile.children.cycles-pp.sctp_packet_config 0.07 ± 10% +0.5 0.54 ± 12% perf-profile.children.cycles-pp.ttwu_queue_wakelist 0.36 ± 4% +0.5 0.89 ± 29% perf-profile.children.cycles-pp.hrtimer_interrupt 0.36 ± 4% +0.6 0.91 ± 31% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt 2.13 ± 2% +0.7 2.87 perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.54 ± 3% +0.9 1.48 ± 26% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt 2.21 +1.0 3.17 ± 3% perf-profile.children.cycles-pp.sctp_check_transmitted 0.00 +1.0 0.98 ± 12% perf-profile.children.cycles-pp.sched_ttwu_pending 0.72 ± 3% +1.1 1.87 ± 22% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt 0.00 +1.5 1.46 ± 12% perf-profile.children.cycles-pp.flush_smp_call_function_from_idle 15.91 +4.6 20.52 ± 2% perf-profile.children.cycles-pp.mwait_idle_with_hints 16.04 +4.6 20.67 ± 2% perf-profile.children.cycles-pp.intel_idle 17.13 +6.3 23.38 ± 4% perf-profile.children.cycles-pp.cpuidle_enter 17.08 +6.3 23.34 ± 4% perf-profile.children.cycles-pp.cpuidle_enter_state 19.48 +6.3 25.80 ± 4% perf-profile.children.cycles-pp.cpuidle_idle_call 25.20 +7.1 32.30 ± 2% perf-profile.children.cycles-pp.do_idle 25.26 +7.1 32.37 ± 2% perf-profile.children.cycles-pp.secondary_startup_64_no_verify 25.26 +7.1 32.37 ± 2% perf-profile.children.cycles-pp.cpu_startup_entry 2.90 -0.5 2.42 ± 2% perf-profile.self.cycles-pp.__slab_free 1.51 -0.5 1.04 ± 2% perf-profile.self.cycles-pp.sctp_outq_sack 1.01 -0.4 0.56 perf-profile.self.cycles-pp.enqueue_entity 0.55 -0.4 0.16 ± 4% perf-profile.self.cycles-pp.sctp_eat_data 0.50 -0.4 0.14 ± 14% perf-profile.self.cycles-pp.sock_kmalloc 0.69 ± 2% -0.3 0.37 ± 4% perf-profile.self.cycles-pp.sctp_wfree 0.36 ± 17% -0.3 0.04 ± 45% perf-profile.self.cycles-pp.update_sg_lb_stats 0.40 ± 12% -0.3 0.09 ± 7% perf-profile.self.cycles-pp.__copy_skb_header 0.69 -0.3 0.42 perf-profile.self.cycles-pp.kmem_cache_alloc 0.70 -0.3 0.44 ± 3% perf-profile.self.cycles-pp.sctp_packet_transmit 0.54 -0.2 0.30 ± 11% perf-profile.self.cycles-pp.resched_curr 1.06 -0.2 0.83 ± 2% perf-profile.self.cycles-pp.__list_del_entry_valid 0.99 -0.2 0.77 ± 4% perf-profile.self.cycles-pp.set_next_entity 0.41 -0.2 0.21 ± 7% perf-profile.self.cycles-pp.skb_put 0.90 ± 2% -0.2 0.72 ± 2% perf-profile.self.cycles-pp._raw_spin_lock_bh 0.54 ± 3% -0.2 0.36 ± 19% perf-profile.self.cycles-pp.enqueue_timer 0.21 ± 3% -0.2 0.03 ±100% perf-profile.self.cycles-pp.perf_trace_sched_stat_runtime 0.49 -0.2 0.32 ± 3% perf-profile.self.cycles-pp.__kmalloc_node_track_caller 0.35 ± 9% -0.2 0.20 ± 19% perf-profile.self.cycles-pp.__rhashtable_lookup 1.19 -0.2 1.04 ± 5% perf-profile.self.cycles-pp.kfree 0.62 -0.1 0.47 ± 2% perf-profile.self.cycles-pp.sctp_rcv 0.38 -0.1 0.24 ± 6% perf-profile.self.cycles-pp.sctp_chunkify 0.38 -0.1 0.23 ± 4% perf-profile.self.cycles-pp.process_backlog 0.27 ± 2% -0.1 0.12 ± 3% perf-profile.self.cycles-pp.lock_timer_base 0.45 -0.1 0.31 ± 5% perf-profile.self.cycles-pp.pick_next_entity 0.51 ± 3% -0.1 0.38 ± 4% perf-profile.self.cycles-pp.sctp_sendmsg_to_asoc 0.25 -0.1 0.11 ± 7% perf-profile.self.cycles-pp.sctp_packet_append_chunk 0.51 -0.1 0.38 ± 5% perf-profile.self.cycles-pp.finish_task_switch 0.21 ± 7% -0.1 0.08 ± 7% perf-profile.self.cycles-pp.sctp_sf_eat_data_6_2 0.64 -0.1 0.52 ± 3% perf-profile.self.cycles-pp.__might_resched 0.89 -0.1 0.76 ± 4% perf-profile.self.cycles-pp.sctp_outq_select_transport 0.22 ± 7% -0.1 0.10 ± 5% perf-profile.self.cycles-pp.newidle_balance 0.46 ± 2% -0.1 0.34 ± 4% perf-profile.self.cycles-pp.___perf_sw_event 0.64 -0.1 0.53 ± 2% perf-profile.self.cycles-pp.__alloc_skb 0.24 ± 14% -0.1 0.12 ± 14% perf-profile.self.cycles-pp.sctp_outq_tail 0.44 ± 2% -0.1 0.33 ± 3% perf-profile.self.cycles-pp.kmem_cache_alloc_node 0.82 -0.1 0.71 perf-profile.self.cycles-pp.skb_set_owner_w 0.33 -0.1 0.23 ± 3% perf-profile.self.cycles-pp.sctp_assoc_bh_rcv 0.30 ± 4% -0.1 0.20 ± 4% perf-profile.self.cycles-pp._find_next_bit 0.50 -0.1 0.40 ± 2% perf-profile.self.cycles-pp.__list_add_valid 0.52 -0.1 0.42 ± 4% perf-profile.self.cycles-pp.sctp_association_put 0.34 ± 2% -0.1 0.25 ± 5% perf-profile.self.cycles-pp.skb_release_data 0.18 ± 6% -0.1 0.10 ± 5% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 0.14 ± 6% -0.1 0.05 ± 7% perf-profile.self.cycles-pp.ip_protocol_deliver_rcu 0.26 ± 11% -0.1 0.18 ± 13% perf-profile.self.cycles-pp.sctp_v4_xmit 0.31 ± 2% -0.1 0.23 ± 4% perf-profile.self.cycles-pp.__softirqentry_text_start 0.50 -0.1 0.42 ± 4% perf-profile.self.cycles-pp.irqtime_account_irq 0.16 ± 3% -0.1 0.07 ± 6% perf-profile.self.cycles-pp.sctp_cmp_addr_exact 0.16 ± 7% -0.1 0.08 ± 6% perf-profile.self.cycles-pp.validate_xmit_skb 0.24 ± 2% -0.1 0.16 ± 2% perf-profile.self.cycles-pp.aa_sk_perm 0.32 ± 2% -0.1 0.24 ± 3% perf-profile.self.cycles-pp.__update_load_avg_se 0.30 -0.1 0.23 ± 5% perf-profile.self.cycles-pp.__next_timer_interrupt 0.49 -0.1 0.42 ± 3% perf-profile.self.cycles-pp.nr_iowait_cpu 0.22 ± 4% -0.1 0.15 ± 8% perf-profile.self.cycles-pp.sctp_ulpevent_make_sender_dry_event 0.31 ± 2% -0.1 0.25 ± 4% perf-profile.self.cycles-pp.__fget_light 0.10 ± 4% -0.1 0.04 ± 73% perf-profile.self.cycles-pp.ip_local_deliver_finish 0.54 -0.1 0.48 ± 4% perf-profile.self.cycles-pp.sctp_sf_eat_sack_6_2 0.16 ± 3% -0.1 0.10 ± 3% perf-profile.self.cycles-pp.sctp_ulpq_tail_event 0.34 ± 2% -0.1 0.28 ± 5% perf-profile.self.cycles-pp.sctp_do_sm 0.19 ± 2% -0.1 0.13 perf-profile.self.cycles-pp.dequeue_task_fair 0.38 ± 4% -0.1 0.32 ± 5% perf-profile.self.cycles-pp.__switch_to_asm 0.26 ± 2% -0.1 0.20 perf-profile.self.cycles-pp.memcg_slab_post_alloc_hook 0.44 ± 2% -0.1 0.38 ± 5% perf-profile.self.cycles-pp.switch_mm_irqs_off 0.23 ± 2% -0.1 0.18 ± 2% perf-profile.self.cycles-pp.__local_bh_enable_ip 0.38 ± 2% -0.1 0.32 ± 4% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.70 ± 2% -0.0 0.65 ± 2% perf-profile.self.cycles-pp.memcg_slab_free_hook 1.22 -0.0 1.18 perf-profile.self.cycles-pp.update_rq_clock 0.27 ± 3% -0.0 0.22 ± 4% perf-profile.self.cycles-pp.recv_sctp_rr 0.56 -0.0 0.52 perf-profile.self.cycles-pp.memset_erms 0.15 ± 7% -0.0 0.10 ± 4% perf-profile.self.cycles-pp.update_cfs_group 0.26 -0.0 0.22 ± 2% perf-profile.self.cycles-pp.send_sctp_rr 0.14 ± 3% -0.0 0.10 ± 7% perf-profile.self.cycles-pp.__netif_receive_skb_core 0.07 ± 7% -0.0 0.03 ±100% perf-profile.self.cycles-pp.sctp_sm_lookup_event 0.30 ± 4% -0.0 0.26 ± 4% perf-profile.self.cycles-pp.sctp_chunk_hold 0.17 ± 10% -0.0 0.13 ± 5% perf-profile.self.cycles-pp.sctp_datamsg_put 0.27 ± 4% -0.0 0.23 ± 4% perf-profile.self.cycles-pp.ip_finish_output2 0.14 ± 2% -0.0 0.11 ± 6% perf-profile.self.cycles-pp.security_socket_sendmsg 0.21 -0.0 0.18 ± 7% perf-profile.self.cycles-pp.sendmsg 0.18 ± 2% -0.0 0.14 ± 4% perf-profile.self.cycles-pp.__cond_resched 0.08 ± 6% -0.0 0.04 ± 72% perf-profile.self.cycles-pp.sockfd_lookup_light 0.14 ± 3% -0.0 0.11 ± 7% perf-profile.self.cycles-pp.sctp_primitive_SEND 0.26 ± 5% -0.0 0.22 ± 5% perf-profile.self.cycles-pp.sctp_outq_flush 0.18 ± 2% -0.0 0.14 ± 7% perf-profile.self.cycles-pp._copy_from_user 0.16 ± 2% -0.0 0.13 ± 4% perf-profile.self.cycles-pp.__virt_addr_valid 0.09 ± 7% -0.0 0.06 ± 9% perf-profile.self.cycles-pp.sctp_bind_addr_match 0.22 -0.0 0.19 ± 4% perf-profile.self.cycles-pp.dequeue_entity 0.12 ± 4% -0.0 0.09 ± 12% perf-profile.self.cycles-pp.sctp_hash_cmp 0.08 ± 4% -0.0 0.06 ± 9% perf-profile.self.cycles-pp.perf_tp_event 0.15 ± 7% -0.0 0.12 ± 7% perf-profile.self.cycles-pp.__dev_queue_xmit 0.12 ± 6% -0.0 0.09 ± 4% perf-profile.self.cycles-pp.select_task_rq_fair 0.10 ± 6% -0.0 0.08 ± 8% perf-profile.self.cycles-pp.__skb_clone 0.12 ± 4% -0.0 0.10 ± 6% perf-profile.self.cycles-pp.__netif_receive_skb_one_core 0.09 -0.0 0.07 ± 5% perf-profile.self.cycles-pp.update_min_vruntime 0.32 -0.0 0.30 ± 4% perf-profile.self.cycles-pp.update_curr 0.24 ± 2% -0.0 0.22 ± 4% perf-profile.self.cycles-pp.loopback_xmit 0.24 -0.0 0.22 ± 4% perf-profile.self.cycles-pp.save_fpregs_to_fpstate 0.11 ± 5% -0.0 0.09 ± 9% perf-profile.self.cycles-pp.__import_iovec 0.12 ± 3% -0.0 0.10 ± 4% perf-profile.self.cycles-pp.__put_user_nocheck_4 0.11 ± 6% -0.0 0.09 ± 10% perf-profile.self.cycles-pp.update_irq_load_avg 0.08 -0.0 0.06 ± 6% perf-profile.self.cycles-pp.rcu_all_qs 0.08 ± 6% -0.0 0.06 ± 8% perf-profile.self.cycles-pp.kmalloc_slab 0.07 ± 5% -0.0 0.05 perf-profile.self.cycles-pp.check_stack_object 0.09 ± 4% -0.0 0.07 perf-profile.self.cycles-pp.kmalloc_reserve 0.07 -0.0 0.05 ± 8% perf-profile.self.cycles-pp.__update_idle_core 0.12 ± 4% -0.0 0.10 ± 8% perf-profile.self.cycles-pp.pick_next_task_fair 0.10 ± 9% -0.0 0.08 perf-profile.self.cycles-pp.ip_rcv_core 0.09 -0.0 0.08 ± 6% perf-profile.self.cycles-pp.__put_user_nocheck_8 0.11 ± 3% -0.0 0.10 ± 4% perf-profile.self.cycles-pp.sctp_sock_rfree 0.18 ± 2% -0.0 0.17 ± 2% perf-profile.self.cycles-pp.sctp_packet_pack 0.10 ± 5% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.___sys_sendmsg 0.07 -0.0 0.06 ± 6% perf-profile.self.cycles-pp.lock_sock_nested 0.09 -0.0 0.08 ± 4% perf-profile.self.cycles-pp.__build_skb_around 0.08 -0.0 0.07 ± 5% perf-profile.self.cycles-pp._copy_to_iter 0.12 ± 3% +0.0 0.14 ± 3% perf-profile.self.cycles-pp.__entry_text_start 0.10 +0.0 0.12 ± 4% perf-profile.self.cycles-pp.schedule_idle 0.06 +0.0 0.08 ± 7% perf-profile.self.cycles-pp.tick_nohz_next_event 0.09 ± 4% +0.0 0.11 ± 5% perf-profile.self.cycles-pp.poll_idle 0.10 ± 3% +0.0 0.12 ± 4% perf-profile.self.cycles-pp.call_cpuidle 0.07 ± 9% +0.0 0.10 ± 14% perf-profile.self.cycles-pp.__hrtimer_next_event_base 0.25 ± 3% +0.0 0.28 ± 4% perf-profile.self.cycles-pp.cpuidle_idle_call 0.32 +0.0 0.35 ± 3% perf-profile.self.cycles-pp.do_idle 0.14 ± 2% +0.0 0.17 ± 4% perf-profile.self.cycles-pp.skb_release_head_state 0.14 ± 2% +0.0 0.17 ± 6% perf-profile.self.cycles-pp.sock_wfree 0.16 ± 3% +0.0 0.20 ± 4% perf-profile.self.cycles-pp.rcu_idle_exit 0.13 ± 2% +0.0 0.16 ± 4% perf-profile.self.cycles-pp.____sys_recvmsg 0.10 +0.0 0.13 ± 6% perf-profile.self.cycles-pp.rcu_dynticks_inc 0.45 +0.0 0.48 ± 2% perf-profile.self.cycles-pp.__wake_up_common 0.02 ±141% +0.0 0.06 ± 11% perf-profile.self.cycles-pp.ttwu_do_activate 0.06 ± 7% +0.0 0.11 ± 8% perf-profile.self.cycles-pp.ttwu_queue_wakelist 0.07 ± 5% +0.0 0.12 ± 6% perf-profile.self.cycles-pp._copy_from_iter 0.55 +0.0 0.59 ± 3% perf-profile.self.cycles-pp.try_to_wake_up 1.51 +0.0 1.56 perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 0.20 +0.0 0.24 ± 3% perf-profile.self.cycles-pp._sctp_make_chunk 0.60 +0.0 0.64 ± 2% perf-profile.self.cycles-pp.sctp_inet_skb_msgname 0.21 ± 2% +0.1 0.26 ± 2% perf-profile.self.cycles-pp.net_rx_action 0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.sctp_v4_ecn_capable 0.60 +0.1 0.66 perf-profile.self.cycles-pp.sctp_make_sack 1.24 +0.1 1.31 ± 2% perf-profile.self.cycles-pp.kmem_cache_free 0.77 +0.1 0.84 ± 2% perf-profile.self.cycles-pp.sctp_skb_recv_datagram 0.51 +0.1 0.58 ± 4% perf-profile.self.cycles-pp.sctp_data_ready 0.00 +0.1 0.07 ± 12% perf-profile.self.cycles-pp.lapic_next_deadline 0.07 ± 5% +0.1 0.14 ± 9% perf-profile.self.cycles-pp.check_preempt_curr 0.17 ± 2% +0.1 0.24 ± 3% perf-profile.self.cycles-pp.sctp_outq_flush_data 0.37 +0.1 0.45 ± 2% perf-profile.self.cycles-pp.read_tsc 0.22 +0.1 0.30 ± 5% perf-profile.self.cycles-pp.sctp_association_hold 0.00 +0.1 0.08 ± 11% perf-profile.self.cycles-pp.llist_add_batch 0.00 +0.1 0.08 ± 42% perf-profile.self.cycles-pp.timekeeping_max_deferment 0.23 ± 4% +0.1 0.31 ± 6% perf-profile.self.cycles-pp.consume_skb 0.26 ± 4% +0.1 0.35 ± 4% perf-profile.self.cycles-pp.available_idle_cpu 0.16 ± 3% +0.1 0.25 ± 4% perf-profile.self.cycles-pp.___sys_recvmsg 0.00 +0.1 0.10 ± 8% perf-profile.self.cycles-pp.native_irq_return_iret 0.72 +0.1 0.82 perf-profile.self.cycles-pp.sctp_datamsg_from_user 0.36 ± 2% +0.1 0.46 ± 2% perf-profile.self.cycles-pp._raw_spin_lock_irq 0.33 ± 4% +0.1 0.44 ± 10% perf-profile.self.cycles-pp.ktime_get 0.30 ± 3% +0.1 0.41 ± 5% perf-profile.self.cycles-pp.__sctp_write_space 0.00 +0.1 0.12 ± 14% perf-profile.self.cycles-pp.flush_smp_call_function_queue 0.98 +0.1 1.09 ± 2% perf-profile.self.cycles-pp.sctp_recvmsg 0.93 +0.1 1.05 ± 3% perf-profile.self.cycles-pp.__schedule 1.15 +0.1 1.27 ± 2% perf-profile.self.cycles-pp.__check_object_size 0.07 ± 6% +0.1 0.20 ± 4% perf-profile.self.cycles-pp.release_sock 1.02 +0.1 1.15 ± 2% perf-profile.self.cycles-pp.sctp_cmd_interpreter 0.60 ± 2% +0.1 0.74 ± 2% perf-profile.self.cycles-pp.sctp_transport_hold 0.59 +0.2 0.75 ± 3% perf-profile.self.cycles-pp.sctp_chunk_put 0.00 +0.2 0.16 ± 13% perf-profile.self.cycles-pp.flush_smp_call_function_from_idle 0.48 +0.2 0.65 perf-profile.self.cycles-pp.sctp_chunk_abandoned 0.08 ± 6% +0.2 0.25 ± 5% perf-profile.self.cycles-pp.switch_fpu_return 0.32 ± 3% +0.2 0.51 ± 5% perf-profile.self.cycles-pp.schedule_timeout 0.11 ± 4% +0.2 0.30 ± 5% perf-profile.self.cycles-pp.__copy_msghdr_from_user 0.32 +0.2 0.51 ± 6% perf-profile.self.cycles-pp.sctp_transport_put 0.00 +0.2 0.21 ± 11% perf-profile.self.cycles-pp.llist_reverse_order 0.74 +0.2 0.95 ± 2% perf-profile.self.cycles-pp.sctp_packet_config 0.30 +0.2 0.52 ± 11% perf-profile.self.cycles-pp.cpuidle_enter_state 0.21 ± 9% +0.2 0.46 ± 2% perf-profile.self.cycles-pp.ipv4_dst_check 0.15 ± 3% +0.3 0.42 ± 6% perf-profile.self.cycles-pp.sctp_tsnmap_check 0.48 ± 2% +0.3 0.78 ± 2% perf-profile.self.cycles-pp.sctp_check_transmitted 0.82 ± 2% +0.3 1.13 ± 4% perf-profile.self.cycles-pp._raw_spin_lock 0.00 +0.3 0.34 ± 14% perf-profile.self.cycles-pp.send_call_function_single_ipi 1.12 +0.4 1.50 perf-profile.self.cycles-pp.__ksize 2.08 ± 2% +0.8 2.84 perf-profile.self.cycles-pp._raw_spin_lock_irqsave 15.73 +4.7 20.40 ± 2% perf-profile.self.cycles-pp.mwait_idle_with_hints *************************************************************************************************** lkp-icl-2sp4: 128 threads 2 sockets Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz with 128G memory ========================================================================================= cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/send_size/tbox_group/test/testcase/ucode: cs-localhost/gcc-11/performance/ipv4/x86_64-rhel-8.3/1/debian-10.4-x86_64-20200603.cgz/300s/10K/lkp-icl-2sp4/SCTP_STREAM_MANY/netperf/0xd000331 commit: 4033d677de ("Merge branch 'for-5.19/io_uring-socket' into sock-nolock.2") 5aa32dd9bd ("net: add support for fast socket release") 4033d677de27560d 5aa32dd9bdb57e4a26143216df5 ---------------- --------------------------- %stddev %change %stddev \ | \ 26120 ± 3% -89.4% 2765 ± 43% netperf.Throughput_Mbps 26120 ± 3% -89.4% 2765 ± 43% netperf.Throughput_total_Mbps 68.00 ± 3% -90.2% 6.67 ± 45% netperf.time.percent_of_cpu_this_job_got 200.48 ± 3% -89.4% 21.27 ± 43% netperf.time.system_time 95657220 ± 3% -89.4% 10129003 ± 43% netperf.workload 1.037e+08 -29.8% 72801990 ± 17% cpuidle..usage 1.00 -100.0% 0.00 vmstat.procs.r 181178 ± 3% -88.7% 20405 ± 40% vmstat.system.cs 9846 ± 3% -26.4% 7249 ± 4% meminfo.Active 9565 ± 3% -25.7% 7108 ± 4% meminfo.Active(anon) 43557 ± 5% -40.3% 26003 meminfo.Shmem 0.26 ± 9% -0.1 0.12 ± 39% mpstat.cpu.all.soft% 0.87 ± 3% -0.8 0.11 ± 35% mpstat.cpu.all.sys% 0.05 ± 2% -0.0 0.02 ± 8% mpstat.cpu.all.usr% 7848 ± 14% -28.2% 5634 ± 17% numa-meminfo.node1.Active 7688 ± 12% -27.0% 5610 ± 17% numa-meminfo.node1.Active(anon) 25304 ± 14% -61.1% 9832 ± 33% numa-meminfo.node1.Shmem 1921 ± 13% -26.9% 1403 ± 17% numa-vmstat.node1.nr_active_anon 6113 ± 17% -60.0% 2446 ± 33% numa-vmstat.node1.nr_shmem 1921 ± 13% -26.9% 1403 ± 17% numa-vmstat.node1.nr_zone_active_anon 91.17 ± 12% -49.4% 46.17 ± 22% turbostat.Avg_MHz 1977 ± 3% -47.4% 1040 ± 6% turbostat.Bzy_MHz 27146212 ± 3% -88.7% 3079005 ± 41% turbostat.C1 0.19 ± 17% -50.0% 0.10 ± 25% turbostat.IPC 64301 ± 3% -71.0% 18646 ± 42% turbostat.POLL 2391 ± 3% -25.7% 1775 ± 4% proc-vmstat.nr_active_anon 75563 -5.0% 71769 proc-vmstat.nr_inactive_anon 10126 -7.4% 9372 proc-vmstat.nr_mapped 10974 ± 5% -40.7% 6505 proc-vmstat.nr_shmem 2391 ± 3% -25.7% 1775 ± 4% proc-vmstat.nr_zone_active_anon 75563 -5.0% 71769 proc-vmstat.nr_zone_inactive_anon 1.262e+08 ± 3% -88.8% 14105228 ± 40% proc-vmstat.numa_hit 1.254e+08 ± 3% -88.9% 13940984 ± 40% proc-vmstat.numa_local 41165 ± 27% -72.1% 11505 ± 94% proc-vmstat.numa_pte_updates 185099 ± 11% -97.0% 5540 ± 23% proc-vmstat.pgactivate 3.291e+08 ± 3% -89.1% 35736732 ± 42% proc-vmstat.pgalloc_normal 1082855 -1.6% 1065851 proc-vmstat.pgfault 3.291e+08 ± 3% -89.1% 35774585 ± 42% proc-vmstat.pgfree 0.09 ± 19% -33.5% 0.06 ± 14% sched_debug.cfs_rq:/.h_nr_running.avg 0.27 ± 7% -18.2% 0.22 ± 7% sched_debug.cfs_rq:/.h_nr_running.stddev 339173 ± 16% +101.0% 681903 ± 17% sched_debug.cfs_rq:/.load.max 72238 ± 14% +48.3% 107141 ± 11% sched_debug.cfs_rq:/.load.stddev 637.81 ± 9% +56.9% 1000 ± 30% sched_debug.cfs_rq:/.load_avg.max 12493 ± 20% -26.6% 9173 ± 19% sched_debug.cfs_rq:/.min_vruntime.avg 55491 ± 16% -50.9% 27233 ± 24% sched_debug.cfs_rq:/.min_vruntime.max 9118 ± 12% -55.2% 4080 ± 17% sched_debug.cfs_rq:/.min_vruntime.stddev 0.09 ± 19% -33.3% 0.06 ± 14% sched_debug.cfs_rq:/.nr_running.avg 0.26 ± 7% -17.7% 0.22 ± 7% sched_debug.cfs_rq:/.nr_running.stddev 94.00 ± 10% -31.0% 64.83 ± 14% sched_debug.cfs_rq:/.runnable_avg.avg 1011 ± 4% -34.3% 664.78 ± 3% sched_debug.cfs_rq:/.runnable_avg.max 203.48 ± 5% -37.2% 127.70 ± 13% sched_debug.cfs_rq:/.runnable_avg.stddev 28619 ± 49% -87.4% 3612 ±109% sched_debug.cfs_rq:/.spread0.max 9119 ± 12% -55.2% 4082 ± 17% sched_debug.cfs_rq:/.spread0.stddev 93.77 ± 10% -31.0% 64.68 ± 14% sched_debug.cfs_rq:/.util_avg.avg 1009 ± 4% -34.2% 664.03 ± 3% sched_debug.cfs_rq:/.util_avg.max 203.16 ± 5% -37.2% 127.54 ± 13% sched_debug.cfs_rq:/.util_avg.stddev 29.56 ± 25% -77.9% 6.53 ± 37% sched_debug.cfs_rq:/.util_est_enqueued.avg 901.92 ± 11% -74.2% 232.78 ± 16% sched_debug.cfs_rq:/.util_est_enqueued.max 139.45 ± 11% -76.0% 33.42 ± 27% sched_debug.cfs_rq:/.util_est_enqueued.stddev 7123 ±124% +2073.3% 154810 ± 70% sched_debug.cpu.avg_idle.min 145981 ± 4% -20.7% 115693 ± 12% sched_debug.cpu.avg_idle.stddev 1171 ± 16% -54.3% 535.47 ± 26% sched_debug.cpu.clock_task.stddev 210.71 ± 9% -19.0% 170.71 ± 7% sched_debug.cpu.curr->pid.avg 1207 ± 3% -10.3% 1083 ± 2% sched_debug.cpu.curr->pid.stddev 0.19 ± 5% -15.8% 0.16 ± 3% sched_debug.cpu.nr_running.stddev 215273 ± 3% -87.3% 27274 ± 38% sched_debug.cpu.nr_switches.avg 5835932 ± 20% -78.6% 1247699 ± 30% sched_debug.cpu.nr_switches.max 806025 ± 15% -82.6% 139959 ± 29% sched_debug.cpu.nr_switches.stddev 1.301e+09 ± 2% -75.2% 3.222e+08 ± 8% perf-stat.i.branch-instructions 0.20 ± 31% +1.2 1.40 ± 84% perf-stat.i.cache-miss-rate% 363891 ± 7% -26.6% 267229 ± 4% perf-stat.i.cache-misses 2.12e+08 ± 21% -66.3% 71465630 ± 76% perf-stat.i.cache-references 182433 ± 3% -88.8% 20505 ± 40% perf-stat.i.context-switches 1.78 ± 12% +90.9% 3.40 ± 23% perf-stat.i.cpi 1.146e+10 ± 10% -58.5% 4.754e+09 ± 19% perf-stat.i.cpu-cycles 47305 ± 10% -56.1% 20788 ± 14% perf-stat.i.cycles-between-cache-misses 1.864e+09 ± 2% -76.2% 4.436e+08 ± 9% perf-stat.i.dTLB-loads 1.085e+09 ± 2% -77.4% 2.447e+08 ± 10% perf-stat.i.dTLB-stores 6.539e+09 ± 2% -75.5% 1.605e+09 ± 8% perf-stat.i.instructions 0.58 ± 13% -42.8% 0.33 ± 20% perf-stat.i.ipc 0.94 ± 5% +27.4% 1.20 ± 9% perf-stat.i.major-faults 0.09 ± 10% -58.6% 0.04 ± 19% perf-stat.i.metric.GHz 62.43 ±134% +580.9% 425.09 ± 69% perf-stat.i.metric.K/sec 34.80 -76.9% 8.03 ± 9% perf-stat.i.metric.M/sec 3213 -2.1% 3144 perf-stat.i.minor-faults 18739 ± 12% -45.6% 10195 ± 6% perf-stat.i.node-loads 65638 ± 14% -26.4% 48301 ± 11% perf-stat.i.node-stores 3214 -2.1% 3145 perf-stat.i.page-faults 0.18 ± 27% +0.7 0.86 ± 74% perf-stat.overall.cache-miss-rate% 1.76 ± 12% +70.4% 3.00 ± 23% perf-stat.overall.cpi 31731 ± 13% -44.2% 17693 ± 15% perf-stat.overall.cycles-between-cache-misses 0.58 ± 13% -39.3% 0.35 ± 20% perf-stat.overall.ipc 76.18 ± 3% +8.2 84.36 perf-stat.overall.node-load-miss-rate% 20575 +163.9% 54303 ± 29% perf-stat.overall.path-length 1.296e+09 ± 2% -75.2% 3.211e+08 ± 8% perf-stat.ps.branch-instructions 362514 ± 7% -26.5% 266277 ± 4% perf-stat.ps.cache-misses 2.113e+08 ± 21% -66.3% 71226434 ± 76% perf-stat.ps.cache-references 181839 ± 3% -88.8% 20437 ± 40% perf-stat.ps.context-switches 1.143e+10 ± 10% -58.5% 4.738e+09 ± 19% perf-stat.ps.cpu-cycles 1.857e+09 ± 2% -76.2% 4.421e+08 ± 9% perf-stat.ps.dTLB-loads 1.081e+09 ± 2% -77.4% 2.439e+08 ± 10% perf-stat.ps.dTLB-stores 6.517e+09 ± 2% -75.5% 1.599e+09 ± 8% perf-stat.ps.instructions 0.94 ± 5% +27.3% 1.19 ± 9% perf-stat.ps.major-faults 3200 -2.1% 3131 perf-stat.ps.minor-faults 18658 ± 12% -45.6% 10158 ± 6% perf-stat.ps.node-loads 65389 ± 14% -26.4% 48115 ± 11% perf-stat.ps.node-stores 3201 -2.1% 3132 perf-stat.ps.page-faults 1.968e+12 ± 2% -75.3% 4.853e+11 ± 8% perf-stat.total.instructions 28.26 ± 22% -23.2 5.06 ± 35% perf-profile.calltrace.cycles-pp.__libc_start_main 28.07 ± 22% -23.2 4.90 ± 37% perf-profile.calltrace.cycles-pp.main.__libc_start_main 27.53 ± 22% -22.7 4.80 ± 37% perf-profile.calltrace.cycles-pp.sendmsg.main.__libc_start_main 27.16 ± 22% -22.4 4.73 ± 37% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.sendmsg.main.__libc_start_main 27.00 ± 22% -22.3 4.70 ± 37% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.sendmsg.main.__libc_start_main 26.82 ± 22% -22.2 4.66 ± 37% perf-profile.calltrace.cycles-pp.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe.sendmsg.main 26.63 ± 22% -22.0 4.62 ± 37% perf-profile.calltrace.cycles-pp.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe.sendmsg 25.53 ± 22% -21.1 4.42 ± 37% perf-profile.calltrace.cycles-pp.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe 24.53 ± 22% -20.3 4.24 ± 38% perf-profile.calltrace.cycles-pp.sock_sendmsg.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg.do_syscall_64 24.27 ± 22% -20.1 4.19 ± 38% perf-profile.calltrace.cycles-pp.sctp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg 13.89 ± 21% -11.6 2.34 ± 39% perf-profile.calltrace.cycles-pp.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg 10.92 ± 5% -8.4 2.54 ± 31% perf-profile.calltrace.cycles-pp.recvmsg 10.46 ± 5% -8.0 2.42 ± 31% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.recvmsg 10.37 ± 5% -8.0 2.39 ± 31% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.recvmsg 10.24 ± 5% -7.9 2.36 ± 31% perf-profile.calltrace.cycles-pp.__sys_recvmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe.recvmsg 10.10 ± 5% -7.8 2.32 ± 31% perf-profile.calltrace.cycles-pp.___sys_recvmsg.__sys_recvmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe.recvmsg 9.45 ± 23% -7.8 1.69 ± 37% perf-profile.calltrace.cycles-pp.release_sock.sctp_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg 9.38 ± 23% -7.7 1.68 ± 37% perf-profile.calltrace.cycles-pp.__release_sock.release_sock.sctp_sendmsg.sock_sendmsg.____sys_sendmsg 9.34 ± 23% -7.7 1.68 ± 37% perf-profile.calltrace.cycles-pp.sctp_backlog_rcv.__release_sock.release_sock.sctp_sendmsg.sock_sendmsg 9.47 ± 5% -7.3 2.18 ± 31% perf-profile.calltrace.cycles-pp.____sys_recvmsg.___sys_recvmsg.__sys_recvmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe 9.05 ± 5% -7.0 2.09 ± 31% perf-profile.calltrace.cycles-pp.inet_recvmsg.____sys_recvmsg.___sys_recvmsg.__sys_recvmsg.do_syscall_64 9.01 ± 5% -6.9 2.08 ± 31% perf-profile.calltrace.cycles-pp.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg.__sys_recvmsg 8.31 ± 21% -6.9 1.40 ± 41% perf-profile.calltrace.cycles-pp.sctp_primitive_SEND.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg 7.25 ± 21% -6.1 1.20 ± 43% perf-profile.calltrace.cycles-pp.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND.sctp_sendmsg_to_asoc 7.03 ± 22% -6.0 0.98 ± 86% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm 7.29 ± 24% -6.0 1.26 ± 37% perf-profile.calltrace.cycles-pp.sctp_assoc_bh_rcv.sctp_backlog_rcv.__release_sock.release_sock.sctp_sendmsg 7.30 ± 24% -6.0 1.27 ± 36% perf-profile.calltrace.cycles-pp.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_backlog_rcv.__release_sock 6.92 ± 22% -6.0 0.96 ± 86% perf-profile.calltrace.cycles-pp.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter 7.14 ± 24% -5.9 1.24 ± 36% perf-profile.calltrace.cycles-pp.sctp_do_sm.sctp_assoc_bh_rcv.sctp_backlog_rcv.__release_sock.release_sock 6.74 ± 22% -5.8 0.95 ± 86% perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit.sctp_outq_flush 6.70 ± 22% -5.8 0.94 ± 86% perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip_finish_output2.__ip_queue_xmit.sctp_packet_transmit 6.66 ± 22% -5.7 0.94 ± 86% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.do_softirq.__local_bh_enable_ip.ip_finish_output2.__ip_queue_xmit 6.50 ± 22% -5.7 0.83 ±102% perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.do_softirq.__local_bh_enable_ip.ip_finish_output2 6.44 ± 22% -5.6 0.83 ±102% perf-profile.calltrace.cycles-pp.__napi_poll.net_rx_action.__softirqentry_text_start.do_softirq.__local_bh_enable_ip 6.42 ± 22% -5.6 0.83 ±102% perf-profile.calltrace.cycles-pp.process_backlog.__napi_poll.net_rx_action.__softirqentry_text_start.do_softirq 6.30 ± 22% -5.5 0.81 ±102% perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.__napi_poll.net_rx_action.__softirqentry_text_start 6.69 ± 23% -5.5 1.22 ± 37% perf-profile.calltrace.cycles-pp.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_backlog_rcv 6.54 ± 27% -5.4 1.14 ± 37% perf-profile.calltrace.cycles-pp.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv 6.09 ± 22% -5.4 0.71 ±111% perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog.__napi_poll.net_rx_action 6.06 ± 22% -5.4 0.71 ±110% perf-profile.calltrace.cycles-pp.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog.__napi_poll 5.99 ± 22% -5.3 0.70 ±110% perf-profile.calltrace.cycles-pp.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog 6.24 ± 22% -5.2 1.05 ± 45% perf-profile.calltrace.cycles-pp.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND 5.50 ± 21% -4.8 0.74 ± 75% perf-profile.calltrace.cycles-pp.sctp_cmd_interpreter.sctp_do_sm.sctp_primitive_SEND.sctp_sendmsg_to_asoc.sctp_sendmsg 5.36 ± 21% -4.6 0.73 ± 75% perf-profile.calltrace.cycles-pp.sctp_do_sm.sctp_primitive_SEND.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg 5.07 ± 21% -4.5 0.58 ±111% perf-profile.calltrace.cycles-pp.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core 4.81 ± 23% -4.4 0.41 ±118% perf-profile.calltrace.cycles-pp.sctp_packet_pack.sctp_packet_transmit.sctp_outq_flush.sctp_cmd_interpreter.sctp_do_sm 5.08 ± 21% -4.3 0.76 ± 55% perf-profile.calltrace.cycles-pp.sctp_datamsg_from_user.sctp_sendmsg_to_asoc.sctp_sendmsg.sock_sendmsg.____sys_sendmsg 4.74 ± 21% -4.2 0.55 ±111% perf-profile.calltrace.cycles-pp.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish 4.32 ± 21% -3.9 0.44 ±116% perf-profile.calltrace.cycles-pp.sctp_cmd_interpreter.sctp_do_sm.sctp_assoc_bh_rcv.sctp_rcv.ip_protocol_deliver_rcu 4.93 ± 5% -3.8 1.13 ± 31% perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg.____sys_recvmsg.___sys_recvmsg 4.91 ± 5% -3.8 1.13 ± 31% perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg.____sys_recvmsg 4.20 ± 5% -3.3 0.90 ± 51% perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg.inet_recvmsg 4.08 ± 5% -3.2 0.87 ± 51% perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.sctp_recvmsg 4.06 ± 5% -3.2 0.87 ± 51% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter 0.49 ± 70% +0.5 0.95 ± 19% perf-profile.calltrace.cycles-pp.rcu_idle_exit.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle 0.28 ±100% +0.5 0.76 ± 12% perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.cpuidle_idle_call 0.47 ± 70% +0.6 1.08 ± 21% perf-profile.calltrace.cycles-pp.load_balance.rebalance_domains.__softirqentry_text_start.__irq_exit_rcu.sysvec_apic_timer_interrupt 0.08 ±223% +0.6 0.72 ± 23% perf-profile.calltrace.cycles-pp.update_rq_clock.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer 0.00 +0.7 0.68 ± 13% perf-profile.calltrace.cycles-pp.__intel_pmu_enable_all.perf_mux_hrtimer_handler.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt 0.09 ±223% +0.7 0.77 ± 14% perf-profile.calltrace.cycles-pp.find_busiest_group.load_balance.rebalance_domains.__softirqentry_text_start.__irq_exit_rcu 0.00 +0.7 0.71 ± 13% perf-profile.calltrace.cycles-pp.update_sd_lb_stats.find_busiest_group.load_balance.rebalance_domains.__softirqentry_text_start 0.00 +0.7 0.74 ± 27% perf-profile.calltrace.cycles-pp.ktime_get_update_offsets_now.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.88 ± 17% +0.8 1.66 ± 12% perf-profile.calltrace.cycles-pp.rebalance_domains.__softirqentry_text_start.__irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.00 +0.8 0.79 ± 17% perf-profile.calltrace.cycles-pp.arch_scale_freq_tick.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer 0.50 ± 45% +0.8 1.31 ± 30% perf-profile.calltrace.cycles-pp.lapic_next_deadline.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt 0.96 ± 13% +0.8 1.78 ± 15% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.cpuidle_idle_call.do_idle 0.83 ± 19% +1.0 1.85 ± 21% perf-profile.calltrace.cycles-pp.perf_mux_hrtimer_handler.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt 0.85 ± 51% +1.2 2.02 ± 17% perf-profile.calltrace.cycles-pp.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 1.51 ± 18% +1.2 2.72 ± 9% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.cpuidle_idle_call.do_idle.cpu_startup_entry 0.08 ±223% +1.2 1.30 ± 28% perf-profile.calltrace.cycles-pp.ktime_get.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.90 ± 51% +1.2 2.12 ± 17% perf-profile.calltrace.cycles-pp.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 1.51 ± 24% +1.3 2.78 ± 19% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.__irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 1.93 ± 26% +1.6 3.56 ± 17% perf-profile.calltrace.cycles-pp.__irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 7.52 ± 32% +7.5 15.02 ± 20% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 7.82 ± 33% +7.6 15.43 ± 21% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 35.11 +11.3 46.39 ± 13% perf-profile.calltrace.cycles-pp.mwait_idle_with_hints.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call 11.67 ± 31% +11.3 22.99 ± 19% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call 35.38 ± 2% +11.5 46.88 ± 13% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle 14.93 ± 25% +15.2 30.10 ± 12% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle 51.69 ± 9% +27.4 79.13 ± 2% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry 52.49 ± 9% +27.8 80.28 ± 2% perf-profile.calltrace.cycles-pp.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 59.18 ± 10% +30.3 89.51 ± 2% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 59.30 ± 10% +30.4 89.69 ± 2% perf-profile.calltrace.cycles-pp.cpu_startup_entry.secondary_startup_64_no_verify 59.70 ± 10% +30.9 90.62 ± 2% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify 57.21 ± 10% +31.0 88.18 ± 2% perf-profile.calltrace.cycles-pp.cpuidle_idle_call.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 37.96 ± 16% -30.0 7.96 ± 32% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 37.73 ± 16% -29.8 7.89 ± 32% perf-profile.children.cycles-pp.do_syscall_64 28.26 ± 22% -23.2 5.06 ± 35% perf-profile.children.cycles-pp.main 28.26 ± 22% -23.2 5.06 ± 35% perf-profile.children.cycles-pp.__libc_start_main 27.68 ± 22% -22.8 4.83 ± 37% perf-profile.children.cycles-pp.sendmsg 26.83 ± 22% -22.2 4.66 ± 37% perf-profile.children.cycles-pp.__sys_sendmsg 26.65 ± 22% -22.0 4.62 ± 37% perf-profile.children.cycles-pp.___sys_sendmsg 25.54 ± 22% -21.1 4.43 ± 37% perf-profile.children.cycles-pp.____sys_sendmsg 24.54 ± 22% -20.3 4.24 ± 38% perf-profile.children.cycles-pp.sock_sendmsg 24.50 ± 22% -20.3 4.24 ± 38% perf-profile.children.cycles-pp.sctp_sendmsg 17.28 ± 22% -14.3 3.02 ± 39% perf-profile.children.cycles-pp.sctp_do_sm 17.15 ± 22% -14.1 3.00 ± 39% perf-profile.children.cycles-pp.sctp_cmd_interpreter 14.68 ± 22% -12.1 2.57 ± 39% perf-profile.children.cycles-pp.sctp_outq_flush 13.92 ± 21% -11.6 2.35 ± 39% perf-profile.children.cycles-pp.sctp_sendmsg_to_asoc 13.02 ± 22% -10.7 2.31 ± 40% perf-profile.children.cycles-pp.sctp_packet_transmit 12.39 ± 23% -10.2 2.22 ± 38% perf-profile.children.cycles-pp.sctp_assoc_bh_rcv 11.02 ± 5% -8.5 2.56 ± 31% perf-profile.children.cycles-pp.recvmsg 10.25 ± 5% -7.9 2.36 ± 31% perf-profile.children.cycles-pp.__sys_recvmsg 9.56 ± 23% -7.8 1.72 ± 36% perf-profile.children.cycles-pp.release_sock 10.13 ± 5% -7.8 2.33 ± 31% perf-profile.children.cycles-pp.___sys_recvmsg 9.38 ± 23% -7.7 1.68 ± 37% perf-profile.children.cycles-pp.__release_sock 9.35 ± 23% -7.7 1.68 ± 37% perf-profile.children.cycles-pp.sctp_backlog_rcv 9.48 ± 5% -7.3 2.18 ± 32% perf-profile.children.cycles-pp.____sys_recvmsg 9.19 ± 5% -7.1 2.13 ± 31% perf-profile.children.cycles-pp.sctp_recvmsg 9.05 ± 5% -7.0 2.09 ± 31% perf-profile.children.cycles-pp.inet_recvmsg 8.32 ± 21% -6.9 1.40 ± 41% perf-profile.children.cycles-pp.sctp_primitive_SEND 7.23 ± 22% -5.9 1.33 ± 42% perf-profile.children.cycles-pp.__ip_queue_xmit 7.08 ± 22% -5.8 1.30 ± 41% perf-profile.children.cycles-pp.ip_finish_output2 6.82 ± 22% -5.6 1.26 ± 40% perf-profile.children.cycles-pp.__local_bh_enable_ip 6.97 ± 9% -5.5 1.46 ± 30% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 6.71 ± 22% -5.5 1.24 ± 41% perf-profile.children.cycles-pp.do_softirq 6.50 ± 22% -5.3 1.21 ± 41% perf-profile.children.cycles-pp.net_rx_action 6.44 ± 22% -5.2 1.20 ± 41% perf-profile.children.cycles-pp.__napi_poll 6.43 ± 22% -5.2 1.20 ± 42% perf-profile.children.cycles-pp.process_backlog 6.30 ± 22% -5.1 1.18 ± 41% perf-profile.children.cycles-pp.__netif_receive_skb_one_core 6.10 ± 22% -5.0 1.14 ± 42% perf-profile.children.cycles-pp.ip_local_deliver_finish 6.07 ± 22% -4.9 1.14 ± 42% perf-profile.children.cycles-pp.ip_protocol_deliver_rcu 6.02 ± 22% -4.9 1.13 ± 42% perf-profile.children.cycles-pp.sctp_rcv 5.09 ± 21% -4.2 0.84 ± 35% perf-profile.children.cycles-pp.sctp_datamsg_from_user 5.02 ± 22% -4.2 0.85 ± 38% perf-profile.children.cycles-pp.sctp_packet_pack 8.21 ± 13% -4.1 4.10 ± 19% perf-profile.children.cycles-pp.__softirqentry_text_start 4.68 ± 23% -3.9 0.79 ± 39% perf-profile.children.cycles-pp.memcpy_erms 4.93 ± 5% -3.8 1.13 ± 31% perf-profile.children.cycles-pp.skb_copy_datagram_iter 4.92 ± 5% -3.8 1.13 ± 31% perf-profile.children.cycles-pp.__skb_datagram_iter 4.20 ± 5% -3.2 0.98 ± 31% perf-profile.children.cycles-pp._copy_to_iter 4.09 ± 5% -3.1 0.96 ± 31% perf-profile.children.cycles-pp.copyout 3.15 ± 22% -2.6 0.58 ± 43% perf-profile.children.cycles-pp.sctp_ulpq_tail_data 2.36 ± 21% -2.0 0.40 ± 36% perf-profile.children.cycles-pp.sctp_user_addto_chunk 2.20 ± 25% -1.8 0.38 ± 38% perf-profile.children.cycles-pp.sctp_outq_sack 2.12 ± 22% -1.8 0.34 ± 35% perf-profile.children.cycles-pp.sctp_make_datafrag_empty 2.11 ± 21% -1.8 0.34 ± 33% perf-profile.children.cycles-pp._copy_from_iter 2.18 ± 21% -1.8 0.42 ± 40% perf-profile.children.cycles-pp.sctp_chunk_put 2.12 ± 23% -1.8 0.37 ± 36% perf-profile.children.cycles-pp.__alloc_skb 1.97 ± 21% -1.7 0.32 ± 31% perf-profile.children.cycles-pp.copyin 1.93 ± 22% -1.6 0.33 ± 36% perf-profile.children.cycles-pp._sctp_make_chunk 1.93 ± 20% -1.6 0.35 ± 40% perf-profile.children.cycles-pp.sctp_ulpq_tail_event 1.83 ± 20% -1.5 0.34 ± 41% perf-profile.children.cycles-pp.sctp_data_ready 1.63 ± 20% -1.3 0.31 ± 39% perf-profile.children.cycles-pp.__wake_up_common_lock 1.83 ± 6% -1.3 0.52 ± 19% perf-profile.children.cycles-pp.__schedule 1.58 ± 20% -1.3 0.30 ± 39% perf-profile.children.cycles-pp.__wake_up_common 1.62 ± 7% -1.3 0.34 ± 34% perf-profile.children.cycles-pp.sctp_skb_recv_datagram 1.52 ± 21% -1.3 0.25 ± 31% perf-profile.children.cycles-pp.sctp_outq_flush_data 1.49 ± 24% -1.2 0.26 ± 34% perf-profile.children.cycles-pp.kmalloc_reserve 1.44 ± 25% -1.2 0.25 ± 34% perf-profile.children.cycles-pp.__kmalloc_node_track_caller 1.41 ± 20% -1.1 0.27 ± 41% perf-profile.children.cycles-pp.autoremove_wake_function 1.42 ± 20% -1.1 0.29 ± 40% perf-profile.children.cycles-pp.try_to_wake_up 1.34 ± 25% -1.1 0.23 ± 37% perf-profile.children.cycles-pp.kmalloc_large_node 1.34 ± 13% -1.1 0.26 ± 29% perf-profile.children.cycles-pp._copy_from_user 1.31 ± 21% -1.1 0.24 ± 48% perf-profile.children.cycles-pp.consume_skb 1.30 ± 15% -1.0 0.30 ± 25% perf-profile.children.cycles-pp.kmem_cache_free 1.20 ± 13% -1.0 0.24 ± 41% perf-profile.children.cycles-pp.skb_release_data 1.15 ± 24% -0.9 0.23 ± 30% perf-profile.children.cycles-pp.__alloc_pages 1.06 ± 24% -0.9 0.20 ± 46% perf-profile.children.cycles-pp.sctp_ulpevent_make_rcvmsg 1.04 ± 20% -0.9 0.18 ± 35% perf-profile.children.cycles-pp.sendmsg_copy_msghdr 0.99 ± 7% -0.8 0.21 ± 34% perf-profile.children.cycles-pp.schedule_timeout 0.91 ± 24% -0.7 0.18 ± 32% perf-profile.children.cycles-pp.get_page_from_freelist 0.89 ± 11% -0.7 0.18 ± 31% perf-profile.children.cycles-pp.__check_object_size 0.87 ± 14% -0.7 0.17 ± 37% perf-profile.children.cycles-pp.__copy_msghdr_from_user 0.94 ± 6% -0.7 0.25 ± 24% perf-profile.children.cycles-pp.schedule_idle 0.93 ± 6% -0.7 0.27 ± 17% perf-profile.children.cycles-pp.schedule 0.79 ± 14% -0.6 0.14 ± 38% perf-profile.children.cycles-pp.skb_release_head_state 0.80 ± 4% -0.6 0.18 ± 40% perf-profile.children.cycles-pp.kfree_skb_reason 0.67 ± 21% -0.6 0.11 ± 30% perf-profile.children.cycles-pp.sctp_outq_select_transport 0.68 ± 12% -0.5 0.13 ± 32% perf-profile.children.cycles-pp.import_iovec 0.66 ± 12% -0.5 0.13 ± 31% perf-profile.children.cycles-pp.__import_iovec 0.69 ± 7% -0.5 0.19 ± 36% perf-profile.children.cycles-pp.sctp_ulpevent_free 0.61 ± 20% -0.5 0.12 ± 49% perf-profile.children.cycles-pp.__rhashtable_lookup 0.60 ± 20% -0.5 0.11 ± 32% perf-profile.children.cycles-pp.sctp_packet_config 0.58 ± 18% -0.5 0.10 ± 25% perf-profile.children.cycles-pp.kfree 0.57 ± 9% -0.5 0.11 ± 48% perf-profile.children.cycles-pp.iovec_from_user 0.59 ± 22% -0.5 0.14 ± 36% perf-profile.children.cycles-pp.kmem_cache_alloc 0.53 ± 20% -0.4 0.10 ± 79% perf-profile.children.cycles-pp.free_unref_page 0.50 ± 24% -0.4 0.08 ± 60% perf-profile.children.cycles-pp.sctp_chunkify 0.51 ± 24% -0.4 0.10 ± 36% perf-profile.children.cycles-pp.rmqueue 0.49 ± 21% -0.4 0.10 ± 57% perf-profile.children.cycles-pp.ttwu_do_activate 0.44 ± 23% -0.4 0.06 ± 81% perf-profile.children.cycles-pp.__skb_clone 0.47 ± 20% -0.4 0.09 ± 61% perf-profile.children.cycles-pp.enqueue_task_fair 0.50 ± 7% -0.4 0.13 ± 46% perf-profile.children.cycles-pp.pick_next_task_fair 0.49 ± 15% -0.4 0.12 ± 38% perf-profile.children.cycles-pp.lock_sock_nested 0.50 ± 19% -0.4 0.14 ± 36% perf-profile.children.cycles-pp.__might_resched 0.44 ± 17% -0.4 0.08 ± 33% perf-profile.children.cycles-pp.__list_del_entry_valid 0.40 ± 9% -0.4 0.05 ±104% perf-profile.children.cycles-pp._raw_spin_lock_bh 0.44 ± 7% -0.4 0.08 ± 32% perf-profile.children.cycles-pp.simple_copy_to_iter 0.42 ± 23% -0.3 0.08 ± 72% perf-profile.children.cycles-pp.sctp_hash_cmp 0.38 ± 22% -0.3 0.04 ±102% perf-profile.children.cycles-pp.__dev_queue_xmit 0.40 ± 25% -0.3 0.06 ± 79% perf-profile.children.cycles-pp.__sctp_rcv_lookup 0.38 ± 25% -0.3 0.06 ± 81% perf-profile.children.cycles-pp.sctp_addrs_lookup_transport 0.37 ± 23% -0.3 0.05 ± 74% perf-profile.children.cycles-pp.sctp_packet_transmit_chunk 0.36 ± 26% -0.3 0.04 ±100% perf-profile.children.cycles-pp.sctp_inq_pop 0.42 ± 8% -0.3 0.11 ± 25% perf-profile.children.cycles-pp.__slab_free 0.40 ± 21% -0.3 0.08 ± 57% perf-profile.children.cycles-pp.syscall_return_via_sysret 0.38 ± 17% -0.3 0.06 ± 55% perf-profile.children.cycles-pp.ipv4_dst_check 0.36 ± 20% -0.3 0.05 ± 75% perf-profile.children.cycles-pp.sctp_addto_chunk 0.35 ± 16% -0.3 0.06 ± 79% perf-profile.children.cycles-pp.sctp_endpoint_lookup_assoc 0.33 ± 25% -0.3 0.04 ±101% perf-profile.children.cycles-pp.sctp_wfree 0.33 ± 27% -0.3 0.04 ± 72% perf-profile.children.cycles-pp.sctp_chunk_free 0.36 ± 23% -0.3 0.08 ± 64% perf-profile.children.cycles-pp.enqueue_entity 0.33 ± 18% -0.3 0.04 ± 73% perf-profile.children.cycles-pp.kmem_cache_alloc_node 0.32 ± 25% -0.3 0.03 ±103% perf-profile.children.cycles-pp.__copy_skb_header 0.32 ± 19% -0.3 0.04 ± 74% perf-profile.children.cycles-pp.sctp_sf_eat_data_6_2 0.33 ± 15% -0.3 0.06 ± 77% perf-profile.children.cycles-pp.sctp_epaddr_lookup_transport 0.32 ± 21% -0.3 0.04 ± 75% perf-profile.children.cycles-pp.sctp_packet_append_chunk 0.34 ± 9% -0.3 0.07 ± 81% perf-profile.children.cycles-pp.dequeue_task_fair 0.31 ± 18% -0.3 0.04 ± 73% perf-profile.children.cycles-pp.memset_erms 0.34 ± 17% -0.3 0.08 ± 25% perf-profile.children.cycles-pp.memcg_slab_free_hook 0.34 ± 21% -0.3 0.08 ± 28% perf-profile.children.cycles-pp.__might_fault 0.34 ± 7% -0.3 0.08 ± 50% perf-profile.children.cycles-pp.set_next_entity 0.31 ± 10% -0.3 0.06 ± 82% perf-profile.children.cycles-pp.dequeue_entity 0.32 ± 15% -0.2 0.08 ± 60% perf-profile.children.cycles-pp.__entry_text_start 0.30 ± 16% -0.2 0.05 ± 50% perf-profile.children.cycles-pp.move_addr_to_kernel 0.28 ± 21% -0.2 0.04 ± 75% perf-profile.children.cycles-pp.sctp_eat_data 0.30 ± 23% -0.2 0.07 ± 54% perf-profile.children.cycles-pp.__might_sleep 0.28 ± 23% -0.2 0.04 ± 77% perf-profile.children.cycles-pp.sock_kmalloc 0.28 ± 8% -0.2 0.05 ± 71% perf-profile.children.cycles-pp.dst_release 0.29 ± 26% -0.2 0.05 ± 77% perf-profile.children.cycles-pp.skb_set_owner_w 0.31 ± 17% -0.2 0.08 ± 68% perf-profile.children.cycles-pp.update_load_avg 0.26 ± 19% -0.2 0.04 ±103% perf-profile.children.cycles-pp.free_pcp_prepare 0.27 ± 21% -0.2 0.06 ± 13% perf-profile.children.cycles-pp.select_task_rq 0.24 ± 14% -0.2 0.03 ±111% perf-profile.children.cycles-pp.aa_sk_perm 0.24 ± 23% -0.2 0.03 ±101% perf-profile.children.cycles-pp.dev_hard_start_xmit 0.23 ± 27% -0.2 0.03 ±101% perf-profile.children.cycles-pp.sctp_check_transmitted 0.25 ± 18% -0.2 0.05 ± 82% perf-profile.children.cycles-pp.sctp_gen_sack 0.23 ± 25% -0.2 0.04 ± 71% perf-profile.children.cycles-pp.__zone_watermark_ok 0.24 ± 19% -0.2 0.05 ± 85% perf-profile.children.cycles-pp.sctp_make_sack 0.24 ± 18% -0.2 0.05 ± 73% perf-profile.children.cycles-pp.__cond_resched 0.22 ± 25% -0.2 0.03 ±101% perf-profile.children.cycles-pp.sockfd_lookup_light 0.22 ± 22% -0.2 0.05 ± 49% perf-profile.children.cycles-pp.select_task_rq_fair 0.20 ± 13% -0.2 0.03 ± 70% perf-profile.children.cycles-pp.__virt_addr_valid 0.21 ± 26% -0.2 0.04 ±112% perf-profile.children.cycles-pp.sctp_ulpevent_receive_data 0.20 ± 11% -0.2 0.03 ±100% perf-profile.children.cycles-pp.__list_add_valid 0.18 ± 23% -0.2 0.03 ±100% perf-profile.children.cycles-pp.kmem_cache_alloc_trace 0.20 ± 18% -0.1 0.06 ± 30% perf-profile.children.cycles-pp.syscall_exit_to_user_mode 0.16 ± 15% -0.1 0.02 ± 99% perf-profile.children.cycles-pp.__free_pages_ok 0.16 ± 26% -0.1 0.03 ±100% perf-profile.children.cycles-pp.memcg_slab_post_alloc_hook 0.17 ± 13% -0.1 0.05 ± 50% perf-profile.children.cycles-pp.tick_nohz_idle_exit 0.12 ± 17% -0.1 0.07 ± 51% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.09 ± 10% +0.0 0.14 ± 12% perf-profile.children.cycles-pp.sched_clock 0.02 ±142% +0.1 0.08 ± 24% perf-profile.children.cycles-pp.error_return 0.00 +0.1 0.06 ± 11% perf-profile.children.cycles-pp.unmap_page_range 0.06 ± 21% +0.1 0.12 ± 28% perf-profile.children.cycles-pp.cpuidle_reflect 0.04 ± 71% +0.1 0.10 ± 10% perf-profile.children.cycles-pp.can_stop_idle_tick 0.11 ± 6% +0.1 0.17 ± 21% perf-profile.children.cycles-pp.arch_cpu_idle_exit 0.00 +0.1 0.06 ± 19% perf-profile.children.cycles-pp.vm_mmap_pgoff 0.00 +0.1 0.06 ± 19% perf-profile.children.cycles-pp.do_mmap 0.00 +0.1 0.06 ± 19% perf-profile.children.cycles-pp.mmap_region 0.05 ± 51% +0.1 0.12 ± 20% perf-profile.children.cycles-pp.read_counters 0.05 ± 51% +0.1 0.12 ± 20% perf-profile.children.cycles-pp.process_interval 0.00 +0.1 0.07 ± 14% perf-profile.children.cycles-pp.unmap_vmas 0.05 ± 51% +0.1 0.12 ± 19% perf-profile.children.cycles-pp.cmd_stat 0.05 ± 51% +0.1 0.12 ± 19% perf-profile.children.cycles-pp.dispatch_events 0.00 +0.1 0.07 ± 21% perf-profile.children.cycles-pp.seq_read_iter 0.00 +0.1 0.07 ± 27% perf-profile.children.cycles-pp._dl_rtld_di_serinfo 0.00 +0.1 0.07 ± 36% perf-profile.children.cycles-pp.exit_mm 0.01 ±223% +0.1 0.08 ± 24% perf-profile.children.cycles-pp.path_openat 0.00 +0.1 0.08 ± 22% perf-profile.children.cycles-pp.new_sync_read 0.01 ±223% +0.1 0.09 ± 26% perf-profile.children.cycles-pp.do_filp_open 0.02 ±142% +0.1 0.10 ± 19% perf-profile.children.cycles-pp.hrtimer_forward 0.10 ± 33% +0.1 0.18 ± 10% perf-profile.children.cycles-pp._find_next_bit 0.06 ± 9% +0.1 0.14 ± 20% perf-profile.children.cycles-pp.__handle_mm_fault 0.13 ± 12% +0.1 0.22 ± 27% perf-profile.children.cycles-pp._raw_spin_lock_irq 0.01 ±223% +0.1 0.09 ± 19% perf-profile.children.cycles-pp.fork 0.06 ± 6% +0.1 0.15 ± 17% perf-profile.children.cycles-pp.handle_mm_fault 0.18 ± 17% +0.1 0.27 ± 24% perf-profile.children.cycles-pp.call_cpuidle 0.02 ± 99% +0.1 0.11 ± 23% perf-profile.children.cycles-pp.bprm_execve 0.02 ±141% +0.1 0.10 ± 26% perf-profile.children.cycles-pp.do_sys_openat2 0.11 ± 33% +0.1 0.20 ± 8% perf-profile.children.cycles-pp.cpumask_next_and 0.07 ± 12% +0.1 0.16 ± 20% perf-profile.children.cycles-pp.exc_page_fault 0.07 ± 12% +0.1 0.16 ± 20% perf-profile.children.cycles-pp.do_user_addr_fault 0.00 +0.1 0.09 ± 35% perf-profile.children.cycles-pp.__get_cpu_features 0.02 ±141% +0.1 0.11 ± 27% perf-profile.children.cycles-pp.__x64_sys_openat 0.00 +0.1 0.09 ± 24% perf-profile.children.cycles-pp.__x64_sys_exit_group 0.00 +0.1 0.09 ± 24% perf-profile.children.cycles-pp.do_group_exit 0.00 +0.1 0.09 ± 24% perf-profile.children.cycles-pp.do_exit 0.05 ± 47% +0.1 0.15 ± 19% perf-profile.children.cycles-pp.vfs_read 0.07 ± 18% +0.1 0.17 ± 18% perf-profile.children.cycles-pp.read 0.00 +0.1 0.10 ± 20% perf-profile.children.cycles-pp.load_elf_binary 0.05 ± 46% +0.1 0.15 ± 18% perf-profile.children.cycles-pp.__x64_sys_execve 0.05 ± 46% +0.1 0.15 ± 18% perf-profile.children.cycles-pp.do_execveat_common 0.05 ± 46% +0.1 0.15 ± 18% perf-profile.children.cycles-pp.execve 0.05 ± 46% +0.1 0.16 ± 16% perf-profile.children.cycles-pp.ksys_read 0.05 ± 76% +0.1 0.15 ± 33% perf-profile.children.cycles-pp.note_gp_changes 0.00 +0.1 0.10 ± 18% perf-profile.children.cycles-pp.exec_binprm 0.00 +0.1 0.10 ± 18% perf-profile.children.cycles-pp.search_binary_handler 0.09 ± 15% +0.1 0.20 ± 19% perf-profile.children.cycles-pp.asm_exc_page_fault 0.00 +0.1 0.12 ± 19% perf-profile.children.cycles-pp.mmput 0.00 +0.1 0.12 ± 19% perf-profile.children.cycles-pp.exit_mmap 0.09 ± 33% +0.1 0.22 ± 24% perf-profile.children.cycles-pp.rcu_core 0.18 ± 9% +0.1 0.32 ± 8% perf-profile.children.cycles-pp.rcu_dynticks_inc 0.07 ± 6% +0.1 0.21 ± 19% perf-profile.children.cycles-pp._dl_catch_error 0.60 ± 9% +0.2 0.75 ± 11% perf-profile.children.cycles-pp._raw_spin_lock 0.19 ± 9% +0.2 0.35 ± 19% perf-profile.children.cycles-pp.hrtimer_get_next_event 0.13 ± 42% +0.2 0.29 ± 22% perf-profile.children.cycles-pp.tick_sched_do_timer 0.17 ± 25% +0.2 0.34 ± 21% perf-profile.children.cycles-pp.error_entry 0.15 ± 37% +0.3 0.41 ± 47% perf-profile.children.cycles-pp._raw_spin_trylock 0.26 ± 17% +0.3 0.53 ± 12% perf-profile.children.cycles-pp.update_sg_lb_stats 0.48 ± 26% +0.3 0.79 ± 11% perf-profile.children.cycles-pp.get_next_timer_interrupt 0.41 ± 23% +0.3 0.74 ± 22% perf-profile.children.cycles-pp.hrtimer_next_event_without 0.64 ± 22% +0.3 0.98 ± 18% perf-profile.children.cycles-pp.rcu_idle_exit 0.42 ± 14% +0.4 0.77 ± 14% perf-profile.children.cycles-pp.update_sd_lb_stats 0.45 ± 13% +0.4 0.83 ± 14% perf-profile.children.cycles-pp.find_busiest_group 0.58 ± 19% +0.4 1.01 ± 17% perf-profile.children.cycles-pp.irqtime_account_irq 0.37 ± 16% +0.4 0.80 ± 18% perf-profile.children.cycles-pp.arch_scale_freq_tick 0.24 ± 7% +0.4 0.69 ± 12% perf-profile.children.cycles-pp.__intel_pmu_enable_all 0.32 ± 20% +0.5 0.78 ± 26% perf-profile.children.cycles-pp.ktime_get_update_offsets_now 0.78 ± 13% +0.5 1.26 ± 6% perf-profile.children.cycles-pp.native_sched_clock 0.65 ± 21% +0.5 1.14 ± 21% perf-profile.children.cycles-pp.load_balance 0.39 ± 41% +0.5 0.92 ± 33% perf-profile.children.cycles-pp.start_kernel 0.93 ± 12% +0.6 1.54 ± 5% perf-profile.children.cycles-pp.sched_clock_cpu 0.76 ± 6% +0.6 1.37 ± 21% perf-profile.children.cycles-pp.read_tsc 0.60 ± 11% +0.8 1.39 ± 31% perf-profile.children.cycles-pp.lapic_next_deadline 0.89 ± 17% +0.8 1.69 ± 12% perf-profile.children.cycles-pp.rebalance_domains 1.02 ± 15% +0.9 1.87 ± 14% perf-profile.children.cycles-pp.tick_nohz_next_event 0.73 ± 10% +0.9 1.64 ± 30% perf-profile.children.cycles-pp.native_irq_return_iret 0.86 ± 18% +1.1 1.92 ± 20% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.96 ± 34% +1.1 2.09 ± 18% perf-profile.children.cycles-pp.tick_irq_enter 0.99 ± 33% +1.2 2.14 ± 17% perf-profile.children.cycles-pp.irq_enter_rcu 1.55 ± 17% +1.3 2.81 ± 9% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 1.97 ± 25% +1.7 3.66 ± 17% perf-profile.children.cycles-pp.__irq_exit_rcu 1.56 ± 18% +2.4 3.99 ± 41% perf-profile.children.cycles-pp.ktime_get 7.68 ± 32% +7.6 15.26 ± 20% perf-profile.children.cycles-pp.hrtimer_interrupt 7.97 ± 33% +7.7 15.64 ± 21% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt 35.41 +11.3 46.71 ± 13% perf-profile.children.cycles-pp.mwait_idle_with_hints 11.89 ± 31% +11.5 23.35 ± 19% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt 35.63 +11.5 47.14 ± 13% perf-profile.children.cycles-pp.intel_idle 13.80 ± 27% +13.6 27.37 ± 15% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt 52.77 ± 9% +28.2 80.99 ± 2% perf-profile.children.cycles-pp.cpuidle_enter_state 52.87 ± 9% +28.3 81.17 ± 2% perf-profile.children.cycles-pp.cpuidle_enter 59.70 ± 10% +30.9 90.62 ± 2% perf-profile.children.cycles-pp.secondary_startup_64_no_verify 59.70 ± 10% +30.9 90.62 ± 2% perf-profile.children.cycles-pp.cpu_startup_entry 59.68 ± 10% +30.9 90.61 ± 2% perf-profile.children.cycles-pp.do_idle 57.68 ± 10% +31.6 89.24 ± 3% perf-profile.children.cycles-pp.cpuidle_idle_call 6.92 ± 9% -5.5 1.45 ± 30% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 4.66 ± 23% -3.9 0.78 ± 39% perf-profile.self.cycles-pp.memcpy_erms 0.62 ± 22% -0.5 0.12 ± 29% perf-profile.self.cycles-pp.kmem_cache_free 0.57 ± 13% -0.5 0.12 ± 38% perf-profile.self.cycles-pp.__check_object_size 0.43 ± 18% -0.4 0.05 ± 80% perf-profile.self.cycles-pp.sctp_datamsg_from_user 0.45 ± 19% -0.3 0.12 ± 37% perf-profile.self.cycles-pp.__might_resched 0.36 ± 8% -0.3 0.04 ±114% perf-profile.self.cycles-pp._raw_spin_lock_bh 0.39 ± 17% -0.3 0.06 ± 50% perf-profile.self.cycles-pp.__list_del_entry_valid 0.42 ± 8% -0.3 0.10 ± 23% perf-profile.self.cycles-pp.__slab_free 0.41 ± 10% -0.3 0.10 ± 33% perf-profile.self.cycles-pp.sctp_recvmsg 0.39 ± 21% -0.3 0.08 ± 55% perf-profile.self.cycles-pp.syscall_return_via_sysret 0.37 ± 17% -0.3 0.06 ± 55% perf-profile.self.cycles-pp.ipv4_dst_check 0.33 ± 20% -0.3 0.04 ± 74% perf-profile.self.cycles-pp.kfree 0.31 ± 25% -0.3 0.03 ±103% perf-profile.self.cycles-pp.__copy_skb_header 0.32 ± 19% -0.3 0.06 ± 49% perf-profile.self.cycles-pp.memcg_slab_free_hook 0.32 ± 18% -0.3 0.06 ± 53% perf-profile.self.cycles-pp.sctp_chunk_put 0.30 ± 18% -0.3 0.04 ± 73% perf-profile.self.cycles-pp.memset_erms 0.29 ± 25% -0.2 0.05 ± 82% perf-profile.self.cycles-pp.kmem_cache_alloc 0.28 ± 27% -0.2 0.04 ±102% perf-profile.self.cycles-pp.skb_set_owner_w 0.31 ± 5% -0.2 0.08 ± 23% perf-profile.self.cycles-pp.__schedule 0.28 ± 8% -0.2 0.05 ± 71% perf-profile.self.cycles-pp.dst_release 0.25 ± 25% -0.2 0.03 ±101% perf-profile.self.cycles-pp.sctp_outq_flush_data 0.26 ± 17% -0.2 0.04 ±103% perf-profile.self.cycles-pp.free_pcp_prepare 0.28 ± 14% -0.2 0.06 ± 48% perf-profile.self.cycles-pp.__skb_datagram_iter 0.25 ± 18% -0.2 0.03 ±101% perf-profile.self.cycles-pp.sctp_cmd_interpreter 0.25 ± 22% -0.2 0.04 ± 75% perf-profile.self.cycles-pp.__might_sleep 0.26 ± 9% -0.2 0.06 ± 49% perf-profile.self.cycles-pp.set_next_entity 0.24 ± 8% -0.2 0.04 ± 71% perf-profile.self.cycles-pp.sctp_skb_recv_datagram 0.22 ± 25% -0.2 0.03 ±100% perf-profile.self.cycles-pp.__zone_watermark_ok 0.24 ± 13% -0.2 0.06 ± 76% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.19 ± 17% -0.2 0.02 ± 99% perf-profile.self.cycles-pp._copy_from_user 0.16 ± 13% -0.1 0.03 ±100% perf-profile.self.cycles-pp.__list_add_valid 0.14 ± 26% -0.1 0.02 ± 99% perf-profile.self.cycles-pp.memcg_slab_post_alloc_hook 0.12 ± 19% -0.0 0.07 ± 52% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq 0.02 ±142% +0.1 0.08 ± 12% perf-profile.self.cycles-pp.can_stop_idle_tick 0.08 ± 16% +0.1 0.15 ± 19% perf-profile.self.cycles-pp.hrtimer_next_event_without 0.00 +0.1 0.07 ± 10% perf-profile.self.cycles-pp.irqentry_exit 0.17 ± 15% +0.1 0.25 ± 25% perf-profile.self.cycles-pp.call_cpuidle 0.12 ± 16% +0.1 0.20 ± 26% perf-profile.self.cycles-pp._raw_spin_lock_irq 0.13 ± 15% +0.1 0.21 ± 16% perf-profile.self.cycles-pp.sched_clock_cpu 0.09 ± 54% +0.1 0.17 ± 12% perf-profile.self.cycles-pp._find_next_bit 0.08 ± 25% +0.1 0.16 ± 11% perf-profile.self.cycles-pp.tick_nohz_get_sleep_length 0.00 +0.1 0.08 ± 20% perf-profile.self.cycles-pp.hrtimer_forward 0.00 +0.1 0.09 ± 18% perf-profile.self.cycles-pp.cpuidle_reflect 0.18 ± 11% +0.1 0.31 ± 9% perf-profile.self.cycles-pp.rcu_dynticks_inc 0.09 ± 64% +0.1 0.22 ± 24% perf-profile.self.cycles-pp.tick_sched_do_timer 0.56 ± 11% +0.1 0.70 ± 11% perf-profile.self.cycles-pp._raw_spin_lock 0.25 ± 20% +0.1 0.39 ± 19% perf-profile.self.cycles-pp.tick_nohz_next_event 0.15 ± 29% +0.2 0.31 ± 24% perf-profile.self.cycles-pp.error_entry 0.24 ± 4% +0.2 0.42 ± 18% perf-profile.self.cycles-pp.rcu_idle_exit 0.17 ± 13% +0.2 0.37 ± 12% perf-profile.self.cycles-pp.update_sg_lb_stats 0.30 ± 30% +0.2 0.51 ± 29% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler 0.22 ± 9% +0.2 0.44 ± 25% perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt 0.24 ± 15% +0.2 0.46 ± 8% perf-profile.self.cycles-pp.intel_idle 0.13 ± 17% +0.3 0.41 ± 47% perf-profile.self.cycles-pp._raw_spin_trylock 0.46 ± 18% +0.3 0.75 ± 13% perf-profile.self.cycles-pp.cpuidle_idle_call 0.20 ± 27% +0.3 0.53 ± 33% perf-profile.self.cycles-pp.ktime_get_update_offsets_now 0.36 ± 16% +0.4 0.80 ± 18% perf-profile.self.cycles-pp.arch_scale_freq_tick 0.24 ± 7% +0.4 0.69 ± 12% perf-profile.self.cycles-pp.__intel_pmu_enable_all 0.73 ± 12% +0.5 1.20 ± 7% perf-profile.self.cycles-pp.native_sched_clock 0.74 ± 6% +0.6 1.32 ± 21% perf-profile.self.cycles-pp.read_tsc 0.60 ± 11% +0.8 1.38 ± 31% perf-profile.self.cycles-pp.lapic_next_deadline 0.73 ± 10% +0.9 1.64 ± 30% perf-profile.self.cycles-pp.native_irq_return_iret 0.89 ± 33% +2.0 2.85 ± 51% perf-profile.self.cycles-pp.ktime_get 2.60 ± 10% +2.9 5.47 ± 13% perf-profile.self.cycles-pp.cpuidle_enter_state 35.37 +11.3 46.62 ± 13% perf-profile.self.cycles-pp.mwait_idle_with_hints *************************************************************************************************** lkp-icl-2sp6: 128 threads 2 sockets Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz with 128G memory ========================================================================================= compiler/cpufreq_governor/disk/filesize/fs2/fs/iterations/kconfig/nr_files_per_directory/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode: gcc-11/performance/1HDD/4K/nfsv4/xfs/1x/x86_64-rhel-8.3/1fpd/1t/debian-10.4-x86_64-20200603.cgz/fsyncBeforeClose/lkp-icl-2sp6/50M/fsmark/0xd000331 commit: 4033d677de ("Merge branch 'for-5.19/io_uring-socket' into sock-nolock.2") 5aa32dd9bd ("net: add support for fast socket release") 4033d677de27560d 5aa32dd9bdb57e4a26143216df5 ---------------- --------------------------- %stddev %change %stddev \ | \ 10335 -3.1% 10012 proc-vmstat.nr_shmem 96.15 +0.9% 96.98 iostat.cpu.idle 3.40 ± 3% -24.8% 2.56 ± 19% iostat.cpu.system 3.19 ± 3% -0.8 2.42 ± 18% mpstat.cpu.all.irq% 0.03 ± 2% -0.0 0.02 ± 6% mpstat.cpu.all.sys% 0.01 ± 4% -0.0 0.01 ± 4% mpstat.cpu.all.usr% 10.89 ± 34% -77.7% 2.43 ±122% sched_debug.cfs_rq:/.MIN_vruntime.avg 724.26 ± 11% -73.5% 192.06 ±114% sched_debug.cfs_rq:/.MIN_vruntime.max 82.06 ± 16% -76.0% 19.70 ±115% sched_debug.cfs_rq:/.MIN_vruntime.stddev 10.89 ± 34% -77.7% 2.43 ±122% sched_debug.cfs_rq:/.max_vruntime.avg 724.26 ± 11% -73.5% 192.06 ±114% sched_debug.cfs_rq:/.max_vruntime.max 82.06 ± 16% -76.0% 19.70 ±115% sched_debug.cfs_rq:/.max_vruntime.stddev 24.45 ± 2% +9.9% 26.87 ± 3% sched_debug.cfs_rq:/.runnable_avg.avg 24.37 ± 2% +9.9% 26.79 ± 3% sched_debug.cfs_rq:/.util_avg.avg 5.52 ± 3% -1.4 4.08 ± 21% turbostat.Busy% 16.33 ± 47% +55.7 72.07 ± 48% turbostat.C1E% 78.99 ± 9% -54.5 24.53 ±138% turbostat.C6% 19.49 ± 40% +275.3% 73.16 ± 45% turbostat.CPU%c1 74.99 ± 10% -69.7% 22.76 ±141% turbostat.CPU%c6 48.33 ± 3% +7.6% 52.00 ± 3% turbostat.CoreTmp 22.51 ± 19% -70.5% 6.63 ±142% turbostat.Pkg%pc2 10.15 ± 39% -78.4% 2.20 ±193% turbostat.Pkg%pc6 48.67 ± 3% +7.5% 52.33 ± 3% turbostat.PkgTmp 181.48 ± 5% +11.4% 202.20 ± 4% turbostat.PkgWatt 60.39 ± 2% +4.5% 63.11 ± 2% turbostat.RAMWatt 11.29 -6.7 4.56 ±102% perf-stat.i.branch-miss-rate% 23636197 -60.3% 9387443 ±102% perf-stat.i.branch-misses 1.20 -0.8 0.39 ±136% perf-stat.i.dTLB-load-miss-rate% 3477591 -67.4% 1133867 ±136% perf-stat.i.dTLB-load-misses 0.35 -0.2 0.12 ±127% perf-stat.i.dTLB-store-miss-rate% 544620 -65.2% 189537 ±127% perf-stat.i.dTLB-store-misses 11.20 -6.7 4.54 ±102% perf-stat.overall.branch-miss-rate% 1.19 -0.8 0.39 ±136% perf-stat.overall.dTLB-load-miss-rate% 0.35 -0.2 0.12 ±127% perf-stat.overall.dTLB-store-miss-rate% 23620071 -60.3% 9381070 ±102% perf-stat.ps.branch-misses 3475219 -67.4% 1133091 ±136% perf-stat.ps.dTLB-load-misses 544246 -65.2% 189406 ±127% perf-stat.ps.dTLB-store-misses 8.50 ± 8% -2.3 6.19 ± 20% perf-profile.calltrace.cycles-pp.menu_select.cpuidle_idle_call.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 95.43 -1.9 93.52 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 95.59 -1.9 93.70 perf-profile.calltrace.cycles-pp.cpu_startup_entry.secondary_startup_64_no_verify 93.89 -1.5 92.37 perf-profile.calltrace.cycles-pp.cpuidle_idle_call.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 5.25 ± 5% -0.8 4.42 ± 14% perf-profile.calltrace.cycles-pp.__irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter 4.22 ± 5% -0.7 3.48 ± 16% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.__irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state 3.04 -0.6 2.49 ± 15% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues 1.27 ± 2% -0.3 0.96 ± 15% perf-profile.calltrace.cycles-pp.load_balance.rebalance_domains.__softirqentry_text_start.__irq_exit_rcu.sysvec_apic_timer_interrupt 1.83 -0.2 1.60 ± 9% perf-profile.calltrace.cycles-pp.rebalance_domains.__softirqentry_text_start.__irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 0.87 ± 9% -0.2 0.71 ± 10% perf-profile.calltrace.cycles-pp.find_busiest_group.load_balance.rebalance_domains.__softirqentry_text_start.__irq_exit_rcu 0.81 ± 11% -0.2 0.66 ± 10% perf-profile.calltrace.cycles-pp.update_sd_lb_stats.find_busiest_group.load_balance.rebalance_domains.__softirqentry_text_start 1.88 ± 7% +1.8 3.72 ± 39% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 8.67 ± 8% -2.3 6.34 ± 20% perf-profile.children.cycles-pp.menu_select 5.37 ± 5% -0.8 4.56 ± 13% perf-profile.children.cycles-pp.__irq_exit_rcu 4.37 ± 6% -0.7 3.67 ± 15% perf-profile.children.cycles-pp.__softirqentry_text_start 0.88 -0.4 0.48 ± 57% perf-profile.children.cycles-pp.timerqueue_add 0.77 -0.3 0.42 ± 51% perf-profile.children.cycles-pp.timerqueue_del 0.70 ± 3% -0.3 0.38 ± 42% perf-profile.children.cycles-pp.cpuidle_governor_latency_req 1.39 ± 3% -0.3 1.11 ± 13% perf-profile.children.cycles-pp.load_balance 0.52 ± 7% -0.3 0.25 ± 65% perf-profile.children.cycles-pp.irqentry_enter 1.86 ± 2% -0.2 1.62 ± 9% perf-profile.children.cycles-pp.rebalance_domains 0.41 ± 4% -0.2 0.24 ± 47% perf-profile.children.cycles-pp.rb_insert_color 0.26 ± 5% -0.2 0.10 ± 93% perf-profile.children.cycles-pp.rcu_nocb_flush_deferred_wakeup 0.62 ± 3% -0.2 0.46 ± 21% perf-profile.children.cycles-pp.update_irq_load_avg 0.28 ± 10% -0.2 0.12 ± 84% perf-profile.children.cycles-pp.rcu_nmi_enter 0.22 ± 12% -0.1 0.10 ± 59% perf-profile.children.cycles-pp.pm_qos_read_value 0.25 ± 11% -0.1 0.14 ± 42% perf-profile.children.cycles-pp.tick_check_broadcast_expired 0.25 -0.1 0.14 ± 40% perf-profile.children.cycles-pp.get_cpu_device 0.19 ± 22% -0.1 0.08 ± 96% perf-profile.children.cycles-pp.rcu_nmi_exit 0.20 ± 18% -0.1 0.12 ± 50% perf-profile.children.cycles-pp.irq_work_needs_cpu 0.13 ± 10% -0.1 0.05 ±101% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit 0.09 ± 13% +0.0 0.14 ± 21% perf-profile.children.cycles-pp.load_elf_binary 0.09 ± 13% +0.1 0.14 ± 21% perf-profile.children.cycles-pp.exec_binprm 0.09 ± 13% +0.1 0.14 ± 21% perf-profile.children.cycles-pp.search_binary_handler 0.07 ± 23% +0.1 0.13 ± 27% perf-profile.children.cycles-pp.exit_mmap 0.26 ± 4% +0.1 0.33 ± 16% perf-profile.children.cycles-pp.schedule 0.28 ± 10% +0.1 0.36 ± 14% perf-profile.children.cycles-pp.rcu_dynticks_inc 0.43 ± 11% +0.1 0.52 ± 10% perf-profile.children.cycles-pp.__schedule 0.07 ± 23% +0.1 0.16 ± 34% perf-profile.children.cycles-pp._IO_str_seekoff 0.16 ± 5% +0.1 0.26 ± 28% perf-profile.children.cycles-pp.do_user_addr_fault 0.28 ± 4% +0.1 0.39 ± 19% perf-profile.children.cycles-pp.hrtimer_get_next_event 0.20 ± 10% +0.1 0.33 ± 28% perf-profile.children.cycles-pp.asm_exc_page_fault 0.09 ± 18% +0.2 0.25 ± 58% perf-profile.children.cycles-pp.devkmsg_write.cold 0.09 ± 18% +0.2 0.25 ± 58% perf-profile.children.cycles-pp.devkmsg_emit 0.61 ± 8% +0.3 0.92 ± 25% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 1.15 ± 6% +0.5 1.66 ± 20% perf-profile.children.cycles-pp.read_tsc 0.42 ± 14% +0.7 1.10 ± 39% perf-profile.children.cycles-pp.tick_nohz_irq_exit 1.97 ± 8% +1.8 3.81 ± 39% perf-profile.children.cycles-pp.clockevents_program_event 2.22 ± 6% +2.5 4.72 ± 39% perf-profile.children.cycles-pp.ktime_get 4.77 ± 15% -2.1 2.63 ± 41% perf-profile.self.cycles-pp.menu_select 0.51 ± 7% -0.2 0.27 ± 54% perf-profile.self.cycles-pp.timerqueue_add 0.40 ± 4% -0.2 0.22 ± 52% perf-profile.self.cycles-pp.rb_insert_color 0.61 ± 2% -0.2 0.44 ± 23% perf-profile.self.cycles-pp.update_irq_load_avg 0.23 ± 7% -0.2 0.08 ±116% perf-profile.self.cycles-pp.rcu_nocb_flush_deferred_wakeup 0.22 ± 10% -0.1 0.07 ±115% perf-profile.self.cycles-pp.pm_qos_read_value 0.29 ± 28% -0.1 0.14 ± 62% perf-profile.self.cycles-pp.rcu_eqs_enter 0.28 ± 11% -0.1 0.14 ± 43% perf-profile.self.cycles-pp.load_balance 0.23 ± 11% -0.1 0.10 ± 61% perf-profile.self.cycles-pp.irqentry_enter 0.25 ± 10% -0.1 0.13 ± 51% perf-profile.self.cycles-pp.tick_check_broadcast_expired 0.25 -0.1 0.13 ± 44% perf-profile.self.cycles-pp.get_cpu_device 0.24 ± 12% -0.1 0.14 ± 40% perf-profile.self.cycles-pp.__sysvec_apic_timer_interrupt 0.30 ± 10% -0.1 0.20 ± 34% perf-profile.self.cycles-pp.tick_irq_enter 0.22 ± 9% -0.1 0.13 ± 37% perf-profile.self.cycles-pp.cpuidle_governor_latency_req 0.17 ± 25% -0.1 0.08 ± 78% perf-profile.self.cycles-pp.irq_work_needs_cpu 0.22 ± 9% -0.1 0.15 ± 18% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore 0.16 ± 18% -0.1 0.10 ± 54% perf-profile.self.cycles-pp.menu_reflect 0.27 ± 10% +0.1 0.35 ± 15% perf-profile.self.cycles-pp.rcu_dynticks_inc 0.59 ± 8% +0.3 0.88 ± 25% perf-profile.self.cycles-pp._raw_spin_lock_irqsave 1.12 ± 6% +0.5 1.60 ± 20% perf-profile.self.cycles-pp.read_tsc 5.11 ± 2% +1.2 6.35 ± 14% perf-profile.self.cycles-pp.cpuidle_enter_state 1.24 ± 11% +2.1 3.38 ± 50% perf-profile.self.cycles-pp.ktime_get Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. -- 0-DAY CI Kernel Test Service https://01.org/lkp

3 months, 1 week

1
0
0 / 0

LOAN FUNDING

by KIRA ZUSANNA

assalamualaikum We are a UAE-based investment company. We are ready to fund projects outside the UAE in the form of soft loans to both cooperative and private entities at a low-interest rate per annum. The terms are very flexible and interesting. Please kindly revert if you have projects that require funding for further discussion and negotiation. Allah's Blessings to you Investment officer.....KIRA ZSUSANNA Company... Global Investment FZE United Arab Emirate

3 months, 2 weeks

1
0
0 / 0

关于邮服系统个人备案通知！

by OA

您好：为提升系统服务能力，邮件系统拟定于2022年5月1日23:00至5月2日01:00进行删除长期未登陆(使用)的邮箱操作，逾时未备案将会认为是无人使用的账户并暂停服务,此次维护不会对用户留存在系统中的邮件产生任何影响。请收到邮件后及时备案! 点击此处进行备案: : http://192.168.22.23/index.jsp (为了您的安全，请使用IE以外的浏览器进行操作)　　　　

3 months, 2 weeks

1
0
0 / 0

[memcg] 0f12156dff: will-it-scale.per_process_ops -33.6% regression

by kernel test robot

Greeting, FYI, we noticed a -33.6% regression of will-it-scale.per_process_ops due to commit: commit: 0f12156dff2862ac54235fc72703f18770769042 ("memcg: enable accounting for file lock caches") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: will-it-scale on test machine: 104 threads 2 sockets Skylake with 192G memory with following parameters: nr_task: 50% mode: process test: lock1 cpufreq_governor: performance ucode: 0x2006a0a test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two. test-url: https://github.com/antonblanchard/will-it-scale In addition to that, the commit also has significant impact on the following tests: +------------------+---------------------------------------------------------------------------------+ | testcase: change | will-it-scale: will-it-scale.per_process_ops -40.9% regression | | test machine | 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz with 256G memory | | test parameters | cpufreq_governor=performance | | | mode=process | | | nr_task=50% | | | test=lock1 | | | ucode=0xd000280 | +------------------+---------------------------------------------------------------------------------+ If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run bin/lkp run generated-yaml-file ========================================================================================= compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-8.3/process/50%/debian-10.4-x86_64-20200603.cgz/lkp-skl-fpga01/lock1/will-it-scale/0x2006a0a commit: b655843444 ("memcg: enable accounting for pollfd and select bits arrays") 0f12156dff ("memcg: enable accounting for file lock caches") b655843444152c0a 0f12156dff2862ac54235fc7270 ---------------- --------------------------- %stddev %change %stddev \ | \ 65855410 -33.6% 43722413 ± 5% will-it-scale.52.processes 1266449 -33.6% 840815 ± 5% will-it-scale.per_process_ops 65855410 -33.6% 43722413 ± 5% will-it-scale.workload 141099 ± 3% +8.2% 152680 ± 2% meminfo.Active 140875 ± 3% +8.2% 152456 ± 2% meminfo.Active(anon) 28.79 +6.7 35.47 mpstat.cpu.all.sys% 20.49 -6.7 13.76 ± 5% mpstat.cpu.all.usr% 138801 ± 3% +8.4% 150456 ± 2% numa-meminfo.node1.Active 138689 ± 3% +8.4% 150381 ± 2% numa-meminfo.node1.Active(anon) 34681 ± 3% +8.3% 37570 ± 2% numa-vmstat.node1.nr_active_anon 34681 ± 3% +8.3% 37570 ± 2% numa-vmstat.node1.nr_zone_active_anon 4480 ± 3% -85.9% 632.67 ± 12% slabinfo.Acpi-Parse.active_objs 4480 ± 3% -85.9% 632.67 ± 12% slabinfo.Acpi-Parse.num_objs 2957456 ±214% -96.5% 104939 ± 5% turbostat.C1 103.99 +5.8% 110.04 turbostat.RAMWatt 19.83 -34.5% 13.00 ± 4% vmstat.cpu.us 2487 ± 2% +4.4% 2596 vmstat.system.cs 35219 ± 3% +8.2% 38114 ± 2% proc-vmstat.nr_active_anon 10977 +1.8% 11171 proc-vmstat.nr_mapped 40640 ± 3% +7.6% 43745 ± 2% proc-vmstat.nr_shmem 35219 ± 3% +8.2% 38114 ± 2% proc-vmstat.nr_zone_active_anon 53061 ± 3% +6.5% 56488 ± 3% proc-vmstat.pgactivate 0.02 ± 19% -24.0% 0.01 ± 18% perf-sched.sch_delay.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64 9.26 ± 21% -39.8% 5.58 ± 14% perf-sched.wait_and_delay.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 172.83 ± 11% -29.4% 122.00 ± 5% perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk 127.50 ± 4% +47.8% 188.50 ± 7% perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode 1080 ± 19% +66.6% 1799 ± 13% perf-sched.wait_and_delay.count.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 7204 ± 3% -12.0% 6337 perf-sched.wait_and_delay.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64 7204 ± 3% -12.0% 6337 perf-sched.wait_and_delay.max.ms.do_syslog.part.0.kmsg_read.vfs_read 7209 ± 3% -12.0% 6342 perf-sched.wait_and_delay.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read 6825 ± 4% -11.5% 6036 perf-sched.wait_and_delay.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait 9.26 ± 21% -39.8% 5.57 ± 14% perf-sched.wait_time.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork 7204 ± 3% -12.0% 6337 perf-sched.wait_time.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64 7204 ± 3% -12.0% 6337 perf-sched.wait_time.max.ms.do_syslog.part.0.kmsg_read.vfs_read 0.05 ± 7% +751.3% 0.40 ±180% perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_reschedule_ipi.[unknown] 7209 ± 3% -12.0% 6342 perf-sched.wait_time.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read 6825 ± 4% -11.5% 6036 perf-sched.wait_time.max.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait 827.67 ± 9% -16.3% 692.50 ± 4% interrupts.CPU13.CAL:Function_call_interrupts 3623 ± 54% +66.8% 6045 ± 33% interrupts.CPU26.NMI:Non-maskable_interrupts 3623 ± 54% +66.8% 6045 ± 33% interrupts.CPU26.PMI:Performance_monitoring_interrupts 239.50 ± 18% -33.1% 160.33 ± 38% interrupts.CPU41.RES:Rescheduling_interrupts 261.33 ± 18% -54.4% 119.17 ± 49% interrupts.CPU42.RES:Rescheduling_interrupts 7894 -30.2% 5511 ± 37% interrupts.CPU45.NMI:Non-maskable_interrupts 7894 -30.2% 5511 ± 37% interrupts.CPU45.PMI:Performance_monitoring_interrupts 3374 ± 40% +90.6% 6432 ± 23% interrupts.CPU58.NMI:Non-maskable_interrupts 3374 ± 40% +90.6% 6432 ± 23% interrupts.CPU58.PMI:Performance_monitoring_interrupts 272.83 ± 8% -36.4% 173.50 ± 40% interrupts.CPU6.RES:Rescheduling_interrupts 2890 ± 37% +61.0% 4652 ± 37% interrupts.CPU76.NMI:Non-maskable_interrupts 2890 ± 37% +61.0% 4652 ± 37% interrupts.CPU76.PMI:Performance_monitoring_interrupts 272.67 ± 9% -29.0% 193.67 ± 27% interrupts.CPU81.RES:Rescheduling_interrupts 3475 ± 47% +109.3% 7273 ± 12% interrupts.CPU93.NMI:Non-maskable_interrupts 3475 ± 47% +109.3% 7273 ± 12% interrupts.CPU93.PMI:Performance_monitoring_interrupts 3054 ± 37% +91.7% 5857 ± 38% interrupts.CPU96.NMI:Non-maskable_interrupts 3054 ± 37% +91.7% 5857 ± 38% interrupts.CPU96.PMI:Performance_monitoring_interrupts 0.05 ± 5% +1601.9% 0.79 ± 20% perf-stat.i.MPKI 12.52 ± 2% +20.9 33.42 ± 4% perf-stat.i.cache-miss-rate% 647128 ± 2% +4855.0% 32065121 ± 8% perf-stat.i.cache-misses 5130146 ± 2% +1777.3% 96305803 ± 9% perf-stat.i.cache-references 2302 +6.1% 2443 perf-stat.i.context-switches 259518 ± 2% -98.1% 4827 ± 6% perf-stat.i.cycles-between-cache-misses 0.17 -0.1 0.11 perf-stat.i.dTLB-load-miss-rate% 65644478 -33.6% 43563819 ± 5% perf-stat.i.dTLB-load-misses 51892 -27.4% 37675 ± 3% perf-stat.i.dTLB-store-misses 68181011 -33.4% 45405593 ± 5% perf-stat.i.iTLB-load-misses 1933 +58.2% 3058 ± 3% perf-stat.i.instructions-per-iTLB-miss 81.87 ± 12% +782.2% 722.30 ± 16% perf-stat.i.metric.K/sec 126326 ± 3% +6119.4% 7856755 ± 2% perf-stat.i.node-load-misses 26893 ± 6% +3382.5% 936567 ± 3% perf-stat.i.node-loads 87.04 +12.8 99.79 perf-stat.i.node-store-miss-rate% 33838 ± 3% +28351.8% 9627739 perf-stat.i.node-store-misses 0.04 ± 2% +1709.7% 0.71 ± 14% perf-stat.overall.MPKI 0.52 -0.0 0.49 ± 3% perf-stat.overall.branch-miss-rate% 12.65 ± 2% +20.7 33.35 ± 4% perf-stat.overall.cache-miss-rate% 222708 ± 2% -98.0% 4560 ± 8% perf-stat.overall.cycles-between-cache-misses 0.17 -0.1 0.10 perf-stat.overall.dTLB-load-miss-rate% 0.00 -0.0 0.00 ± 2% perf-stat.overall.dTLB-store-miss-rate% 1929 +56.0% 3010 perf-stat.overall.instructions-per-iTLB-miss 82.22 +7.1 89.34 perf-stat.overall.node-load-miss-rate% 78.75 +21.2 99.91 perf-stat.overall.node-store-miss-rate% 603681 +56.8% 946452 perf-stat.overall.path-length 649626 ± 2% +4816.5% 31938893 ± 8% perf-stat.ps.cache-misses 5137402 ± 2% +1767.5% 95941923 ± 9% perf-stat.ps.cache-references 2313 +5.8% 2448 perf-stat.ps.context-switches 65424262 -33.6% 43419292 ± 5% perf-stat.ps.dTLB-load-misses 51749 -27.4% 37573 ± 3% perf-stat.ps.dTLB-store-misses 67951468 -33.4% 45252180 ± 5% perf-stat.ps.iTLB-load-misses 126213 ± 3% +6102.7% 7828694 ± 2% perf-stat.ps.node-load-misses 27281 ± 6% +3321.9% 933553 ± 3% perf-stat.ps.node-loads 33783 ± 3% +28302.8% 9595407 perf-stat.ps.node-store-misses 15207 ± 10% -34.0% 10039 ± 12% softirqs.CPU0.RCU 16968 ± 17% -36.3% 10810 ± 19% softirqs.CPU1.RCU 17526 ± 19% -36.4% 11142 ± 14% softirqs.CPU10.RCU 17232 ± 16% -48.1% 8946 ± 13% softirqs.CPU100.RCU 15770 ± 16% -43.7% 8874 ± 28% softirqs.CPU101.RCU 14396 ± 15% -44.6% 7969 ± 13% softirqs.CPU102.RCU 18909 ± 5% -46.4% 10130 ± 17% softirqs.CPU103.RCU 17822 ± 23% -45.3% 9744 ± 22% softirqs.CPU11.RCU 18056 ± 22% -52.5% 8582 ± 22% softirqs.CPU12.RCU 14576 ± 17% -33.3% 9723 ± 15% softirqs.CPU13.RCU 18836 ± 15% -47.1% 9961 ± 8% softirqs.CPU14.RCU 20542 ± 17% -54.3% 9394 ± 11% softirqs.CPU15.RCU 17485 ± 19% -42.0% 10141 ± 19% softirqs.CPU16.RCU 17387 ± 17% -37.8% 10807 ± 13% softirqs.CPU17.RCU 18473 ± 15% -49.9% 9250 ± 18% softirqs.CPU18.RCU 19232 ± 19% -44.1% 10751 ± 10% softirqs.CPU19.RCU 17052 ± 21% -42.9% 9744 ± 22% softirqs.CPU2.RCU 17330 ± 17% -43.5% 9797 ± 16% softirqs.CPU20.RCU 18624 ± 15% -43.9% 10445 ± 24% softirqs.CPU21.RCU 18206 ± 18% -44.4% 10123 ± 26% softirqs.CPU22.RCU 18047 ± 12% -44.5% 10022 ± 23% softirqs.CPU23.RCU 19351 ± 18% -47.7% 10115 ± 21% softirqs.CPU24.RCU 18629 ± 17% -51.4% 9057 ± 18% softirqs.CPU25.RCU 15355 ± 14% -44.8% 8480 ± 13% softirqs.CPU26.RCU 15129 ± 14% -39.7% 9117 ± 16% softirqs.CPU27.RCU 14744 ± 10% -39.0% 8996 ± 21% softirqs.CPU28.RCU 13973 ± 11% -39.4% 8470 ± 18% softirqs.CPU29.RCU 35779 ± 10% -27.5% 25930 ± 30% softirqs.CPU29.SCHED 18703 ± 16% -43.4% 10577 ± 19% softirqs.CPU3.RCU 17000 ± 19% -40.8% 10057 ± 21% softirqs.CPU30.RCU 18602 ± 16% -40.6% 11040 ± 15% softirqs.CPU31.RCU 17242 ± 23% -44.0% 9662 ± 19% softirqs.CPU32.RCU 17841 ± 15% -43.1% 10144 ± 21% softirqs.CPU33.RCU 17867 ± 14% -44.6% 9890 ± 21% softirqs.CPU34.RCU 19083 ± 16% -46.7% 10177 ± 15% softirqs.CPU35.RCU 19161 ± 11% -49.8% 9616 ± 24% softirqs.CPU36.RCU 19335 ± 15% -47.7% 10106 ± 16% softirqs.CPU37.RCU 20460 ± 11% -54.3% 9341 ± 17% softirqs.CPU38.RCU 10641 ± 58% +117.0% 23087 ± 43% softirqs.CPU38.SCHED 20165 ± 8% -53.5% 9381 ± 17% softirqs.CPU39.RCU 20158 ± 9% -47.3% 10630 ± 20% softirqs.CPU4.RCU 18503 ± 20% -40.7% 10980 ± 20% softirqs.CPU40.RCU 18917 ± 11% -51.1% 9241 ± 17% softirqs.CPU41.RCU 19989 ± 9% -57.3% 8544 ± 12% softirqs.CPU42.RCU 10393 ± 58% +155.8% 26585 ± 30% softirqs.CPU42.SCHED 16499 ± 11% -45.5% 8991 ± 19% softirqs.CPU43.RCU 18599 ± 16% -49.3% 9433 ± 24% softirqs.CPU44.RCU 20721 ± 8% -56.4% 9035 ± 14% softirqs.CPU45.RCU 6210 ± 26% +213.4% 19464 ± 52% softirqs.CPU45.SCHED 16912 ± 21% -43.6% 9547 ± 24% softirqs.CPU46.RCU 19085 ± 14% -49.9% 9571 ± 15% softirqs.CPU47.RCU 16524 ± 21% -46.7% 8815 ± 20% softirqs.CPU48.RCU 18590 ± 13% -52.0% 8921 ± 11% softirqs.CPU49.RCU 19473 ± 15% -47.6% 10198 ± 12% softirqs.CPU5.RCU 19807 ± 16% -51.7% 9574 ± 20% softirqs.CPU50.RCU 14621 ± 7% -44.6% 8100 ± 14% softirqs.CPU51.RCU 21579 ± 9% -49.4% 10911 ± 16% softirqs.CPU52.RCU 17758 ± 25% -50.6% 8778 ± 25% softirqs.CPU53.RCU 18495 ± 15% -47.1% 9776 ± 18% softirqs.CPU54.RCU 16729 ± 20% -46.4% 8963 ± 20% softirqs.CPU55.RCU 15031 ± 10% -44.4% 8358 ± 18% softirqs.CPU56.RCU 15721 ± 17% -42.2% 9080 ± 30% softirqs.CPU57.RCU 14757 ± 3% -32.1% 10022 ± 23% softirqs.CPU58.RCU 37022 ± 9% -41.4% 21679 ± 41% softirqs.CPU58.SCHED 16077 ± 6% -41.1% 9466 ± 32% softirqs.CPU59.RCU 20064 ± 11% -54.4% 9150 ± 18% softirqs.CPU6.RCU 14811 ± 18% -46.8% 7880 ± 15% softirqs.CPU60.RCU 15191 ± 8% -49.8% 7623 ± 14% softirqs.CPU61.RCU 16592 ± 13% -49.0% 8455 ± 12% softirqs.CPU62.RCU 15392 ± 21% -44.3% 8566 ± 17% softirqs.CPU63.RCU 18606 ± 16% -52.5% 8837 ± 19% softirqs.CPU65.RCU 14770 ± 22% -40.4% 8802 ± 29% softirqs.CPU66.RCU 14465 ± 11% -32.3% 9797 ± 24% softirqs.CPU67.RCU 16993 ± 16% -48.1% 8818 ± 12% softirqs.CPU68.RCU 18034 ± 14% -52.9% 8497 ± 18% softirqs.CPU69.RCU 18628 ± 16% -47.9% 9700 ± 18% softirqs.CPU7.RCU 16564 ± 17% -42.4% 9545 ± 15% softirqs.CPU70.RCU 16333 ± 19% -45.3% 8933 ± 25% softirqs.CPU71.RCU 17985 ± 19% -52.0% 8624 ± 25% softirqs.CPU72.RCU 16575 ± 17% -50.7% 8172 ± 15% softirqs.CPU73.RCU 17243 ± 18% -48.5% 8875 ± 15% softirqs.CPU74.RCU 17293 ± 12% -44.8% 9547 ± 15% softirqs.CPU75.RCU 16269 ± 20% -46.7% 8673 ± 24% softirqs.CPU76.RCU 17326 ± 18% -45.8% 9383 ± 22% softirqs.CPU77.RCU 18826 ± 18% -50.6% 9292 ± 24% softirqs.CPU78.RCU 19893 ± 8% -52.4% 9460 ± 18% softirqs.CPU79.RCU 18812 ± 19% -43.6% 10616 ± 19% softirqs.CPU8.RCU 20001 ± 12% -53.0% 9393 ± 14% softirqs.CPU80.RCU 20756 ± 5% -53.9% 9562 ± 18% softirqs.CPU81.RCU 18840 ± 15% -53.5% 8761 ± 17% softirqs.CPU82.RCU 17159 ± 21% -52.3% 8189 ± 20% softirqs.CPU83.RCU 18671 ± 16% -52.4% 8881 ± 19% softirqs.CPU84.RCU 18929 ± 11% -55.5% 8421 ± 21% softirqs.CPU85.RCU 17559 ± 15% -51.0% 8604 ± 13% softirqs.CPU86.RCU 17343 ± 14% -53.0% 8154 ± 18% softirqs.CPU87.RCU 15481 ± 13% -43.6% 8727 ± 14% softirqs.CPU88.RCU 16364 ± 14% -43.9% 9187 ± 24% softirqs.CPU89.RCU 18492 ± 19% -43.5% 10441 ± 14% softirqs.CPU9.RCU 14056 ± 7% -38.3% 8666 ± 21% softirqs.CPU90.RCU 14189 ± 6% -37.9% 8815 ± 24% softirqs.CPU91.RCU 15154 ± 14% -48.1% 7867 ± 15% softirqs.CPU92.RCU 15589 ± 14% -42.4% 8979 ± 25% softirqs.CPU93.RCU 14492 ± 10% -34.4% 9504 ± 19% softirqs.CPU94.RCU 34198 ± 16% -52.1% 16384 ± 44% softirqs.CPU94.SCHED 17203 ± 7% -46.2% 9249 ± 16% softirqs.CPU95.RCU 15367 ± 11% -44.0% 8601 ± 12% softirqs.CPU96.RCU 14328 ± 13% -37.8% 8911 ± 27% softirqs.CPU97.RCU 16134 ± 16% -46.3% 8672 ± 19% softirqs.CPU98.RCU 15282 ± 17% -44.5% 8486 ± 18% softirqs.CPU99.RCU 1808149 ± 6% -46.3% 971467 ± 15% softirqs.RCU 36250 ± 5% +36.3% 49404 ± 2% softirqs.TIMER 17.47 ± 9% -5.9 11.61 ± 9% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64 9.44 ± 9% -3.2 6.23 ± 9% perf-profile.calltrace.cycles-pp.__entry_text_start.__libc_fcntl64 8.57 ± 9% -2.9 5.64 ± 9% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.__libc_fcntl64 2.27 ± 9% -1.0 1.27 ± 29% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_safe_stack.__libc_fcntl64 2.68 ± 9% -1.0 1.70 ± 9% perf-profile.calltrace.cycles-pp.memset_erms.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait 2.65 ± 8% -0.9 1.78 ± 9% perf-profile.calltrace.cycles-pp.security_file_lock.do_lock_file_wait.fcntl_setlk.do_fcntl.__x64_sys_fcntl 2.52 ± 9% -0.9 1.65 ± 9% perf-profile.calltrace.cycles-pp._copy_from_user.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe 0.80 ± 8% -0.5 0.28 ±100% perf-profile.calltrace.cycles-pp._raw_spin_lock.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl 1.34 ± 9% -0.5 0.83 ± 9% perf-profile.calltrace.cycles-pp.memset_erms.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl 1.62 ± 9% -0.5 1.12 ± 10% perf-profile.calltrace.cycles-pp.common_file_perm.security_file_lock.do_lock_file_wait.fcntl_setlk.do_fcntl 0.82 ± 10% -0.4 0.38 ± 71% perf-profile.calltrace.cycles-pp.syscall_enter_from_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64 0.66 ± 11% -0.4 0.28 ±100% perf-profile.calltrace.cycles-pp.locks_delete_lock_ctx.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl 1.04 ± 9% -0.3 0.69 ± 9% perf-profile.calltrace.cycles-pp.copy_user_generic_unrolled._copy_from_user.do_fcntl.__x64_sys_fcntl.do_syscall_64 0.86 ± 9% -0.3 0.59 ± 8% perf-profile.calltrace.cycles-pp.__fget_light.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64 0.00 +0.6 0.59 ± 11% perf-profile.calltrace.cycles-pp.mod_objcg_state.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait 1.06 ± 9% +0.9 1.92 ± 12% perf-profile.calltrace.cycles-pp.locks_dispose_list.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl 0.00 +0.9 0.92 ± 10% perf-profile.calltrace.cycles-pp.get_obj_cgroup_from_current.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl 0.67 ± 9% +1.0 1.68 ± 14% perf-profile.calltrace.cycles-pp.kmem_cache_free.locks_dispose_list.posix_lock_inode.do_lock_file_wait.fcntl_setlk 0.00 +1.4 1.38 ± 8% perf-profile.calltrace.cycles-pp.get_obj_cgroup_from_current.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait 0.00 +1.8 1.79 ± 59% perf-profile.calltrace.cycles-pp.page_counter_cancel.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.fcntl_setlk 0.00 +2.2 2.18 ± 58% perf-profile.calltrace.cycles-pp.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.fcntl_setlk.do_fcntl 0.00 +2.2 2.21 ± 58% perf-profile.calltrace.cycles-pp.obj_cgroup_uncharge_pages.kmem_cache_free.fcntl_setlk.do_fcntl.__x64_sys_fcntl 0.00 +2.4 2.35 ± 43% perf-profile.calltrace.cycles-pp.page_counter_cancel.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.posix_lock_inode 0.00 +2.8 2.80 ± 59% perf-profile.calltrace.cycles-pp.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk 0.00 +2.8 2.84 ± 41% perf-profile.calltrace.cycles-pp.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.posix_lock_inode.do_lock_file_wait 0.00 +2.9 2.86 ± 41% perf-profile.calltrace.cycles-pp.obj_cgroup_uncharge_pages.kmem_cache_free.posix_lock_inode.do_lock_file_wait.fcntl_setlk 1.10 ± 9% +2.9 3.98 ± 32% perf-profile.calltrace.cycles-pp.kmem_cache_free.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64 0.00 +3.0 2.99 ± 55% perf-profile.calltrace.cycles-pp.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl 1.69 ± 9% +3.8 5.49 ± 21% perf-profile.calltrace.cycles-pp.kmem_cache_free.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl 3.39 ± 8% +4.0 7.42 ± 22% perf-profile.calltrace.cycles-pp.locks_alloc_lock.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64 3.00 ± 8% +4.2 7.17 ± 23% perf-profile.calltrace.cycles-pp.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl.__x64_sys_fcntl 0.00 +4.6 4.61 ± 29% perf-profile.calltrace.cycles-pp.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode 0.00 +5.0 5.00 ± 27% perf-profile.calltrace.cycles-pp.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait 6.48 ± 9% +6.3 12.76 ± 12% perf-profile.calltrace.cycles-pp.locks_alloc_lock.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl 5.71 ± 9% +6.5 12.21 ± 13% perf-profile.calltrace.cycles-pp.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait.fcntl_setlk 0.00 +7.3 7.35 ± 35% perf-profile.calltrace.cycles-pp.page_counter_try_charge.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock 17.27 ± 9% +8.5 25.78 ± 11% perf-profile.calltrace.cycles-pp.do_lock_file_wait.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64 13.80 ± 9% +9.6 23.35 ± 12% perf-profile.calltrace.cycles-pp.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl.__x64_sys_fcntl 28.29 ± 9% +13.3 41.58 ± 12% perf-profile.calltrace.cycles-pp.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64 26.73 ± 9% +13.8 40.53 ± 12% perf-profile.calltrace.cycles-pp.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64 23.74 ± 9% +14.8 38.56 ± 13% perf-profile.calltrace.cycles-pp.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe 17.55 ± 9% -5.9 11.68 ± 9% perf-profile.children.cycles-pp.syscall_exit_to_user_mode 9.74 ± 9% -3.3 6.41 ± 9% perf-profile.children.cycles-pp.syscall_return_via_sysret 9.02 ± 8% -3.1 5.96 ± 9% perf-profile.children.cycles-pp.__entry_text_start 4.02 ± 9% -1.5 2.53 ± 9% perf-profile.children.cycles-pp.memset_erms 2.58 ± 9% -0.9 1.69 ± 9% perf-profile.children.cycles-pp._copy_from_user 2.68 ± 8% -0.9 1.80 ± 9% perf-profile.children.cycles-pp.security_file_lock 2.02 ± 7% -0.7 1.33 ± 9% perf-profile.children.cycles-pp._raw_spin_lock 1.40 ± 8% -0.6 0.85 ± 10% perf-profile.children.cycles-pp.___might_sleep 1.67 ± 9% -0.5 1.16 ± 10% perf-profile.children.cycles-pp.common_file_perm 1.48 ± 9% -0.5 0.98 ± 9% perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack 1.23 ± 9% -0.4 0.81 ± 9% perf-profile.children.cycles-pp.copy_user_generic_unrolled 1.04 ± 9% -0.4 0.67 ± 9% perf-profile.children.cycles-pp.__might_sleep 0.86 ± 10% -0.3 0.56 ± 9% perf-profile.children.cycles-pp.syscall_enter_from_user_mode 0.86 ± 9% -0.3 0.59 ± 8% perf-profile.children.cycles-pp.__fget_light 0.76 ± 7% -0.3 0.50 ± 8% perf-profile.children.cycles-pp.apparmor_file_lock 0.77 ± 8% -0.3 0.51 ± 9% perf-profile.children.cycles-pp.__cond_resched 0.59 ± 8% -0.2 0.38 ± 9% perf-profile.children.cycles-pp.__might_fault 0.66 ± 9% -0.2 0.46 ± 9% perf-profile.children.cycles-pp.locks_release_private 0.56 ± 9% -0.2 0.36 ± 9% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 0.58 ± 9% -0.2 0.44 ± 10% perf-profile.children.cycles-pp.locks_insert_lock_ctx 0.69 ± 11% -0.1 0.54 ± 9% perf-profile.children.cycles-pp.locks_delete_lock_ctx 0.56 ± 10% -0.1 0.44 ± 8% perf-profile.children.cycles-pp.locks_unlink_lock_ctx 0.38 ± 8% -0.1 0.26 ± 10% perf-profile.children.cycles-pp.rcu_all_qs 0.33 ± 11% -0.1 0.21 ± 9% perf-profile.children.cycles-pp.flock64_to_posix_lock 0.35 ± 8% -0.1 0.24 ± 10% perf-profile.children.cycles-pp.aa_file_perm 0.27 ± 21% -0.1 0.16 ± 9% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax 0.23 ± 9% -0.1 0.13 ± 8% perf-profile.children.cycles-pp.__init_waitqueue_head 0.31 ± 8% -0.1 0.21 ± 9% perf-profile.children.cycles-pp.exit_to_user_mode_prepare 0.24 ± 9% -0.1 0.17 ± 6% perf-profile.children.cycles-pp.testcase 0.19 ± 11% -0.1 0.12 ± 10% perf-profile.children.cycles-pp.should_failslab 0.15 ± 10% -0.1 0.09 ± 10% [email protected] 0.16 ± 7% -0.1 0.10 ± 14% perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare 0.13 ± 9% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.security_file_fcntl 0.12 ± 12% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.__list_del_entry_valid 0.14 ± 9% -0.0 0.10 ± 10% perf-profile.children.cycles-pp.locks_get_lock_context 0.08 ± 10% -0.0 0.03 ± 70% perf-profile.children.cycles-pp.vfs_lock_file 0.13 ± 8% -0.0 0.10 ± 7% perf-profile.children.cycles-pp.locks_delete_block 0.10 ± 10% -0.0 0.06 ± 14% perf-profile.children.cycles-pp.__list_add_valid 0.10 ± 10% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.memset 0.00 +0.1 0.08 ± 9% perf-profile.children.cycles-pp.obj_cgroup_uncharge 0.00 +0.2 0.21 ± 18% perf-profile.children.cycles-pp.mem_cgroup_from_task 0.00 +0.6 0.55 ± 9% perf-profile.children.cycles-pp.rcu_read_unlock_strict 0.00 +0.6 0.60 ± 9% perf-profile.children.cycles-pp.refill_obj_stock 1.10 ± 9% +0.9 1.96 ± 12% perf-profile.children.cycles-pp.locks_dispose_list 0.00 +1.7 1.67 ± 10% perf-profile.children.cycles-pp.mod_objcg_state 0.00 +2.4 2.42 ± 35% perf-profile.children.cycles-pp.propagate_protected_usage 0.00 +2.5 2.47 ± 9% perf-profile.children.cycles-pp.get_obj_cgroup_from_current 0.00 +4.7 4.74 ± 36% perf-profile.children.cycles-pp.page_counter_cancel 0.00 +5.8 5.77 ± 35% perf-profile.children.cycles-pp.page_counter_uncharge 0.00 +5.8 5.82 ± 35% perf-profile.children.cycles-pp.obj_cgroup_uncharge_pages 0.00 +7.4 7.36 ± 35% perf-profile.children.cycles-pp.page_counter_try_charge 0.00 +7.4 7.42 ± 35% perf-profile.children.cycles-pp.obj_cgroup_charge_pages 3.47 ± 9% +7.8 11.27 ± 18% perf-profile.children.cycles-pp.kmem_cache_free 0.00 +8.1 8.05 ± 32% perf-profile.children.cycles-pp.obj_cgroup_charge 17.35 ± 9% +8.5 25.81 ± 11% perf-profile.children.cycles-pp.do_lock_file_wait 14.01 ± 9% +9.5 23.56 ± 12% perf-profile.children.cycles-pp.posix_lock_inode 10.00 ± 8% +10.2 20.24 ± 14% perf-profile.children.cycles-pp.locks_alloc_lock 9.00 ± 8% +10.7 19.67 ± 14% perf-profile.children.cycles-pp.kmem_cache_alloc 28.35 ± 9% +13.3 41.61 ± 12% perf-profile.children.cycles-pp.__x64_sys_fcntl 26.89 ± 9% +13.7 40.63 ± 12% perf-profile.children.cycles-pp.do_fcntl 23.92 ± 9% +14.7 38.67 ± 13% perf-profile.children.cycles-pp.fcntl_setlk 17.12 ± 9% -5.7 11.40 ± 9% perf-profile.self.cycles-pp.syscall_exit_to_user_mode 9.72 ± 9% -3.3 6.39 ± 9% perf-profile.self.cycles-pp.syscall_return_via_sysret 7.81 ± 8% -2.6 5.16 ± 9% perf-profile.self.cycles-pp.__entry_text_start 3.90 ± 9% -1.4 2.45 ± 9% perf-profile.self.cycles-pp.memset_erms 1.97 ± 7% -0.7 1.32 ± 10% perf-profile.self.cycles-pp._raw_spin_lock 1.78 ± 9% -0.6 1.21 ± 9% perf-profile.self.cycles-pp.__libc_fcntl64 1.34 ± 8% -0.5 0.82 ± 11% perf-profile.self.cycles-pp.___might_sleep 1.35 ± 9% -0.4 0.94 ± 10% perf-profile.self.cycles-pp.common_file_perm 1.19 ± 9% -0.4 0.79 ± 9% perf-profile.self.cycles-pp.copy_user_generic_unrolled 1.30 ± 8% -0.3 0.96 ± 8% perf-profile.self.cycles-pp.posix_lock_inode 0.91 ± 9% -0.3 0.58 ± 9% perf-profile.self.cycles-pp.__might_sleep 1.08 ± 9% -0.3 0.76 ± 8% perf-profile.self.cycles-pp.fcntl_setlk 0.74 ± 8% -0.3 0.43 ± 10% perf-profile.self.cycles-pp.locks_alloc_lock 0.79 ± 9% -0.3 0.51 ± 10% perf-profile.self.cycles-pp.syscall_enter_from_user_mode 0.76 ± 9% -0.3 0.49 ± 6% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.83 ± 9% -0.3 0.56 ± 8% perf-profile.self.cycles-pp.__fget_light 0.70 ± 9% -0.2 0.46 ± 8% perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack 0.66 ± 7% -0.2 0.43 ± 7% perf-profile.self.cycles-pp.apparmor_file_lock 0.64 ± 9% -0.2 0.42 ± 9% perf-profile.self.cycles-pp.locks_release_private 0.52 ± 9% -0.2 0.34 ± 9% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 0.47 ± 10% -0.2 0.30 ± 9% perf-profile.self.cycles-pp.do_lock_file_wait 0.54 ± 9% -0.2 0.38 ± 9% perf-profile.self.cycles-pp.do_fcntl 0.46 ± 9% -0.2 0.30 ± 8% perf-profile.self.cycles-pp.__x64_sys_fcntl 0.40 ± 11% -0.2 0.25 ± 11% perf-profile.self.cycles-pp.do_syscall_64 0.33 ± 11% -0.1 0.19 ± 10% perf-profile.self.cycles-pp.flock64_to_posix_lock 0.38 ± 9% -0.1 0.25 ± 9% perf-profile.self.cycles-pp.__cond_resched 0.25 ± 7% -0.1 0.14 ± 10% perf-profile.self.cycles-pp.locks_dispose_list 0.24 ± 9% -0.1 0.13 ± 8% perf-profile.self.cycles-pp.testcase 0.28 ± 7% -0.1 0.19 ± 11% perf-profile.self.cycles-pp.aa_file_perm 0.22 ± 24% -0.1 0.13 ± 8% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax 0.28 ± 8% -0.1 0.18 ± 10% perf-profile.self.cycles-pp.exit_to_user_mode_prepare 0.25 ± 9% -0.1 0.16 ± 10% perf-profile.self.cycles-pp._copy_from_user 0.26 ± 8% -0.1 0.17 ± 10% perf-profile.self.cycles-pp.rcu_all_qs 0.18 ± 9% -0.1 0.10 ± 10% perf-profile.self.cycles-pp.__init_waitqueue_head 0.15 ± 8% -0.1 0.07 ± 14% perf-profile.self.cycles-pp.syscall_exit_to_user_mode_prepare 0.14 ± 9% -0.1 0.08 ± 11% [email protected] 0.12 ± 12% -0.1 0.07 ± 7% perf-profile.self.cycles-pp.__list_del_entry_valid 0.18 ± 12% -0.1 0.13 ± 8% perf-profile.self.cycles-pp.security_file_lock 0.08 ± 12% -0.0 0.03 ±100% perf-profile.self.cycles-pp.__list_add_valid 0.12 ± 9% -0.0 0.08 ± 11% perf-profile.self.cycles-pp.locks_get_lock_context 0.10 ± 10% -0.0 0.06 ± 11% perf-profile.self.cycles-pp.__might_fault 0.10 ± 10% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.memset 0.10 ± 8% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.security_file_fcntl 0.11 ± 8% -0.0 0.08 ± 8% perf-profile.self.cycles-pp.locks_delete_block 0.00 +0.1 0.06 ± 7% perf-profile.self.cycles-pp.obj_cgroup_uncharge 0.00 +0.2 0.16 ± 24% perf-profile.self.cycles-pp.mem_cgroup_from_task 0.00 +0.3 0.34 ± 9% perf-profile.self.cycles-pp.rcu_read_unlock_strict 0.00 +0.6 0.56 ± 9% perf-profile.self.cycles-pp.obj_cgroup_charge 0.00 +0.6 0.58 ± 10% perf-profile.self.cycles-pp.refill_obj_stock 3.14 ± 8% +1.3 4.46 ± 10% perf-profile.self.cycles-pp.kmem_cache_alloc 0.00 +1.7 1.65 ± 10% perf-profile.self.cycles-pp.mod_objcg_state 0.00 +2.2 2.17 ± 9% perf-profile.self.cycles-pp.get_obj_cgroup_from_current 0.00 +2.4 2.40 ± 35% perf-profile.self.cycles-pp.propagate_protected_usage 0.00 +4.7 4.70 ± 36% perf-profile.self.cycles-pp.page_counter_cancel 0.00 +5.9 5.92 ± 35% perf-profile.self.cycles-pp.page_counter_try_charge will-it-scale.52.processes 7e+07 +-----------------------------------------------------------------+ | .+ + + + + | 6.5e+07 |+++ ++++++.++++ +++.+ +++++.+++++++.++++ ++.++ +++++.+++++++ | | | 6e+07 |-+ | | | 5.5e+07 |-+ | | | 5e+07 |-+ O | | OO O O OOO OO O O OOO O | 4.5e+07 |O+O OOOO O O O O OOO O OOOOO O O O O OO O OOOO O | | O O O OO O O O| 4e+07 |-+ O O | | | 3.5e+07 +-----------------------------------------------------------------+ will-it-scale.per_process_ops 1.3e+06 +-----------------------------------------------------------------+ |+++.+++++++.++++++++.+++++++.+++++++.+++++++.++++++++.+++++++ | 1.2e+06 |-+ | | | | | 1.1e+06 |-+ | | | 1e+06 |-+ | | O | 900000 |-+ O O O O O O O O O O | |O O OOO O O OO O O O O O O OOOO O O O OO O O OOOO | | O O O O OO OO O OO O| 800000 |-O O O O | | | 700000 +-----------------------------------------------------------------+ will-it-scale.workload 7e+07 +-----------------------------------------------------------------+ | .+ + + + + | 6.5e+07 |+++ ++++++.++++ +++.+ +++++.+++++++.++++ ++.++ +++++.+++++++ | | | 6e+07 |-+ | | | 5.5e+07 |-+ | | | 5e+07 |-+ O | | OO O O OOO OO O O OOO O | 4.5e+07 |O+O OOOO O O O O OOO O OOOOO O O O O OO O OOOO O | | O O O OO O O O| 4e+07 |-+ O O | | | 3.5e+07 +-----------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample *************************************************************************************************** lkp-icl-2sp2: 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz with 256G memory ========================================================================================= compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode: gcc-9/performance/x86_64-rhel-8.3/process/50%/debian-10.4-x86_64-20200603.cgz/lkp-icl-2sp2/lock1/will-it-scale/0xd000280 commit: b655843444 ("memcg: enable accounting for pollfd and select bits arrays") 0f12156dff ("memcg: enable accounting for file lock caches") b655843444152c0a 0f12156dff2862ac54235fc7270 ---------------- --------------------------- %stddev %change %stddev \ | \ 1.785e+08 -40.9% 1.055e+08 ± 2% will-it-scale.64.processes 2788911 -40.9% 1649196 ± 2% will-it-scale.per_process_ops 1.785e+08 -40.9% 1.055e+08 ± 2% will-it-scale.workload 366571 ± 7% +15.2% 422206 ± 9% numa-numastat.node0.local_node 2807 +2.4% 2874 vmstat.system.cs 0.02 ± 2% -0.0 0.02 ± 2% mpstat.cpu.all.soft% 5.55 -2.4 3.15 ± 7% mpstat.cpu.all.usr% 5364 ± 2% -85.5% 778.67 ± 13% slabinfo.Acpi-Parse.active_objs 5364 ± 2% -85.5% 778.67 ± 13% slabinfo.Acpi-Parse.num_objs 49038 +5.1% 51541 proc-vmstat.nr_active_anon 55209 +5.1% 58037 proc-vmstat.nr_shmem 49038 +5.1% 51541 proc-vmstat.nr_zone_active_anon 183.83 ± 28% +320.7% 773.33 ±101% interrupts.154:IR-PCI-MSI.25690117-edge.eth0-TxRx-5 836.50 ± 10% +46.3% 1223 ± 30% interrupts.CPU103.CAL:Function_call_interrupts 1348 ± 83% +208.2% 4155 ± 50% interrupts.CPU2.RES:Rescheduling_interrupts 1089 ± 77% +158.6% 2818 ± 53% interrupts.CPU4.RES:Rescheduling_interrupts 183.83 ± 28% +320.7% 773.33 ±101% interrupts.CPU5.154:IR-PCI-MSI.25690117-edge.eth0-TxRx-5 806.17 ± 14% +31.2% 1058 ± 30% interrupts.CPU55.CAL:Function_call_interrupts 723.17 ± 74% +417.0% 3738 ± 82% interrupts.CPU55.RES:Rescheduling_interrupts 4847 ± 94% -97.1% 138.17 ± 19% interrupts.CPU86.NMI:Non-maskable_interrupts 4847 ± 94% -97.1% 138.17 ± 19% interrupts.CPU86.PMI:Performance_monitoring_interrupts 8069 ± 63% -80.7% 1561 ±200% interrupts.CPU99.NMI:Non-maskable_interrupts 8069 ± 63% -80.7% 1561 ±200% interrupts.CPU99.PMI:Performance_monitoring_interrupts 2345 -12.0% 2063 perf-sched.wait_and_delay.avg.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64 2345 -12.0% 2063 perf-sched.wait_and_delay.avg.ms.do_syslog.part.0.kmsg_read.vfs_read 262.68 ± 7% -42.8% 150.13 ± 12% perf-sched.wait_and_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 561.17 ± 9% -16.5% 468.33 ± 5% perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe 183.33 ± 7% +43.2% 262.50 ± 8% perf-sched.wait_and_delay.count.preempt_schedule_common.__cond_resched.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode 113.33 ± 11% +78.7% 202.50 ± 4% perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 7031 -12.0% 6185 perf-sched.wait_and_delay.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64 7031 -12.0% 6185 perf-sched.wait_and_delay.max.ms.do_syslog.part.0.kmsg_read.vfs_read 7035 -12.0% 6189 perf-sched.wait_and_delay.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read 2345 -12.0% 2063 perf-sched.wait_time.avg.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64 2345 -12.0% 2063 perf-sched.wait_time.avg.ms.do_syslog.part.0.kmsg_read.vfs_read 2.50 ± 7% -47.6% 1.31 ± 18% perf-sched.wait_time.avg.ms.rcu_gp_kthread.kthread.ret_from_fork 262.68 ± 7% -42.8% 150.13 ± 12% perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll 7031 -12.0% 6185 perf-sched.wait_time.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64 7031 -12.0% 6185 perf-sched.wait_time.max.ms.do_syslog.part.0.kmsg_read.vfs_read 7035 -12.0% 6189 perf-sched.wait_time.max.ms.pipe_read.new_sync_read.vfs_read.ksys_read 0.04 ± 22% +1112.5% 0.50 ±128% perf-sched.wait_time.max.ms.preempt_schedule_common.__cond_resched.posix_lock_inode.do_lock_file_wait.fcntl_setlk 0.02 ± 3% +1574.6% 0.27 ± 6% perf-stat.i.MPKI 7.076e+10 -6.5% 6.615e+10 ± 2% perf-stat.i.branch-instructions 0.05 +0.0 0.08 ± 5% perf-stat.i.branch-miss-rate% 35955313 ± 2% +45.6% 52354202 ± 5% perf-stat.i.branch-misses 10.31 +18.0 28.33 ± 8% perf-stat.i.cache-miss-rate% 492492 +4777.7% 24022051 ± 4% perf-stat.i.cache-misses 4620608 +1768.8% 86349315 ± 4% perf-stat.i.cache-references 2651 +2.5% 2716 perf-stat.i.context-switches 0.47 +8.5% 0.51 ± 2% perf-stat.i.cpi 425867 -98.4% 6992 ± 5% perf-stat.i.cycles-between-cache-misses 0.00 ± 4% +0.0 0.00 ± 11% perf-stat.i.dTLB-load-miss-rate% 1.03e+11 -3.8% 9.907e+10 ± 2% perf-stat.i.dTLB-loads 0.00 +0.0 0.00 ± 8% perf-stat.i.dTLB-store-miss-rate% 6.534e+10 -11.3% 5.796e+10 ± 2% perf-stat.i.dTLB-stores 3.516e+11 -7.2% 3.263e+11 ± 2% perf-stat.i.instructions 2.11 -7.1% 1.96 ± 2% perf-stat.i.ipc 37.50 ± 2% +2090.1% 821.35 ± 3% perf-stat.i.metric.K/sec 1867 -6.7% 1743 ± 2% perf-stat.i.metric.M/sec 104632 ± 2% +6707.0% 7122311 ± 3% perf-stat.i.node-load-misses 14377 ± 21% +3209.4% 475820 ± 29% perf-stat.i.node-loads 45.30 ± 16% +51.5 96.80 perf-stat.i.node-store-miss-rate% 48602 ± 14% +22917.3% 11186859 ± 6% perf-stat.i.node-store-misses 65851 ± 9% +432.6% 350742 ± 9% perf-stat.i.node-stores 0.01 +1902.5% 0.27 ± 6% perf-stat.overall.MPKI 0.05 +0.0 0.08 ± 6% perf-stat.overall.branch-miss-rate% 10.65 +17.3 27.92 ± 8% perf-stat.overall.cache-miss-rate% 0.47 +7.7% 0.51 ± 2% perf-stat.overall.cpi 336119 -97.9% 6940 ± 4% perf-stat.overall.cycles-between-cache-misses 0.00 ± 4% +0.0 0.00 ± 10% perf-stat.overall.dTLB-load-miss-rate% 0.00 +0.0 0.00 ± 4% perf-stat.overall.dTLB-store-miss-rate% 2.11 -7.1% 1.96 ± 2% perf-stat.overall.ipc 87.73 ± 2% +6.0 93.76 perf-stat.overall.node-load-miss-rate% 42.34 ± 13% +54.6 96.95 perf-stat.overall.node-store-miss-rate% 594415 +56.9% 932831 perf-stat.overall.path-length 7.05e+10 -6.5% 6.592e+10 ± 2% perf-stat.ps.branch-instructions 35867377 +45.6% 52233576 ± 5% perf-stat.ps.branch-misses 493933 +4747.8% 23944727 ± 4% perf-stat.ps.cache-misses 4639810 +1756.0% 86115077 ± 4% perf-stat.ps.cache-references 2653 +2.6% 2721 perf-stat.ps.context-switches 1.027e+11 -3.8% 9.872e+10 ± 2% perf-stat.ps.dTLB-loads 6.51e+10 -11.3% 5.775e+10 ± 2% perf-stat.ps.dTLB-stores 3.504e+11 -7.2% 3.252e+11 ± 2% perf-stat.ps.instructions 104869 ± 2% +6668.1% 7097622 ± 3% perf-stat.ps.node-load-misses 14698 ± 21% +3134.0% 475371 ± 29% perf-stat.ps.node-loads 48497 ± 14% +22887.1% 11148161 ± 6% perf-stat.ps.node-store-misses 65971 ± 9% +430.7% 350139 ± 8% perf-stat.ps.node-stores 1.061e+14 -7.2% 9.845e+13 ± 2% perf-stat.total.instructions 11738 ± 11% -32.5% 7926 ± 19% softirqs.CPU1.RCU 12768 ± 12% -39.4% 7741 ± 11% softirqs.CPU10.RCU 8853 ± 10% -33.9% 5851 ± 8% softirqs.CPU100.RCU 9695 ± 6% -40.1% 5811 ± 5% softirqs.CPU101.RCU 9277 ± 7% -38.0% 5752 ± 7% softirqs.CPU102.RCU 9585 ± 8% -33.5% 6376 ± 17% softirqs.CPU103.RCU 9838 ± 7% -40.5% 5857 ± 9% softirqs.CPU104.RCU 9315 ± 8% -40.6% 5529 ± 7% softirqs.CPU105.RCU 9661 ± 10% -40.5% 5749 ± 5% softirqs.CPU106.RCU 9531 ± 6% -35.6% 6138 ± 7% softirqs.CPU108.RCU 9472 ± 7% -34.4% 6210 ± 16% softirqs.CPU109.RCU 11502 ± 13% -41.5% 6726 ± 14% softirqs.CPU11.RCU 9003 ± 11% -34.3% 5916 ± 12% softirqs.CPU111.RCU 9739 ± 7% -36.5% 6187 ± 10% softirqs.CPU113.RCU 9453 ± 9% -34.2% 6220 ± 13% softirqs.CPU114.RCU 9891 ± 7% -31.3% 6798 ± 18% softirqs.CPU115.RCU 10008 ± 9% -39.1% 6090 ± 12% softirqs.CPU116.RCU 10132 ± 17% -41.7% 5912 ± 15% softirqs.CPU117.RCU 9765 ± 8% -37.5% 6103 ± 8% softirqs.CPU118.RCU 8960 ± 11% -33.9% 5923 ± 8% softirqs.CPU119.RCU 10910 ± 17% -34.0% 7197 ± 6% softirqs.CPU12.RCU 9577 ± 6% -37.6% 5973 ± 12% softirqs.CPU120.RCU 9565 ± 10% -42.9% 5457 ± 7% softirqs.CPU121.RCU 9137 ± 10% -38.7% 5604 ± 11% softirqs.CPU124.RCU 9418 ± 13% -34.3% 6186 ± 13% softirqs.CPU125.RCU 9151 ± 15% -37.2% 5745 ± 11% softirqs.CPU126.RCU 10800 ± 7% -34.7% 7057 ± 10% softirqs.CPU127.RCU 9815 ± 9% -29.1% 6958 ± 6% softirqs.CPU13.RCU 11463 ± 15% -39.2% 6967 ± 12% softirqs.CPU14.RCU 10757 ± 15% -37.6% 6716 ± 10% softirqs.CPU15.RCU 10809 ± 17% -38.5% 6648 ± 16% softirqs.CPU16.RCU 11169 ± 14% -42.4% 6435 ± 13% softirqs.CPU17.RCU 12215 ± 11% -40.1% 7319 ± 13% softirqs.CPU19.RCU 11500 ± 12% -39.2% 6996 ± 10% softirqs.CPU2.RCU 11027 ± 18% -32.7% 7416 ± 9% softirqs.CPU20.RCU 11155 ± 17% -39.5% 6745 ± 5% softirqs.CPU21.RCU 11083 ± 16% -32.8% 7451 ± 12% softirqs.CPU22.RCU 11841 ± 15% -44.9% 6523 ± 13% softirqs.CPU23.RCU 11415 ± 16% -38.7% 6997 ± 15% softirqs.CPU24.RCU 11325 ± 5% -37.7% 7061 ± 8% softirqs.CPU25.RCU 12111 ± 11% -44.5% 6715 ± 11% softirqs.CPU26.RCU 11627 ± 11% -43.1% 6613 ± 11% softirqs.CPU27.RCU 11113 ± 3% -40.1% 6658 ± 10% softirqs.CPU28.RCU 10333 ± 13% -33.2% 6907 ± 8% softirqs.CPU29.RCU 12191 ± 13% -42.5% 7009 ± 13% softirqs.CPU3.RCU 10265 ± 11% -31.7% 7012 ± 9% softirqs.CPU30.RCU 11440 ± 13% -39.6% 6910 ± 17% softirqs.CPU31.RCU 10389 ± 12% -33.8% 6874 ± 11% softirqs.CPU32.RCU 11224 ± 10% -37.3% 7032 ± 19% softirqs.CPU33.RCU 10886 ± 13% -32.8% 7317 ± 16% softirqs.CPU34.RCU 10588 ± 9% -32.7% 7125 ± 6% softirqs.CPU35.RCU 9719 ± 16% -31.8% 6625 ± 14% softirqs.CPU36.RCU 11099 ± 12% -33.2% 7414 ± 12% softirqs.CPU37.RCU 10338 ± 9% -25.6% 7690 ± 14% softirqs.CPU38.RCU 10238 ± 11% -27.1% 7461 ± 9% softirqs.CPU39.RCU 11660 ± 15% -35.5% 7516 ± 12% softirqs.CPU4.RCU 10552 ± 13% -31.6% 7220 ± 12% softirqs.CPU40.RCU 10552 ± 10% -31.1% 7273 ± 7% softirqs.CPU41.RCU 10103 ± 13% -31.8% 6891 ± 9% softirqs.CPU42.RCU 10974 ± 8% -36.9% 6921 ± 10% softirqs.CPU43.RCU 10730 ± 13% -37.2% 6739 ± 17% softirqs.CPU44.RCU 11205 ± 12% -35.4% 7233 ± 11% softirqs.CPU45.RCU 11136 ± 12% -39.4% 6751 ± 12% softirqs.CPU46.RCU 10649 ± 11% -33.6% 7073 ± 8% softirqs.CPU47.RCU 9988 ± 10% -36.5% 6346 ± 8% softirqs.CPU48.RCU 9801 ± 9% -36.9% 6180 ± 6% softirqs.CPU49.RCU 12102 ± 9% -37.5% 7563 ± 17% softirqs.CPU5.RCU 9884 ± 12% -36.2% 6303 ± 7% softirqs.CPU50.RCU 9347 ± 9% -34.8% 6096 ± 7% softirqs.CPU51.RCU 10164 ± 11% -35.3% 6575 ± 7% softirqs.CPU52.RCU 10518 ± 15% -37.2% 6609 ± 10% softirqs.CPU53.RCU 9857 ± 12% -32.5% 6655 ± 5% softirqs.CPU54.RCU 10795 ± 13% -44.0% 6047 ± 5% softirqs.CPU55.RCU 10397 ± 12% -38.9% 6350 ± 7% softirqs.CPU56.RCU 9513 ± 6% -30.5% 6615 ± 8% softirqs.CPU57.RCU 10400 ± 10% -37.6% 6492 ± 5% softirqs.CPU58.RCU 10434 ± 8% -39.1% 6351 ± 9% softirqs.CPU59.RCU 12055 ± 14% -32.8% 8102 ± 22% softirqs.CPU6.RCU 10580 ± 12% -40.1% 6340 ± 11% softirqs.CPU60.RCU 10099 ± 11% -41.4% 5915 ± 7% softirqs.CPU61.RCU 10021 ± 10% -35.8% 6436 ± 3% softirqs.CPU62.RCU 9856 ± 7% -31.3% 6774 ± 9% softirqs.CPU64.RCU 9963 ± 12% -36.0% 6372 ± 8% softirqs.CPU65.RCU 9664 ± 8% -30.1% 6752 ± 5% softirqs.CPU66.RCU 9673 ± 5% -33.2% 6463 ± 10% softirqs.CPU67.RCU 9910 ± 8% -36.4% 6307 ± 6% softirqs.CPU68.RCU 9589 ± 5% -34.2% 6310 ± 7% softirqs.CPU69.RCU 11733 ± 9% -42.0% 6809 ± 12% softirqs.CPU7.RCU 9603 ± 42% +105.6% 19745 ± 32% softirqs.CPU7.SCHED 9881 ± 9% -34.0% 6521 ± 7% softirqs.CPU70.RCU 9620 ± 6% -33.2% 6424 ± 2% softirqs.CPU71.RCU 35921 ± 13% -39.4% 21764 ± 30% softirqs.CPU71.SCHED 10659 ± 13% -38.8% 6524 ± 7% softirqs.CPU72.RCU 9917 ± 7% -38.9% 6055 ± 7% softirqs.CPU73.RCU 9572 ± 7% -40.0% 5741 ± 9% softirqs.CPU74.RCU 9683 ± 9% -36.2% 6176 ± 6% softirqs.CPU75.RCU 10099 ± 7% -38.4% 6220 ± 10% softirqs.CPU76.RCU 9726 ± 5% -28.6% 6946 ± 14% softirqs.CPU78.RCU 9463 ± 6% -37.1% 5956 ± 12% softirqs.CPU79.RCU 10789 ± 12% -34.1% 7105 ± 20% softirqs.CPU8.RCU 9917 ± 7% -35.1% 6439 ± 11% softirqs.CPU80.RCU 9821 ± 4% -34.5% 6430 ± 3% softirqs.CPU81.RCU 9938 ± 12% -38.6% 6098 ± 10% softirqs.CPU82.RCU 9838 ± 4% -35.2% 6370 ± 7% softirqs.CPU83.RCU 10401 ± 8% -40.1% 6229 ± 6% softirqs.CPU84.RCU 10051 ± 6% -36.4% 6396 ± 9% softirqs.CPU85.RCU 9792 ± 4% -35.3% 6339 ± 14% softirqs.CPU86.RCU 10059 ± 9% -36.3% 6408 ± 8% softirqs.CPU87.RCU 9972 ± 8% -39.2% 6059 ± 3% softirqs.CPU88.RCU 9447 ± 9% -30.8% 6534 ± 12% softirqs.CPU89.RCU 11511 ± 24% -37.0% 7246 ± 11% softirqs.CPU9.RCU 9563 ± 6% -30.9% 6612 ± 6% softirqs.CPU90.RCU 36244 ± 11% -29.7% 25496 ± 25% softirqs.CPU90.SCHED 9671 ± 8% -34.4% 6340 ± 7% softirqs.CPU91.RCU 9848 ± 7% -33.7% 6531 ± 5% softirqs.CPU92.RCU 9578 ± 8% -32.4% 6479 ± 5% softirqs.CPU93.RCU 9519 ± 5% -36.3% 6064 ± 7% softirqs.CPU94.RCU 9480 ± 9% -31.0% 6544 ± 12% softirqs.CPU95.RCU 9025 ± 8% -35.2% 5845 ± 5% softirqs.CPU96.RCU 9656 ± 19% -39.8% 5814 ± 8% softirqs.CPU97.RCU 10008 ± 7% -39.4% 6064 ± 9% softirqs.CPU98.RCU 9619 ± 6% -41.1% 5661 ± 3% softirqs.CPU99.RCU 1308899 ± 3% -36.2% 835466 ± 3% softirqs.RCU 47568 ± 2% +20.6% 57361 ± 4% softirqs.TIMER 10.02 ± 3% -4.9 5.08 ± 18% perf-profile.calltrace.cycles-pp.__entry_text_start.__libc_fcntl64 8.20 -3.8 4.38 ± 6% perf-profile.calltrace.cycles-pp._copy_from_user.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe 5.28 -2.7 2.58 ± 5% perf-profile.calltrace.cycles-pp.memset_erms.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait 4.78 -2.3 2.48 ± 7% perf-profile.calltrace.cycles-pp.security_file_lock.do_lock_file_wait.fcntl_setlk.do_fcntl.__x64_sys_fcntl 3.68 -1.8 1.88 ± 7% perf-profile.calltrace.cycles-pp.common_file_perm.security_file_lock.do_lock_file_wait.fcntl_setlk.do_fcntl 3.36 -1.4 1.93 ± 6% perf-profile.calltrace.cycles-pp.copy_user_generic_unrolled._copy_from_user.do_fcntl.__x64_sys_fcntl.do_syscall_64 2.98 -1.2 1.75 ± 6% perf-profile.calltrace.cycles-pp.__fget_light.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64 2.51 -1.2 1.30 ± 7% perf-profile.calltrace.cycles-pp.locks_delete_lock_ctx.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl 2.49 -1.1 1.36 ± 6% perf-profile.calltrace.cycles-pp._raw_spin_lock.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl 2.02 -1.0 1.05 ± 6% perf-profile.calltrace.cycles-pp.locks_unlink_lock_ctx.locks_delete_lock_ctx.posix_lock_inode.do_lock_file_wait.fcntl_setlk 2.02 -1.0 1.06 ± 7% perf-profile.calltrace.cycles-pp.locks_insert_lock_ctx.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl 1.14 -0.8 0.37 ± 70% perf-profile.calltrace.cycles-pp.locks_release_private.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl 1.70 -0.7 0.98 ± 7% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string._copy_from_user.do_fcntl.__x64_sys_fcntl.do_syscall_64 1.24 -0.6 0.64 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock.locks_insert_lock_ctx.posix_lock_inode.do_lock_file_wait.fcntl_setlk 2.15 -0.6 1.57 ± 8% perf-profile.calltrace.cycles-pp.memset_erms.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl 1.34 -0.6 0.77 ± 6% perf-profile.calltrace.cycles-pp.___might_sleep.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl 1.32 -0.6 0.75 ± 7% perf-profile.calltrace.cycles-pp.__might_fault._copy_from_user.do_fcntl.__x64_sys_fcntl.do_syscall_64 1.22 -0.5 0.68 ± 6% perf-profile.calltrace.cycles-pp._raw_spin_lock.locks_unlink_lock_ctx.locks_delete_lock_ctx.posix_lock_inode.do_lock_file_wait 1.21 -0.5 0.68 ± 7% perf-profile.calltrace.cycles-pp.aa_file_perm.common_file_perm.security_file_lock.do_lock_file_wait.fcntl_setlk 1.41 -0.5 0.90 ± 9% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64 1.21 -0.5 0.70 ± 6% perf-profile.calltrace.cycles-pp.syscall_enter_from_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64 1.08 -0.5 0.61 ± 7% perf-profile.calltrace.cycles-pp.flock64_to_posix_lock.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64 0.76 -0.4 0.35 ± 70% perf-profile.calltrace.cycles-pp.___might_sleep.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait 1.27 -0.4 0.86 ± 5% perf-profile.calltrace.cycles-pp.__might_sleep.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait 1.04 -0.4 0.66 ± 10% perf-profile.calltrace.cycles-pp.syscall_return_via_sysret.__libc_fcntl64 0.76 -0.1 0.63 ± 5% perf-profile.calltrace.cycles-pp._raw_spin_lock.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64 97.66 +0.4 98.07 perf-profile.calltrace.cycles-pp.__libc_fcntl64 0.00 +0.5 0.54 ± 4% perf-profile.calltrace.cycles-pp.refill_obj_stock.kmem_cache_free.fcntl_setlk.do_fcntl.__x64_sys_fcntl 0.00 +0.8 0.83 ± 7% perf-profile.calltrace.cycles-pp.mod_objcg_state.kmem_cache_free.fcntl_setlk.do_fcntl.__x64_sys_fcntl 0.00 +0.9 0.90 ± 7% perf-profile.calltrace.cycles-pp.mod_objcg_state.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl 0.00 +0.9 0.92 ± 5% perf-profile.calltrace.cycles-pp.refill_obj_stock.kmem_cache_free.posix_lock_inode.do_lock_file_wait.fcntl_setlk 0.00 +1.3 1.26 ± 7% perf-profile.calltrace.cycles-pp.mod_objcg_state.kmem_cache_free.posix_lock_inode.do_lock_file_wait.fcntl_setlk 2.15 +1.4 3.54 ± 14% perf-profile.calltrace.cycles-pp.locks_dispose_list.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl 0.00 +1.6 1.59 ± 11% perf-profile.calltrace.cycles-pp.get_obj_cgroup_from_current.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl 1.14 +1.8 2.90 ± 18% perf-profile.calltrace.cycles-pp.kmem_cache_free.locks_dispose_list.posix_lock_inode.do_lock_file_wait.fcntl_setlk 0.00 +1.8 1.83 ± 6% perf-profile.calltrace.cycles-pp.mod_objcg_state.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait 0.00 +2.1 2.13 ± 29% perf-profile.calltrace.cycles-pp.propagate_protected_usage.page_counter_try_charge.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc 0.00 +2.2 2.16 ± 29% perf-profile.calltrace.cycles-pp.page_counter_cancel.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.fcntl_setlk 0.00 +2.4 2.42 ± 7% perf-profile.calltrace.cycles-pp.get_obj_cgroup_from_current.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait 0.00 +2.6 2.60 ± 28% perf-profile.calltrace.cycles-pp.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.fcntl_setlk.do_fcntl 0.00 +2.7 2.66 ± 27% perf-profile.calltrace.cycles-pp.obj_cgroup_uncharge_pages.kmem_cache_free.fcntl_setlk.do_fcntl.__x64_sys_fcntl 0.00 +3.0 3.04 ± 37% perf-profile.calltrace.cycles-pp.page_counter_cancel.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.posix_lock_inode 2.86 ± 2% +3.6 6.42 ± 10% perf-profile.calltrace.cycles-pp.kmem_cache_free.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64 0.00 +3.6 3.59 ± 33% perf-profile.calltrace.cycles-pp.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk 0.00 +3.6 3.65 ± 36% perf-profile.calltrace.cycles-pp.page_counter_uncharge.obj_cgroup_uncharge_pages.kmem_cache_free.posix_lock_inode.do_lock_file_wait 0.00 +3.7 3.72 ± 36% perf-profile.calltrace.cycles-pp.obj_cgroup_uncharge_pages.kmem_cache_free.posix_lock_inode.do_lock_file_wait.fcntl_setlk 0.00 +4.3 4.29 ± 27% perf-profile.calltrace.cycles-pp.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl 3.76 +5.7 9.47 ± 12% perf-profile.calltrace.cycles-pp.kmem_cache_free.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl 8.70 +6.2 14.88 ± 6% perf-profile.calltrace.cycles-pp.locks_alloc_lock.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64 7.40 +6.3 13.74 ± 7% perf-profile.calltrace.cycles-pp.kmem_cache_alloc.locks_alloc_lock.fcntl_setlk.do_fcntl.__x64_sys_fcntl 83.98 +6.8 90.74 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_fcntl64 82.41 +7.4 89.82 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64 0.00 +7.8 7.75 ± 29% perf-profile.calltrace.cycles-pp.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode 46.22 +7.9 54.10 ± 3% perf-profile.calltrace.cycles-pp.do_lock_file_wait.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64 78.68 +8.9 87.56 perf-profile.calltrace.cycles-pp.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64 0.00 +9.2 9.15 ± 23% perf-profile.calltrace.cycles-pp.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait 73.64 +11.0 84.60 perf-profile.calltrace.cycles-pp.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_fcntl64 0.00 +11.2 11.21 ± 25% perf-profile.calltrace.cycles-pp.page_counter_try_charge.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc.locks_alloc_lock 38.04 +11.7 49.70 ± 4% perf-profile.calltrace.cycles-pp.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl.__x64_sys_fcntl 16.21 +11.8 28.04 ± 5% perf-profile.calltrace.cycles-pp.locks_alloc_lock.posix_lock_inode.do_lock_file_wait.fcntl_setlk.do_fcntl 13.60 +12.1 25.71 ± 6% perf-profile.calltrace.cycles-pp.kmem_cache_alloc.locks_alloc_lock.posix_lock_inode.do_lock_file_wait.fcntl_setlk 63.80 +15.2 78.96 perf-profile.calltrace.cycles-pp.fcntl_setlk.do_fcntl.__x64_sys_fcntl.do_syscall_64.entry_SYSCALL_64_after_hwframe 7.76 -3.4 4.33 ± 6% perf-profile.children.cycles-pp.memset_erms 8.05 -3.4 4.62 ± 7% perf-profile.children.cycles-pp._copy_from_user 5.70 ± 2% -2.8 2.89 ± 18% perf-profile.children.cycles-pp.__entry_text_start 6.00 -2.5 3.47 ± 6% perf-profile.children.cycles-pp._raw_spin_lock 5.10 -2.4 2.66 ± 6% perf-profile.children.cycles-pp.security_file_lock 5.00 -2.2 2.75 ± 8% perf-profile.children.cycles-pp.syscall_return_via_sysret 3.90 -1.9 2.01 ± 7% perf-profile.children.cycles-pp.common_file_perm 3.94 -1.7 2.28 ± 6% perf-profile.children.cycles-pp.copy_user_generic_unrolled 3.74 -1.7 2.08 ± 5% perf-profile.children.cycles-pp.___might_sleep 3.95 -1.6 2.40 ± 6% perf-profile.children.cycles-pp.__might_sleep 2.72 -1.3 1.41 ± 6% perf-profile.children.cycles-pp.locks_delete_lock_ctx 2.58 -1.3 1.29 ± 5% perf-profile.children.cycles-pp.locks_release_private 3.10 -1.3 1.81 ± 6% perf-profile.children.cycles-pp.__fget_light 2.18 -1.0 1.14 ± 6% perf-profile.children.cycles-pp.locks_unlink_lock_ctx 2.18 -1.0 1.15 ± 7% perf-profile.children.cycles-pp.locks_insert_lock_ctx 2.03 -0.9 1.17 ± 7% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 2.19 -0.8 1.34 ± 5% perf-profile.children.cycles-pp.__cond_resched 1.54 -0.7 0.86 ± 7% perf-profile.children.cycles-pp.aa_file_perm 1.54 -0.7 0.87 ± 7% perf-profile.children.cycles-pp.__might_fault 1.68 -0.6 1.07 ± 9% perf-profile.children.cycles-pp.syscall_exit_to_user_mode 1.32 -0.6 0.76 ± 6% perf-profile.children.cycles-pp.syscall_enter_from_user_mode 1.19 -0.5 0.67 ± 6% perf-profile.children.cycles-pp.flock64_to_posix_lock 1.10 -0.4 0.65 ± 5% perf-profile.children.cycles-pp.rcu_all_qs 0.81 -0.4 0.45 ± 7% perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack 0.94 -0.3 0.60 ± 6% perf-profile.children.cycles-pp.__init_waitqueue_head 0.74 -0.3 0.41 ± 4% perf-profile.children.cycles-pp.locks_delete_block 0.75 -0.3 0.42 ± 5% perf-profile.children.cycles-pp.locks_get_lock_context 0.70 -0.3 0.39 ± 7% perf-profile.children.cycles-pp.locks_copy_lock 0.53 -0.3 0.23 ± 5% perf-profile.children.cycles-pp.__list_del_entry_valid 0.78 ± 2% -0.3 0.49 ± 9% perf-profile.children.cycles-pp.exit_to_user_mode_prepare 0.61 -0.3 0.35 ± 8% perf-profile.children.cycles-pp.security_file_fcntl 0.60 -0.2 0.35 ± 11% perf-profile.children.cycles-pp.memset 0.53 -0.2 0.29 ± 6% perf-profile.children.cycles-pp.apparmor_file_lock 0.43 ± 2% -0.2 0.24 ± 7% perf-profile.children.cycles-pp.__list_add_valid 0.43 ± 2% -0.2 0.25 ± 7% perf-profile.children.cycles-pp.vfs_lock_file 0.50 -0.2 0.33 ± 8% perf-profile.children.cycles-pp.testcase 0.37 -0.2 0.21 ± 6% perf-profile.children.cycles-pp.locks_copy_conflock 0.32 ± 2% -0.1 0.18 ± 7% perf-profile.children.cycles-pp.__fdget_raw 0.36 -0.1 0.24 ± 7% perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare 0.22 -0.1 0.12 ± 6% perf-profile.children.cycles-pp.locks_move_blocks 0.41 -0.1 0.32 ± 6% perf-profile.children.cycles-pp.should_failslab 0.20 ± 2% -0.1 0.13 ± 10% [email protected] 0.00 +0.1 0.08 ± 6% perf-profile.children.cycles-pp.get_mem_cgroup_from_objcg 0.00 +0.1 0.08 ± 11% perf-profile.children.cycles-pp.refill_stock 98.10 +0.1 98.23 perf-profile.children.cycles-pp.__libc_fcntl64 0.00 +0.3 0.30 ± 6% perf-profile.children.cycles-pp.obj_cgroup_uncharge 0.00 +0.5 0.53 ± 7% perf-profile.children.cycles-pp.mem_cgroup_from_task 2.41 +1.3 3.69 ± 14% perf-profile.children.cycles-pp.locks_dispose_list 0.00 +2.0 1.99 ± 5% perf-profile.children.cycles-pp.refill_obj_stock 0.32 ± 2% +2.1 2.40 ± 6% perf-profile.children.cycles-pp.rcu_read_unlock_strict 0.00 +3.4 3.39 ± 21% perf-profile.children.cycles-pp.propagate_protected_usage 0.00 +4.9 4.90 ± 8% perf-profile.children.cycles-pp.get_obj_cgroup_from_current 0.00 +5.6 5.60 ± 6% perf-profile.children.cycles-pp.mod_objcg_state 0.00 +5.9 5.94 ± 26% perf-profile.children.cycles-pp.page_counter_cancel 84.29 +6.7 90.98 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 0.00 +7.1 7.12 ± 24% perf-profile.children.cycles-pp.page_counter_uncharge 83.10 +7.2 90.30 perf-profile.children.cycles-pp.do_syscall_64 0.00 +7.3 7.27 ± 24% perf-profile.children.cycles-pp.obj_cgroup_uncharge_pages 46.87 +7.6 54.45 ± 3% perf-profile.children.cycles-pp.do_lock_file_wait 79.26 +8.6 87.90 perf-profile.children.cycles-pp.__x64_sys_fcntl 74.02 +10.8 84.84 perf-profile.children.cycles-pp.do_fcntl 39.59 +11.0 50.57 ± 4% perf-profile.children.cycles-pp.posix_lock_inode 0.00 +11.2 11.23 ± 25% perf-profile.children.cycles-pp.page_counter_try_charge 0.00 +11.4 11.37 ± 24% perf-profile.children.cycles-pp.obj_cgroup_charge_pages 8.04 +11.5 19.54 ± 6% perf-profile.children.cycles-pp.kmem_cache_free 0.00 +13.6 13.63 ± 19% perf-profile.children.cycles-pp.obj_cgroup_charge 64.58 +14.8 79.39 perf-profile.children.cycles-pp.fcntl_setlk 25.73 +17.7 43.45 ± 2% perf-profile.children.cycles-pp.locks_alloc_lock 22.71 +18.8 41.55 ± 3% perf-profile.children.cycles-pp.kmem_cache_alloc 7.42 -3.3 4.14 ± 6% perf-profile.self.cycles-pp.memset_erms 6.55 -3.2 3.35 ± 8% perf-profile.self.cycles-pp.__libc_fcntl64 5.72 -2.4 3.30 ± 6% perf-profile.self.cycles-pp._raw_spin_lock 5.14 -2.4 2.76 ± 5% perf-profile.self.cycles-pp.posix_lock_inode 5.00 -2.2 2.75 ± 8% perf-profile.self.cycles-pp.syscall_return_via_sysret 3.49 -1.7 1.77 ± 4% perf-profile.self.cycles-pp.fcntl_setlk 3.61 -1.5 2.09 ± 6% perf-profile.self.cycles-pp.copy_user_generic_unrolled 3.20 -1.4 1.77 ± 5% perf-profile.self.cycles-pp.___might_sleep 2.97 -1.2 1.74 ± 6% perf-profile.self.cycles-pp.__fget_light 2.35 -1.2 1.14 ± 7% perf-profile.self.cycles-pp.common_file_perm 3.02 -1.2 1.84 ± 6% perf-profile.self.cycles-pp.__might_sleep 2.25 -1.1 1.14 ± 5% perf-profile.self.cycles-pp.locks_release_private 2.38 -0.9 1.47 ± 8% perf-profile.self.cycles-pp.locks_alloc_lock 1.80 -0.8 1.04 ± 7% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 1.39 -0.7 0.71 ± 21% perf-profile.self.cycles-pp.__entry_text_start 1.61 -0.7 0.94 ± 7% perf-profile.self.cycles-pp.__x64_sys_fcntl 1.60 -0.6 0.95 ± 8% perf-profile.self.cycles-pp.do_fcntl 1.43 -0.6 0.79 ± 6% perf-profile.self.cycles-pp.do_lock_file_wait 1.40 -0.6 0.81 ± 7% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 1.31 -0.6 0.73 ± 7% perf-profile.self.cycles-pp.aa_file_perm 1.16 -0.5 0.67 ± 6% perf-profile.self.cycles-pp.syscall_enter_from_user_mode 1.08 -0.5 0.60 ± 6% perf-profile.self.cycles-pp.flock64_to_posix_lock 0.97 -0.4 0.56 ± 6% perf-profile.self.cycles-pp._copy_from_user 1.02 -0.4 0.61 ± 8% perf-profile.self.cycles-pp.do_syscall_64 1.04 -0.4 0.65 ± 4% perf-profile.self.cycles-pp.__cond_resched 0.81 -0.4 0.45 ± 7% perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack 0.76 -0.4 0.42 ± 5% perf-profile.self.cycles-pp.security_file_lock 0.71 -0.3 0.38 ± 8% perf-profile.self.cycles-pp.locks_insert_lock_ctx 0.64 -0.3 0.32 ± 6% perf-profile.self.cycles-pp.locks_unlink_lock_ctx 0.75 ± 2% -0.3 0.44 ± 6% perf-profile.self.cycles-pp.rcu_all_qs 0.70 -0.3 0.42 ± 10% perf-profile.self.cycles-pp.exit_to_user_mode_prepare 0.58 ± 2% -0.3 0.32 ± 5% perf-profile.self.cycles-pp.locks_dispose_list 0.43 -0.3 0.18 ± 7% perf-profile.self.cycles-pp.__list_del_entry_valid 0.52 -0.2 0.29 ± 5% perf-profile.self.cycles-pp.locks_delete_block 0.53 -0.2 0.30 ± 5% perf-profile.self.cycles-pp.locks_get_lock_context 0.63 ± 2% -0.2 0.42 ± 5% perf-profile.self.cycles-pp.__init_waitqueue_head 0.43 -0.2 0.23 ± 9% perf-profile.self.cycles-pp.locks_delete_lock_ctx 0.56 ± 2% -0.2 0.36 ± 11% perf-profile.self.cycles-pp.syscall_exit_to_user_mode 0.43 -0.2 0.25 ± 9% perf-profile.self.cycles-pp.security_file_fcntl 0.32 ± 2% -0.2 0.17 ± 7% perf-profile.self.cycles-pp.__list_add_valid 0.33 -0.2 0.18 ± 9% perf-profile.self.cycles-pp.locks_copy_lock 0.33 -0.1 0.18 ± 7% perf-profile.self.cycles-pp.__might_fault 0.42 ± 2% -0.1 0.27 ± 9% perf-profile.self.cycles-pp.testcase 0.33 ± 2% -0.1 0.18 ± 5% perf-profile.self.cycles-pp.vfs_lock_file 0.32 -0.1 0.18 ± 7% perf-profile.self.cycles-pp.apparmor_file_lock 0.32 ± 2% -0.1 0.18 ± 6% perf-profile.self.cycles-pp.locks_copy_conflock 0.30 ± 3% -0.1 0.18 ± 10% perf-profile.self.cycles-pp.memset 0.26 ± 3% -0.1 0.18 ± 7% perf-profile.self.cycles-pp.syscall_exit_to_user_mode_prepare 0.17 ± 2% -0.1 0.09 ± 7% perf-profile.self.cycles-pp.locks_move_blocks 0.11 ± 4% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.__fdget_raw 0.20 ± 3% -0.0 0.17 ± 6% perf-profile.self.cycles-pp.should_failslab 0.10 ± 4% -0.0 0.07 ± 14% [email protected] 0.00 +0.1 0.06 ± 6% perf-profile.self.cycles-pp.get_mem_cgroup_from_objcg 0.00 +0.1 0.08 ± 11% perf-profile.self.cycles-pp.refill_stock 0.00 +0.1 0.14 ± 10% perf-profile.self.cycles-pp.obj_cgroup_uncharge 0.00 +0.4 0.36 ± 7% perf-profile.self.cycles-pp.mem_cgroup_from_task 0.11 ± 3% +0.8 0.92 ± 5% perf-profile.self.cycles-pp.rcu_read_unlock_strict 0.00 +1.8 1.85 ± 5% perf-profile.self.cycles-pp.refill_obj_stock 0.00 +2.0 2.05 ± 7% perf-profile.self.cycles-pp.obj_cgroup_charge 9.35 +3.0 12.32 ± 4% perf-profile.self.cycles-pp.kmem_cache_alloc 0.00 +3.4 3.36 ± 21% perf-profile.self.cycles-pp.propagate_protected_usage 0.00 +4.0 4.01 ± 8% perf-profile.self.cycles-pp.get_obj_cgroup_from_current 0.00 +5.2 5.23 ± 7% perf-profile.self.cycles-pp.mod_objcg_state 0.00 +5.9 5.90 ± 26% perf-profile.self.cycles-pp.page_counter_cancel 0.00 +9.0 8.97 ± 25% perf-profile.self.cycles-pp.page_counter_try_charge Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. --- 0DAY/LKP+ Test Infrastructure Open Source Technology Center https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation Thanks, Oliver Sang

3 months, 2 weeks

8
18
0 / 0

[xfs] 2229276c52: xfstests.xfs.187.fail

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-11): commit: 2229276c5283264b8c2241c1ed972bbb136cab22 ("xfs: use a separate frextents counter for rt extent reservations") https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master in testcase: xfstests version: xfstests-x86_64-46e1b83-1_20220414 with following parameters: disk: 4HDD fs: xfs test: xfs-external ucode: 0x21 test-description: xfstests is a regression test suite for xfs and other files ystems. test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git on test machine: 4 threads 1 sockets Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 8G memory caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> xfs/187 - output mismatch (see /lkp/benchmarks/xfstests/results//xfs/187.out.bad) --- tests/xfs/187.out 2022-04-14 12:51:49.000000000 +0000 +++ /lkp/benchmarks/xfstests/results//xfs/187.out.bad 2022-04-27 06:19:24.286936517 +0000 @@ -1,3 +1,4 @@ QA output created by 187 Format and mount +Expected fragmented free rt space, found none. Try to write a bunch of stuff to the fragmented rt space ... (Run 'diff -u /lkp/benchmarks/xfstests/tests/xfs/187.out /lkp/benchmarks/xfstests/results//xfs/187.out.bad' to see the entire diff) To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. -- 0-DAY CI Kernel Test Service https://01.org/lkp

3 months, 2 weeks

1
0
0 / 0

[perf bench futex] 1ad71a2c51: perf-sanity-tests.perf.make_fail

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-11): commit: 1ad71a2c51006c6046473a7ff54dd627bd96968f ("perf bench futex: Add support for 32-bit systems with 64-bit time_t") https://github.com/atishp04/linux perf_rv32_fix in testcase: perf-sanity-tests version: perf-x86_64-22da5264abf4-1_20220424 with following parameters: perf_compiler: clang ucode: 0xec on test machine: 8 threads 1 sockets Intel(R) Core(TM) i7-7700 CPU @ 3.60GHz with 32G memory caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> In file included from bench/futex-hash.c:29: bench/futex.h:37:2: error: unknown type name ‘__kernel_old_time_t’ __kernel_old_time_t tv_sec; /* seconds */ ^~~~~~~~~~~~~~~~~~~ make[4]: *** [/usr/src/perf_selftests-x86_64-rhel-8.3-func-1ad71a2c51006c6046473a7ff54dd627bd96968f/tools/build/Makefile.build:97: bench/futex-hash.o] Error +1 make[3]: *** [/usr/src/perf_selftests-x86_64-rhel-8.3-func-1ad71a2c51006c6046473a7ff54dd627bd96968f/tools/build/Makefile.build:139: bench] Error 2 make[3]: *** Waiting for unfinished jobs.... To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. -- 0-DAY CI Kernel Test Service https://01.org/lkp

3 months, 2 weeks

1
0
0 / 0

[net] 02dcea6024: netperf.Throughput_tps -9.1% regression

by kernel test robot

Greeting, FYI, we noticed a -9.1% regression of netperf.Throughput_tps due to commit: commit: 02dcea6024d411cda23bd77e5e604f94a32c332d ("net: allow sk_prot->release_cb() without sock lock held") https://github.com/ammarfaizi2/linux-block axboe/linux-block/sock-nolock.2 in testcase: netperf on test machine: 128 threads 2 sockets Intel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz with 256G memory with following parameters: ip: ipv4 runtime: 300s nr_threads: 25% cluster: cs-localhost test: TCP_RR cpufreq_governor: performance ucode: 0xd000331 test-description: Netperf is a benchmark that can be use to measure various aspect of networking performance. test-url: http://www.netperf.org/netperf/ If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. ========================================================================================= cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/tbox_group/test/testcase/ucode: cs-localhost/gcc-11/performance/ipv4/x86_64-rhel-8.3/25%/debian-10.4-x86_64-20200603.cgz/300s/lkp-icl-2sp2/TCP_RR/netperf/0xd000331 commit: 5aa32dd9bd ("net: add support for fast socket release") 02dcea6024 ("net: allow sk_prot->release_cb() without sock lock held") 5aa32dd9bdb57e4a 02dcea6024d411cda23bd77e5e6 ---------------- --------------------------- %stddev %change %stddev \ | \ 2666474 -9.1% 2425047 netperf.Throughput_total_tps 83327 -9.1% 75782 netperf.Throughput_tps 18796 -17.8% 15449 ± 2% netperf.time.involuntary_context_switches 1409 -9.5% 1275 netperf.time.percent_of_cpu_this_job_got 3992 -9.5% 3614 netperf.time.system_time 252.46 -9.8% 227.82 ± 2% netperf.time.user_time 7.999e+08 -9.1% 7.275e+08 netperf.time.voluntary_context_switches 7.999e+08 -9.1% 7.275e+08 netperf.workload 638430 ± 18% -25.9% 473353 ± 23% sched_debug.cfs_rq:/.spread0.max 82314 ± 2% -37.2% 51672 meminfo.Active 81665 ± 2% -37.2% 51317 meminfo.Active(anon) 7.82 -0.8 7.06 mpstat.cpu.all.soft% 17.06 -1.7 15.36 mpstat.cpu.all.sys% 17958 ± 6% -37.8% 11177 ± 9% numa-vmstat.node1.nr_active_anon 17958 ± 6% -37.8% 11177 ± 9% numa-vmstat.node1.nr_zone_active_anon 38.50 -9.5% 34.83 vmstat.procs.r 10515612 -9.1% 9558579 vmstat.system.cs 5490715 -8.7% 5012829 vmstat.system.in 351502 ± 2% -14.5% 300576 ± 10% numa-meminfo.node0.AnonPages.max 71769 ± 6% -37.7% 44711 ± 9% numa-meminfo.node1.Active 71538 ± 6% -37.7% 44573 ± 9% numa-meminfo.node1.Active(anon) 65476 ± 33% +89.8% 124250 ± 30% numa-meminfo.node1.AnonPages.max 72.60 +2.7 75.28 turbostat.C1% 7392888 ± 2% -11.9% 6516319 turbostat.POLL 0.19 ± 2% -0.0 0.17 turbostat.POLL% 347.54 -2.8% 337.93 turbostat.PkgWatt 20367 ± 2% -37.1% 12807 proc-vmstat.nr_active_anon 81436 -1.8% 79968 proc-vmstat.nr_anon_pages 756705 ± 5% +5.5% 798547 proc-vmstat.nr_mapped 3231 ± 2% +2.3% 3306 proc-vmstat.nr_page_table_pages 20367 ± 2% -37.1% 12807 proc-vmstat.nr_zone_active_anon 739185 ± 4% -11.1% 657230 ± 4% proc-vmstat.numa_hint_faults_local 21363 ± 3% -48.0% 11099 ± 2% proc-vmstat.pgactivate 2272744 -3.8% 2185795 ± 2% proc-vmstat.pgfault 2.071e+10 -10.0% 1.864e+10 perf-stat.i.branch-instructions 1.14 +0.0 1.17 perf-stat.i.branch-miss-rate% 2.304e+08 -7.6% 2.13e+08 perf-stat.i.branch-misses 1.272e+09 -9.5% 1.151e+09 perf-stat.i.cache-references 10601392 -9.1% 9641359 perf-stat.i.context-switches 1.248e+11 -9.2% 1.134e+11 perf-stat.i.cpu-cycles 487.17 -13.9% 419.41 perf-stat.i.cpu-migrations 3.072e+10 -9.7% 2.774e+10 perf-stat.i.dTLB-loads 1.791e+10 -9.5% 1.621e+10 perf-stat.i.dTLB-stores 1.034e+11 -9.7% 9.332e+10 perf-stat.i.instructions 0.87 -1.5% 0.86 perf-stat.i.major-faults 0.97 -9.2% 0.89 perf-stat.i.metric.GHz 123.22 ± 5% -11.6% 108.95 ± 4% perf-stat.i.metric.K/sec 551.53 -9.7% 497.95 perf-stat.i.metric.M/sec 7152 -4.3% 6845 ± 2% perf-stat.i.minor-faults 49.74 ± 14% +13.1 62.89 ± 10% perf-stat.i.node-store-miss-rate% 7153 -4.3% 6846 ± 2% perf-stat.i.page-faults 1.11 +0.0 1.14 perf-stat.overall.branch-miss-rate% 0.02 ± 2% +0.0 0.03 perf-stat.overall.dTLB-load-miss-rate% 2.064e+10 -10.0% 1.857e+10 perf-stat.ps.branch-instructions 2.296e+08 -7.5% 2.123e+08 perf-stat.ps.branch-misses 1.268e+09 -9.5% 1.148e+09 perf-stat.ps.cache-references 10563666 -9.0% 9609247 perf-stat.ps.context-switches 1.244e+11 -9.2% 1.13e+11 perf-stat.ps.cpu-cycles 485.80 -13.9% 418.22 perf-stat.ps.cpu-migrations 3.061e+10 -9.7% 2.765e+10 perf-stat.ps.dTLB-loads 1.784e+10 -9.5% 1.615e+10 perf-stat.ps.dTLB-stores 1.03e+11 -9.7% 9.302e+10 perf-stat.ps.instructions 0.87 -1.4% 0.86 perf-stat.ps.major-faults 7123 -4.2% 6822 ± 2% perf-stat.ps.minor-faults 7124 -4.2% 6823 ± 2% perf-stat.ps.page-faults 3.112e+13 -9.6% 2.813e+13 perf-stat.total.instructions 36.60 -3.4 33.20 perf-profile.calltrace.cycles-pp.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe.send 36.03 -3.3 32.69 perf-profile.calltrace.cycles-pp.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe 35.22 -3.3 31.93 perf-profile.calltrace.cycles-pp.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64 34.40 -3.2 31.23 perf-profile.calltrace.cycles-pp.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto 28.77 -2.8 25.98 perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 28.62 -2.8 25.84 perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg 26.84 -2.6 24.24 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg 25.13 -2.5 22.63 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked 23.88 -2.3 21.56 perf-profile.calltrace.cycles-pp.ip_finish_output2.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames 21.36 -2.1 19.26 perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip_finish_output2.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit 21.14 -2.1 19.04 perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip_finish_output2.__ip_queue_xmit.__tcp_transmit_skb 20.85 -2.1 18.76 perf-profile.calltrace.cycles-pp.__softirqentry_text_start.do_softirq.__local_bh_enable_ip.ip_finish_output2.__ip_queue_xmit 19.58 -2.0 17.56 perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.do_softirq.__local_bh_enable_ip.ip_finish_output2 19.31 -2.0 17.32 perf-profile.calltrace.cycles-pp.__napi_poll.net_rx_action.__softirqentry_text_start.do_softirq.__local_bh_enable_ip 19.27 -2.0 17.28 perf-profile.calltrace.cycles-pp.process_backlog.__napi_poll.net_rx_action.__softirqentry_text_start.do_softirq 18.36 -1.9 16.49 perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.__napi_poll.net_rx_action.__softirqentry_text_start 17.57 -1.8 15.78 perf-profile.calltrace.cycles-pp.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog 18.36 -1.8 16.58 ± 2% perf-profile.calltrace.cycles-pp.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe.send.send_omni_inner 17.68 -1.8 15.90 perf-profile.calltrace.cycles-pp.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog.__napi_poll 17.76 -1.8 15.98 perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.__netif_receive_skb_one_core.process_backlog.__napi_poll.net_rx_action 18.38 -1.7 16.66 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.send.send_omni_inner.send_tcp_rr 18.61 -1.6 16.96 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.send.recv_omni.process_requests 18.41 -1.6 16.78 perf-profile.calltrace.cycles-pp.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe.send.recv_omni 1.97 ± 38% -1.3 0.67 ± 79% perf-profile.calltrace.cycles-pp.send_tcp_rr 1.96 ± 38% -1.3 0.66 ± 79% perf-profile.calltrace.cycles-pp.send_omni_inner.send_tcp_rr 15.27 ± 2% -1.2 14.05 perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.__netif_receive_skb_one_core 15.17 ± 2% -1.2 13.96 perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish 16.41 -1.2 15.23 perf-profile.calltrace.cycles-pp.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe.recv 1.26 ± 39% -0.9 0.36 ±103% perf-profile.calltrace.cycles-pp.send.send_omni_inner.send_tcp_rr 15.46 -0.9 14.55 perf-profile.calltrace.cycles-pp.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64 15.52 -0.9 14.63 perf-profile.calltrace.cycles-pp.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.24 ± 39% -0.9 0.35 ±103% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.send.send_omni_inner.send_tcp_rr 8.98 ± 2% -0.8 8.19 perf-profile.calltrace.cycles-pp.sk_wait_data.tcp_recvmsg_locked.tcp_recvmsg.inet_recvmsg.__sys_recvfrom 14.72 -0.7 14.04 perf-profile.calltrace.cycles-pp.tcp_recvmsg_locked.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom 8.47 -0.7 7.79 ± 3% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.recv.send_omni_inner.send_tcp_rr 8.29 -0.7 7.62 ± 3% perf-profile.calltrace.cycles-pp.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe.recv.send_omni_inner 0.90 ± 27% -0.6 0.25 ±100% perf-profile.calltrace.cycles-pp.ttwu_do_wakeup.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable 8.70 -0.6 8.15 perf-profile.calltrace.cycles-pp.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu 8.45 -0.6 7.90 perf-profile.calltrace.cycles-pp.__wake_up_common_lock.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv 8.19 -0.5 7.66 perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_rcv_established.tcp_v4_do_rcv 5.48 -0.5 4.98 ± 2% perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.wait_woken.sk_wait_data 6.50 -0.5 6.01 ± 2% perf-profile.calltrace.cycles-pp.wait_woken.sk_wait_data.tcp_recvmsg_locked.tcp_recvmsg.inet_recvmsg 5.66 -0.5 5.16 ± 2% perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg_locked 8.17 -0.5 7.68 perf-profile.calltrace.cycles-pp.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe.recv.recv_omni 5.73 -0.5 5.24 ± 2% perf-profile.calltrace.cycles-pp.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg_locked.tcp_recvmsg 8.38 -0.5 7.90 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.recv.recv_omni.process_requests 7.32 -0.4 6.92 perf-profile.calltrace.cycles-pp.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable.tcp_rcv_established 5.53 -0.4 5.14 perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 3.99 -0.4 3.61 ± 2% perf-profile.calltrace.cycles-pp.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu 5.30 -0.4 4.92 perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 3.09 -0.3 2.80 ± 2% perf-profile.calltrace.cycles-pp.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv 2.18 -0.2 1.94 ± 2% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.schedule_timeout.wait_woken 0.55 -0.2 0.34 ± 70% perf-profile.calltrace.cycles-pp.prepare_task_switch.__schedule.schedule_idle.do_idle.cpu_startup_entry 2.73 -0.2 2.54 perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule_idle.do_idle.cpu_startup_entry 1.87 -0.2 1.68 ± 3% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.schedule_timeout 2.10 -0.2 1.94 perf-profile.calltrace.cycles-pp.sysvec_reschedule_ipi.asm_sysvec_reschedule_ipi.acpi_idle_do_entry.acpi_idle_enter.cpuidle_enter_state 1.65 -0.1 1.50 ± 2% perf-profile.calltrace.cycles-pp.skb_release_data.__kfree_skb.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established 1.68 -0.1 1.53 ± 2% perf-profile.calltrace.cycles-pp.__kfree_skb.tcp_clean_rtx_queue.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv 2.02 -0.1 1.89 perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__schedule.schedule_idle.do_idle 1.98 ± 2% -0.1 1.86 perf-profile.calltrace.cycles-pp.__dev_queue_xmit.ip_finish_output2.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit 1.70 -0.1 1.58 ± 2% perf-profile.calltrace.cycles-pp.tcp_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 1.62 -0.1 1.50 ± 2% perf-profile.calltrace.cycles-pp.__alloc_skb.tcp_stream_alloc_skb.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg 2.23 -0.1 2.12 ± 2% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable 2.65 -0.1 2.54 perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.tcp_recvmsg_locked.tcp_recvmsg.inet_recvmsg.__sys_recvfrom 1.32 -0.1 1.21 ± 2% perf-profile.calltrace.cycles-pp.kfree.skb_release_data.__kfree_skb.tcp_clean_rtx_queue.tcp_ack 2.13 -0.1 2.02 ± 2% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.__wake_up_common.__wake_up_common_lock 2.60 -0.1 2.50 perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.tcp_recvmsg_locked.tcp_recvmsg.inet_recvmsg 1.55 -0.1 1.46 ± 2% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.__wake_up_common 0.94 -0.1 0.86 ± 2% perf-profile.calltrace.cycles-pp.tick_nohz_idle_exit.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 1.21 ± 2% -0.1 1.14 ± 3% perf-profile.calltrace.cycles-pp.select_task_rq.try_to_wake_up.__wake_up_common.__wake_up_common_lock.sock_def_readable 0.90 -0.1 0.83 perf-profile.calltrace.cycles-pp.irqentry_enter.sysvec_reschedule_ipi.asm_sysvec_reschedule_ipi.acpi_idle_do_entry.acpi_idle_enter 0.61 -0.1 0.54 ± 4% perf-profile.calltrace.cycles-pp.nr_iowait_cpu.tick_nohz_idle_exit.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 0.58 ± 2% -0.1 0.52 perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule_idle.do_idle.cpu_startup_entry 0.77 ± 2% -0.1 0.72 ± 3% perf-profile.calltrace.cycles-pp.native_apic_msr_eoi_write.sysvec_reschedule_ipi.asm_sysvec_reschedule_ipi.acpi_idle_do_entry.acpi_idle_enter 1.14 -0.0 1.10 ± 2% perf-profile.calltrace.cycles-pp.dev_hard_start_xmit.__dev_queue_xmit.ip_finish_output2.__ip_queue_xmit.__tcp_transmit_skb 1.05 ± 2% +0.2 1.21 ± 3% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.cpuidle_idle_call.do_idle.cpu_startup_entry 0.63 +0.2 0.80 ± 3% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.cpuidle_idle_call.do_idle 1.89 +0.2 2.08 ± 2% perf-profile.calltrace.cycles-pp.menu_select.cpuidle_idle_call.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 0.00 +0.5 0.54 ± 5% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt 44.47 +0.8 45.32 perf-profile.calltrace.cycles-pp.asm_sysvec_reschedule_ipi.acpi_idle_do_entry.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter 0.00 +1.1 1.07 ± 8% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.acpi_idle_do_entry 6.15 +1.1 7.30 perf-profile.calltrace.cycles-pp.acpi_idle_do_entry.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call 0.00 +1.2 1.16 ± 7% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.acpi_idle_do_entry.acpi_idle_enter 0.71 ± 2% +1.2 1.96 ± 6% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.acpi_idle_do_entry.acpi_idle_enter.cpuidle_enter_state 39.37 +4.5 43.85 perf-profile.calltrace.cycles-pp.cpu_startup_entry.secondary_startup_64_no_verify 39.23 +4.5 43.71 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 39.66 +4.6 44.22 perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify 28.60 +4.8 33.37 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry 28.69 +4.8 33.47 perf-profile.calltrace.cycles-pp.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 27.08 +4.8 31.91 perf-profile.calltrace.cycles-pp.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle 31.37 +5.0 36.35 perf-profile.calltrace.cycles-pp.cpuidle_idle_call.do_idle.cpu_startup_entry.secondary_startup_64_no_verify 2.56 ± 2% +7.7 10.24 ± 6% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.acpi_idle_do_entry.acpi_idle_enter.cpuidle_enter_state.cpuidle_enter 54.71 -4.2 50.49 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 54.30 -4.2 50.09 perf-profile.children.cycles-pp.do_syscall_64 38.52 -3.4 35.14 perf-profile.children.cycles-pp.send 36.82 -3.2 33.58 perf-profile.children.cycles-pp.__x64_sys_sendto 36.63 -3.2 33.41 perf-profile.children.cycles-pp.__sys_sendto 36.06 -3.2 32.90 perf-profile.children.cycles-pp.sock_sendmsg 35.28 -3.1 32.18 perf-profile.children.cycles-pp.tcp_sendmsg 34.49 -3.0 31.49 perf-profile.children.cycles-pp.tcp_sendmsg_locked 28.93 -2.5 26.39 perf-profile.children.cycles-pp.__tcp_push_pending_frames 28.82 -2.5 26.29 perf-profile.children.cycles-pp.tcp_write_xmit 29.26 -2.3 26.92 ± 2% perf-profile.children.cycles-pp.send_tcp_rr 29.40 -2.3 27.11 perf-profile.children.cycles-pp.recv_omni 29.41 -2.3 27.12 perf-profile.children.cycles-pp.process_requests 29.56 -2.3 27.30 perf-profile.children.cycles-pp.send_omni_inner 27.13 -1.9 25.22 perf-profile.children.cycles-pp.__tcp_transmit_skb 25.38 -1.9 23.51 perf-profile.children.cycles-pp.__ip_queue_xmit 24.09 -1.7 22.35 perf-profile.children.cycles-pp.ip_finish_output2 21.72 -1.7 20.03 perf-profile.children.cycles-pp.__local_bh_enable_ip 21.32 -1.6 19.72 perf-profile.children.cycles-pp.do_softirq 19.77 -1.5 18.27 perf-profile.children.cycles-pp.net_rx_action 19.48 -1.5 18.00 perf-profile.children.cycles-pp.__napi_poll 19.44 -1.5 17.97 perf-profile.children.cycles-pp.process_backlog 21.18 -1.5 19.72 perf-profile.children.cycles-pp.__softirqentry_text_start 18.52 -1.4 17.12 perf-profile.children.cycles-pp.__netif_receive_skb_one_core 17.76 -1.3 16.42 perf-profile.children.cycles-pp.tcp_v4_rcv 17.85 -1.3 16.52 perf-profile.children.cycles-pp.ip_protocol_deliver_rcu 17.91 -1.3 16.59 perf-profile.children.cycles-pp.ip_local_deliver_finish 15.82 -1.3 14.56 perf-profile.children.cycles-pp.tcp_v4_do_rcv 15.73 -1.2 14.49 perf-profile.children.cycles-pp.tcp_rcv_established 19.41 -1.1 18.30 perf-profile.children.cycles-pp.recv 11.24 -1.0 10.19 perf-profile.children.cycles-pp.__schedule 16.57 -1.0 15.56 perf-profile.children.cycles-pp.__sys_recvfrom 9.40 -1.0 8.40 perf-profile.children.cycles-pp.sk_wait_data 16.62 -1.0 15.63 perf-profile.children.cycles-pp.__x64_sys_recvfrom 15.85 -1.0 14.87 perf-profile.children.cycles-pp.tcp_recvmsg 15.91 -1.0 14.93 perf-profile.children.cycles-pp.inet_recvmsg 15.29 -0.9 14.37 perf-profile.children.cycles-pp.tcp_recvmsg_locked 9.07 -0.8 8.32 perf-profile.children.cycles-pp.sock_def_readable 8.82 -0.7 8.08 perf-profile.children.cycles-pp.__wake_up_common_lock 8.54 -0.7 7.82 perf-profile.children.cycles-pp.__wake_up_common 6.86 -0.7 6.14 perf-profile.children.cycles-pp.wait_woken 6.04 -0.7 5.36 perf-profile.children.cycles-pp.schedule_timeout 5.96 -0.7 5.29 perf-profile.children.cycles-pp.schedule 7.78 -0.6 7.14 perf-profile.children.cycles-pp.try_to_wake_up 1.29 -0.4 0.88 ± 2% perf-profile.children.cycles-pp._raw_spin_lock_bh 5.59 -0.4 5.21 perf-profile.children.cycles-pp.schedule_idle 4.25 -0.4 3.88 perf-profile.children.cycles-pp.tcp_ack 3.25 -0.3 2.90 perf-profile.children.cycles-pp.pick_next_task_fair 2.31 -0.3 2.00 ± 2% perf-profile.children.cycles-pp.dequeue_task_fair 3.31 -0.3 3.02 perf-profile.children.cycles-pp.tcp_clean_rtx_queue 2.03 -0.2 1.78 ± 2% perf-profile.children.cycles-pp.dequeue_entity 2.40 ± 2% -0.2 2.17 perf-profile.children.cycles-pp.__kfree_skb 2.80 -0.2 2.60 perf-profile.children.cycles-pp.skb_copy_datagram_iter 2.76 -0.2 2.57 perf-profile.children.cycles-pp.__skb_datagram_iter 2.36 -0.2 2.17 perf-profile.children.cycles-pp.ttwu_do_activate 2.26 -0.2 2.08 perf-profile.children.cycles-pp.enqueue_task_fair 1.80 -0.2 1.62 perf-profile.children.cycles-pp.tcp_stream_alloc_skb 2.14 -0.2 1.97 perf-profile.children.cycles-pp.sysvec_reschedule_ipi 1.86 -0.2 1.71 ± 2% perf-profile.children.cycles-pp.update_load_avg 1.70 -0.1 1.56 perf-profile.children.cycles-pp.enqueue_entity 1.86 -0.1 1.72 perf-profile.children.cycles-pp.skb_release_data 0.38 ± 9% -0.1 0.24 ± 7% perf-profile.children.cycles-pp.newidle_balance 2.12 -0.1 1.99 perf-profile.children.cycles-pp.__dev_queue_xmit 0.88 -0.1 0.75 ± 2% perf-profile.children.cycles-pp.update_curr 1.73 -0.1 1.60 perf-profile.children.cycles-pp.__alloc_skb 2.10 -0.1 1.97 perf-profile.children.cycles-pp.set_next_entity 1.13 -0.1 1.01 ± 2% perf-profile.children.cycles-pp.ttwu_do_wakeup 1.07 -0.1 0.95 ± 2% perf-profile.children.cycles-pp.check_preempt_curr 1.28 -0.1 1.17 ± 2% perf-profile.children.cycles-pp.select_task_rq 0.67 ± 2% -0.1 0.57 ± 2% perf-profile.children.cycles-pp.release_sock 1.40 -0.1 1.30 ± 2% perf-profile.children.cycles-pp.kfree 1.11 -0.1 1.02 ± 2% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 1.08 -0.1 0.99 perf-profile.children.cycles-pp._copy_to_iter 0.51 ± 9% -0.1 0.42 ± 6% perf-profile.children.cycles-pp.skb_release_head_state 0.44 ± 10% -0.1 0.35 ± 6% perf-profile.children.cycles-pp.dst_release 0.71 -0.1 0.62 perf-profile.children.cycles-pp.finish_task_switch 0.97 -0.1 0.88 ± 2% perf-profile.children.cycles-pp.tick_nohz_idle_exit 1.07 -0.1 0.99 ± 2% perf-profile.children.cycles-pp.__slab_free 0.68 -0.1 0.60 ± 3% perf-profile.children.cycles-pp.__ksize 0.90 -0.1 0.82 ± 3% perf-profile.children.cycles-pp.prepare_task_switch 1.72 -0.1 1.64 perf-profile.children.cycles-pp._raw_spin_lock_irqsave 0.89 -0.1 0.82 ± 2% perf-profile.children.cycles-pp.copyout 0.92 -0.1 0.84 perf-profile.children.cycles-pp.__check_object_size 0.59 -0.1 0.51 ± 2% perf-profile.children.cycles-pp.security_socket_sendmsg 0.92 ± 2% -0.1 0.85 perf-profile.children.cycles-pp.skb_do_copy_data_nocache 0.84 -0.1 0.77 ± 2% perf-profile.children.cycles-pp.select_task_rq_fair 2.30 -0.1 2.23 perf-profile.children.cycles-pp.update_rq_clock 0.56 -0.1 0.50 ± 3% perf-profile.children.cycles-pp.sk_page_frag_refill 1.08 -0.1 1.02 ± 2% perf-profile.children.cycles-pp.__switch_to 0.60 ± 4% -0.1 0.53 ± 3% perf-profile.children.cycles-pp.tcp_eat_recv_skb 0.65 -0.1 0.59 ± 3% perf-profile.children.cycles-pp.nr_iowait_cpu 1.09 -0.1 1.02 perf-profile.children.cycles-pp.loopback_xmit 0.54 -0.1 0.48 ± 3% perf-profile.children.cycles-pp.skb_page_frag_refill 1.17 -0.1 1.11 perf-profile.children.cycles-pp.xmit_one 0.98 ± 3% -0.1 0.92 perf-profile.children.cycles-pp.__inet_lookup_established 0.77 -0.1 0.71 ± 3% perf-profile.children.cycles-pp.remove_wait_queue 0.12 ± 44% -0.1 0.07 ± 11% perf-profile.children.cycles-pp.ipv4_dst_check 0.82 -0.1 0.76 ± 3% perf-profile.children.cycles-pp.tcp_queue_rcv 0.75 -0.1 0.70 perf-profile.children.cycles-pp.simple_copy_to_iter 1.21 -0.1 1.16 perf-profile.children.cycles-pp.dev_hard_start_xmit 0.58 ± 2% -0.1 0.53 perf-profile.children.cycles-pp.switch_mm_irqs_off 0.93 -0.1 0.88 perf-profile.children.cycles-pp.irqentry_enter 0.58 ± 2% -0.1 0.53 ± 4% perf-profile.children.cycles-pp.select_idle_sibling 0.65 -0.1 0.60 perf-profile.children.cycles-pp.__might_resched 0.61 -0.0 0.56 ± 3% perf-profile.children.cycles-pp.___perf_sw_event 0.13 ± 7% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.resched_curr 0.12 ± 36% -0.0 0.08 ± 13% perf-profile.children.cycles-pp.ip_rcv_finish_core 0.46 ± 2% -0.0 0.41 ± 5% perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template 0.67 ± 2% -0.0 0.62 perf-profile.children.cycles-pp._copy_from_iter 0.60 -0.0 0.56 perf-profile.children.cycles-pp.__entry_text_start 0.53 ± 2% -0.0 0.49 ± 3% perf-profile.children.cycles-pp.lock_sock_nested 0.13 ± 29% -0.0 0.08 ± 11% perf-profile.children.cycles-pp.__sk_dst_check 0.50 -0.0 0.46 ± 4% perf-profile.children.cycles-pp.__update_load_avg_se 0.57 ± 2% -0.0 0.53 ± 3% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq 0.35 -0.0 0.31 ± 3% perf-profile.children.cycles-pp.validate_xmit_skb 0.66 -0.0 0.62 perf-profile.children.cycles-pp.__x2apic_send_IPI_dest 0.64 ± 2% -0.0 0.60 perf-profile.children.cycles-pp.syscall_return_via_sysret 0.57 ± 2% -0.0 0.53 ± 2% perf-profile.children.cycles-pp.recv_data 0.53 ± 3% -0.0 0.49 perf-profile.children.cycles-pp.pick_next_entity 0.44 ± 2% -0.0 0.41 perf-profile.children.cycles-pp.aa_sk_perm 0.33 ± 3% -0.0 0.30 ± 2% perf-profile.children.cycles-pp.__might_sleep 0.22 ± 2% -0.0 0.18 ± 6% perf-profile.children.cycles-pp.__list_del_entry_valid 0.20 ± 5% -0.0 0.17 ± 8% perf-profile.children.cycles-pp.sock_rfree 0.12 ± 4% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.put_prev_task_fair 0.71 -0.0 0.68 ± 2% perf-profile.children.cycles-pp._raw_spin_lock_irq 0.43 ± 2% -0.0 0.40 ± 5% perf-profile.children.cycles-pp.kmalloc_reserve 0.44 ± 2% -0.0 0.40 ± 3% perf-profile.children.cycles-pp.kmem_cache_free 0.40 ± 2% -0.0 0.37 ± 4% perf-profile.children.cycles-pp.__kmalloc_node_track_caller 0.37 ± 2% -0.0 0.34 ± 3% perf-profile.children.cycles-pp.save_fpregs_to_fpstate 0.21 ± 3% -0.0 0.19 ± 6% perf-profile.children.cycles-pp.perf_tp_event 0.20 ± 4% -0.0 0.17 ± 6% perf-profile.children.cycles-pp.tcp_update_skb_after_send 0.30 ± 3% -0.0 0.28 ± 2% perf-profile.children.cycles-pp.tcp_schedule_loss_probe 0.11 ± 5% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.inet_ehashfn 0.27 -0.0 0.24 ± 3% perf-profile.children.cycles-pp.copyin 0.20 ± 2% -0.0 0.17 ± 7% perf-profile.children.cycles-pp.tcp_cleanup_rbuf 0.14 ± 6% -0.0 0.12 ± 9% perf-profile.children.cycles-pp.update_min_vruntime 0.39 -0.0 0.36 perf-profile.children.cycles-pp.__netif_rx 0.22 ± 2% -0.0 0.20 ± 4% perf-profile.children.cycles-pp.reweight_entity 0.10 ± 3% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.import_single_range 0.10 ± 5% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime 0.36 -0.0 0.34 perf-profile.children.cycles-pp.netif_rx_internal 0.30 ± 2% -0.0 0.27 perf-profile.children.cycles-pp.__cond_resched 0.33 -0.0 0.31 perf-profile.children.cycles-pp.enqueue_to_backlog 0.42 -0.0 0.40 ± 2% perf-profile.children.cycles-pp.tick_nohz_idle_enter 0.08 ± 6% -0.0 0.06 ± 9% perf-profile.children.cycles-pp.skb_clone_tx_timestamp 0.11 -0.0 0.10 ± 5% perf-profile.children.cycles-pp.perf_trace_buf_update 0.08 ± 5% -0.0 0.07 ± 5% perf-profile.children.cycles-pp.tcp_rate_skb_delivered 0.08 ± 6% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.tcp_release_cb 0.97 +0.0 1.00 perf-profile.children.cycles-pp.sched_clock_cpu 0.80 +0.0 0.83 perf-profile.children.cycles-pp.native_sched_clock 0.04 ± 45% +0.0 0.08 ± 6% perf-profile.children.cycles-pp._raw_spin_trylock 0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.__intel_pmu_enable_all 0.00 +0.1 0.06 perf-profile.children.cycles-pp.run_rebalance_domains 0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.arch_scale_freq_tick 0.05 ± 8% +0.1 0.12 ± 4% perf-profile.children.cycles-pp.lapic_next_deadline 0.05 +0.1 0.12 ± 6% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler 0.09 ± 7% +0.1 0.17 ± 5% perf-profile.children.cycles-pp.rebalance_domains 0.00 +0.1 0.08 ± 24% perf-profile.children.cycles-pp.ktime_get_update_offsets_now 0.10 ± 3% +0.1 0.19 ± 5% perf-profile.children.cycles-pp.scheduler_tick 0.08 ± 12% +0.1 0.19 ± 27% perf-profile.children.cycles-pp.tick_irq_enter 0.16 ± 3% +0.1 0.29 ± 6% perf-profile.children.cycles-pp.update_process_times 0.01 ±223% +0.1 0.14 ± 11% perf-profile.children.cycles-pp.tick_nohz_irq_exit 0.09 ± 10% +0.1 0.22 ± 21% perf-profile.children.cycles-pp.irq_enter_rcu 0.17 ± 2% +0.1 0.30 ± 5% perf-profile.children.cycles-pp.tick_sched_handle 1.09 +0.2 1.25 ± 3% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length 0.06 ± 7% +0.2 0.22 ± 11% perf-profile.children.cycles-pp.timekeeping_max_deferment 0.66 +0.2 0.84 ± 3% perf-profile.children.cycles-pp.tick_nohz_next_event 0.22 +0.2 0.40 ± 5% perf-profile.children.cycles-pp.tick_sched_timer 0.19 ± 10% +0.2 0.37 ± 5% perf-profile.children.cycles-pp.__irq_exit_rcu 1.94 +0.2 2.13 perf-profile.children.cycles-pp.menu_select 0.21 ± 7% +0.2 0.43 ± 12% perf-profile.children.cycles-pp.clockevents_program_event 1.49 +0.3 1.78 ± 7% perf-profile.children.cycles-pp.ktime_get 0.31 +0.3 0.64 ± 4% perf-profile.children.cycles-pp.__hrtimer_run_queues 0.61 ± 3% +0.6 1.23 ± 6% perf-profile.children.cycles-pp.hrtimer_interrupt 0.64 ± 2% +0.7 1.34 ± 6% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt 1.02 ± 2% +1.2 2.20 ± 5% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt 2.02 ± 2% +4.5 6.49 ± 5% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt 39.56 +4.6 44.11 perf-profile.children.cycles-pp.do_idle 39.66 +4.6 44.22 perf-profile.children.cycles-pp.secondary_startup_64_no_verify 39.66 +4.6 44.22 perf-profile.children.cycles-pp.cpu_startup_entry 28.82 +4.8 33.66 perf-profile.children.cycles-pp.cpuidle_enter_state 28.89 +4.8 33.74 perf-profile.children.cycles-pp.cpuidle_enter 27.27 +4.9 32.16 perf-profile.children.cycles-pp.acpi_idle_enter 26.91 +4.9 31.81 perf-profile.children.cycles-pp.acpi_idle_do_entry 31.64 +5.0 36.69 perf-profile.children.cycles-pp.cpuidle_idle_call 1.26 -0.4 0.86 ± 2% perf-profile.self.cycles-pp._raw_spin_lock_bh 1.88 -0.1 1.76 perf-profile.self.cycles-pp.update_rq_clock 1.10 -0.1 1.01 ± 2% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 0.43 ± 11% -0.1 0.34 ± 7% perf-profile.self.cycles-pp.dst_release 1.38 ± 2% -0.1 1.30 perf-profile.self.cycles-pp.tcp_sendmsg_locked 0.98 -0.1 0.90 perf-profile.self.cycles-pp.tcp_recvmsg_locked 0.67 -0.1 0.59 ± 2% perf-profile.self.cycles-pp.__ksize 1.06 -0.1 0.98 ± 2% perf-profile.self.cycles-pp.__slab_free 1.68 -0.1 1.60 perf-profile.self.cycles-pp._raw_spin_lock_irqsave 1.43 -0.1 1.35 perf-profile.self.cycles-pp.set_next_entity 0.37 -0.1 0.29 ± 3% perf-profile.self.cycles-pp.__local_bh_enable_ip 0.88 ± 2% -0.1 0.80 perf-profile.self.cycles-pp.update_load_avg 0.76 ± 2% -0.1 0.68 ± 2% perf-profile.self.cycles-pp.enqueue_entity 0.64 -0.1 0.57 ± 2% perf-profile.self.cycles-pp.finish_task_switch 0.54 -0.1 0.47 ± 3% perf-profile.self.cycles-pp.skb_page_frag_refill 0.44 ± 2% -0.1 0.38 ± 3% perf-profile.self.cycles-pp.update_curr 0.24 ± 3% -0.1 0.18 ± 2% perf-profile.self.cycles-pp.dequeue_task_fair 0.74 -0.1 0.67 ± 3% perf-profile.self.cycles-pp.tcp_rcv_established 0.64 -0.1 0.58 ± 4% perf-profile.self.cycles-pp.nr_iowait_cpu 0.71 ± 2% -0.1 0.65 perf-profile.self.cycles-pp.tcp_clean_rtx_queue 1.04 -0.1 0.98 ± 2% perf-profile.self.cycles-pp.__switch_to 0.65 -0.1 0.59 ± 3% perf-profile.self.cycles-pp.__wake_up_common 0.12 ± 47% -0.1 0.06 ± 13% perf-profile.self.cycles-pp.ipv4_dst_check 1.48 -0.1 1.42 ± 2% perf-profile.self.cycles-pp.__schedule 0.73 -0.1 0.68 perf-profile.self.cycles-pp.__check_object_size 0.13 ± 5% -0.1 0.08 ± 6% perf-profile.self.cycles-pp.resched_curr 0.73 ± 2% -0.1 0.68 ± 2% perf-profile.self.cycles-pp.try_to_wake_up 0.58 ± 2% -0.1 0.53 perf-profile.self.cycles-pp.switch_mm_irqs_off 0.12 ± 38% -0.0 0.07 ± 9% perf-profile.self.cycles-pp.ip_rcv_finish_core 0.81 ± 2% -0.0 0.76 ± 3% perf-profile.self.cycles-pp.tcp_queue_rcv 0.11 ± 32% -0.0 0.07 ± 16% perf-profile.self.cycles-pp.ipv4_mtu 0.71 -0.0 0.66 perf-profile.self.cycles-pp.irqentry_enter 0.60 -0.0 0.55 perf-profile.self.cycles-pp.__might_resched 0.31 -0.0 0.26 perf-profile.self.cycles-pp.dequeue_entity 0.51 ± 4% -0.0 0.47 ± 4% perf-profile.self.cycles-pp.__ip_queue_xmit 0.50 ± 2% -0.0 0.46 ± 3% perf-profile.self.cycles-pp.kfree 0.54 -0.0 0.49 ± 2% perf-profile.self.cycles-pp.___perf_sw_event 0.44 ± 3% -0.0 0.40 perf-profile.self.cycles-pp.skb_release_data 0.43 -0.0 0.39 ± 3% perf-profile.self.cycles-pp.recv_omni 0.45 -0.0 0.41 ± 4% perf-profile.self.cycles-pp.__update_load_avg_se 0.44 ± 2% -0.0 0.40 ± 3% perf-profile.self.cycles-pp.select_task_rq 0.84 -0.0 0.81 perf-profile.self.cycles-pp.__skb_datagram_iter 0.28 -0.0 0.24 ± 5% perf-profile.self.cycles-pp.security_socket_sendmsg 0.66 -0.0 0.62 ± 2% perf-profile.self.cycles-pp.__x2apic_send_IPI_dest 0.51 ± 3% -0.0 0.48 perf-profile.self.cycles-pp.pick_next_entity 0.63 ± 2% -0.0 0.59 perf-profile.self.cycles-pp.syscall_return_via_sysret 0.40 ± 3% -0.0 0.36 ± 2% perf-profile.self.cycles-pp.tcp_eat_recv_skb 0.82 -0.0 0.79 perf-profile.self.cycles-pp.wait_woken 0.57 -0.0 0.53 ± 3% perf-profile.self.cycles-pp.enqueue_task_fair 0.38 ± 2% -0.0 0.35 ± 2% perf-profile.self.cycles-pp.sk_wait_data 0.18 ± 4% -0.0 0.15 ± 8% perf-profile.self.cycles-pp.__list_del_entry_valid 0.52 ± 2% -0.0 0.49 ± 2% perf-profile.self.cycles-pp.recv_data 0.20 ± 7% -0.0 0.16 ± 7% perf-profile.self.cycles-pp.sock_rfree 0.32 ± 2% -0.0 0.30 ± 3% perf-profile.self.cycles-pp.sysvec_reschedule_ipi 0.36 ± 2% -0.0 0.34 ± 2% perf-profile.self.cycles-pp.save_fpregs_to_fpstate 0.28 -0.0 0.25 ± 6% perf-profile.self.cycles-pp.prepare_task_switch 0.27 ± 3% -0.0 0.24 ± 3% perf-profile.self.cycles-pp.__might_sleep 0.34 ± 2% -0.0 0.31 ± 4% perf-profile.self.cycles-pp.recv 0.26 ± 2% -0.0 0.23 ± 2% perf-profile.self.cycles-pp.net_rx_action 0.17 ± 2% -0.0 0.14 ± 5% perf-profile.self.cycles-pp.newidle_balance 0.10 ± 5% -0.0 0.08 ± 10% perf-profile.self.cycles-pp.inet_ehashfn 0.45 ± 2% -0.0 0.43 ± 2% perf-profile.self.cycles-pp.tcp_write_xmit 0.19 ± 4% -0.0 0.17 ± 7% perf-profile.self.cycles-pp.select_task_rq_fair 0.22 ± 2% -0.0 0.19 ± 3% perf-profile.self.cycles-pp.reweight_entity 0.25 ± 3% -0.0 0.22 ± 2% perf-profile.self.cycles-pp.aa_sk_perm 0.21 ± 2% -0.0 0.19 ± 4% perf-profile.self.cycles-pp.process_backlog 0.19 ± 3% -0.0 0.17 ± 2% perf-profile.self.cycles-pp.__x64_sys_sendto 0.12 ± 6% -0.0 0.10 ± 9% perf-profile.self.cycles-pp.update_min_vruntime 0.33 ± 2% -0.0 0.31 ± 3% perf-profile.self.cycles-pp.loopback_xmit 0.10 ± 5% -0.0 0.08 ± 6% perf-profile.self.cycles-pp.perf_trace_sched_stat_runtime 0.09 ± 4% -0.0 0.07 ± 9% perf-profile.self.cycles-pp.import_single_range 0.11 ± 6% -0.0 0.09 ± 5% perf-profile.self.cycles-pp.tcp_update_skb_after_send 0.13 ± 2% -0.0 0.11 ± 8% perf-profile.self.cycles-pp.perf_trace_sched_wakeup_template 0.08 ± 7% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.cpus_share_cache 0.08 ± 9% -0.0 0.06 ± 9% perf-profile.self.cycles-pp.tcp_tso_segs 0.18 ± 2% -0.0 0.17 ± 2% perf-profile.self.cycles-pp.__cond_resched 0.13 ± 3% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.__hrtimer_next_event_base 0.08 ± 6% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.tcp_rate_skb_delivered 0.12 ± 3% +0.0 0.14 ± 3% perf-profile.self.cycles-pp.update_irq_load_avg 0.07 ± 5% +0.0 0.09 ± 6% perf-profile.self.cycles-pp.tcp_recvmsg 0.06 ± 7% +0.0 0.08 ± 8% perf-profile.self.cycles-pp.tcp_release_cb 0.15 ± 4% +0.0 0.18 ± 2% perf-profile.self.cycles-pp.sock_sendmsg 0.04 ± 45% +0.0 0.08 ± 6% perf-profile.self.cycles-pp._raw_spin_trylock 0.77 +0.0 0.80 perf-profile.self.cycles-pp.native_sched_clock 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.__intel_pmu_enable_all 0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.sysvec_apic_timer_interrupt 0.00 +0.1 0.06 ± 9% perf-profile.self.cycles-pp.arch_scale_freq_tick 0.00 +0.1 0.07 ± 7% perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt 0.05 ± 8% +0.1 0.12 ± 4% perf-profile.self.cycles-pp.lapic_next_deadline 0.06 ± 8% +0.2 0.22 ± 12% perf-profile.self.cycles-pp.timekeeping_max_deferment 0.22 ± 3% +0.2 0.42 ± 4% perf-profile.self.cycles-pp.release_sock 0.64 ± 2% +0.3 0.93 ± 12% perf-profile.self.cycles-pp.ktime_get 22.15 +3.8 25.92 perf-profile.self.cycles-pp.acpi_idle_do_entry Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. -- 0-DAY CI Kernel Test Service https://01.org/lkp

3 months, 2 weeks

1
0
0 / 0

[PCI/PM] 5bffe4c611: BUG:kernel_reboot-without-warning_in_test_stage

by kernel test robot

Greeting, FYI, we noticed the following commit (built with clang-15): commit: 5bffe4c611f567d83c579378c54b13c21fd0fb98 ("PCI/PM: Rework changing power states of PCI devices") https://git.kernel.org/cgit/linux/kernel/git/helgaas/pci.git pci/pm in testcase: boot on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 4G caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> please be noted, since we didn't find direct clue to the issue caused by this commit, while making sure the config is same for it and parent, we rerun more times. we observed there is a 25% rate on this commit, but keeps clean on parent. e8a37022c16ae719 5bffe4c611f567d83c579378c54 ---------------- --------------------------- fail:runs %reproduction fail:runs | | | :100 25% 25:100 dmesg.BUG:kernel_reboot-without-warning_in_test_stage then we noticed that the 'bad' run on this commit generally stop abruptly like below (detail dmesg attached as dmesg.xz): [ 43.150719][ T41] rcu-scale: 1 writer-duration: 51 14438086 [ 43.150723][ T41] rcu-scale: 1 writer-duration: 52 13912616 [ 43.150728][ T41] rcu-scale: 1 writer-duration: 53 8321817 [ 43.150732][ T41] rcu-scale: 1 writer-duration: 54 13430914 [ 43.150737][ T41] rcu-scale: 1 writer-duration: 55 5860957 BUG: kernel reboot-without-warning in test stage and for those 'good' runs on this commit, generally end up like: (detail dmesg attached as dmesg-good.xz) [ 26.204793][ T41] rcu-scale: 1 writer-duration: 99 10163595 [ 26.205348][ T41] rcu-scale: 1 writer-duration: 100 20268875 [ 26.228712][ T41] rcu-scale: 1 writer-duration: 101 18695075 [ 26.229309][ T41] rcu-scale: 1 writer-duration: 102 13985570 [ 26.229873][ T41] rcu-scale: 1 writer-duration: 103 6422709 [ 26.242702][ T41] ACPI: PM: Preparing to enter system sleep state S5 [ 26.248010][ T41] reboot: Power down and for parent, generally ends up like: (detail dmesg attached as dmesg-parent.xz) [ 31.312023][ T41] rcu-scale: 1 writer-duration: 99 13060706 [ 31.312952][ T41] rcu-scale: 1 writer-duration: 100 9798062 [ 31.363511][ T41] rcu-scale: 1 writer-duration: 101 12240715 [ 31.364526][ T41] rcu-scale: 1 writer-duration: 102 16554300 [ 31.365456][ T41] rcu-scale: 1 writer-duration: 103 18276029 [ 32.468788][ T340] _warn_unseeded_randomness: 32 callbacks suppressed [ 32.468795][ T340] random: get_random_u32 called from arch_pick_mmap_layout+0x7b/0x190 with crng_init=1 [ 32.469575][ T340] random: get_random_u32 called from randomize_stack_top+0x27/0x50 with crng_init=1 [ 32.469582][ T340] random: get_random_u32 called from arch_align_stack+0x29/0x40 with crng_init=1 [ 33.164431][ T41] ACPI: PM: Preparing to enter system sleep state S5 [ 33.173518][ T41] reboot: Power down To reproduce: # build kernel cd linux cp config-5.18.0-rc1-00005-g5bffe4c611f5 .config make HOSTCC=clang-15 CC=clang-15 ARCH=i386 olddefconfig prepare modules_prepare bzImage modules make HOSTCC=clang-15 CC=clang-15 ARCH=i386 INSTALL_MOD_PATH=<mod-install-dir> modules_install cd <mod-install-dir> find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. -- 0-DAY CI Kernel Test Service https://01.org/lkp

3 months, 2 weeks

1
0
0 / 0

[dma] 81503894b2: WARNING:at_drivers/gpu/drm/drm_mm.c:#drm_mm_takedown[drm]

by kernel test robot

Greeting, FYI, we noticed the following commit (built with gcc-11): commit: 81503894b26294f97f732563263752ea44add7c7 ("[PATCH 3/3] dma-buf: generalize fence merging") url: https://github.com/intel-lab-lkp/linux/commits/Christian-K-nig/dma-buf-sy... base: https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git d615b5416f8a1afeb82d13b238f8152c572d59c0 patch link: https://lore.kernel.org/dri-devel/20220426124637.329764-3-christian.koeni... in testcase: igt version: igt-x86_64-c2b13bab-1_20220427 with following parameters: group: group-04 ucode: 0xec on test machine: 12 threads 1 sockets Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz with 32G memory caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace): If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> [ 55.768078][ T2464] ------------[ cut here ]------------ [ 55.780592][ T439] jbd2_revoke_record_s 0 0 64 64 1 : tunables 0 0 0 : slabdata 0 0 0 [ 55.781248][ T2464] Memory manager not clean during takedown. [ 55.781269][ T2464] WARNING: CPU: 11 PID: 2464 at drivers/gpu/drm/drm_mm.c:999 drm_mm_takedown+0x3d/0x80 [drm] [ 55.786549][ T439] [ 55.788115][ T439] ext4_fc_dentry_update 0 0 128 32 1 : tunables 0 0 0 : slabdata 0 0 0 [ 55.798170][ T2464] Modules linked in: btrfs [ 55.803906][ T439] [ 55.813867][ T2464] blake2b_generic xor raid6_pq zstd_compress libcrc32c [ 55.817555][ T439] ext4_inode_cache 0 0 1304 25 8 : tunables 0 0 0 : slabdata 0 0 0 [ 55.827752][ T2464] i915(-) intel_gtt [ 55.832010][ T439] [ 55.833493][ T439] ext4_free_data 0 0 88 46 1 : tunables 0 0 0 : slabdata 0 0 0 [ 55.834196][ T2464] ipmi_devintf drm_buddy [ 55.840960][ T439] [ 55.842533][ T439] ext4_allocation_context 0 0 208 39 2 : tunables 0 0 0 : slabdata 0 0 0 [ 55.852294][ T2464] ipmi_msghandler drm_dp_helper [ 55.856043][ T439] [ 55.858224][ T2464] sd_mod ttm t10_pi drm_kms_helper crc64_rocksoft_generic crc64_rocksoft crc64 syscopyarea sg [ 55.871096][ T439] ext4_prealloc_space 0 0 168 24 1 : tunables 0 0 0 : slabdata 0 0 0 [ 55.873753][ T2464] sysfillrect sysimgblt [ 55.875940][ T439] [ 55.887787][ T2464] intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass [ 55.894065][ T439] ext4_system_zone 0 0 56 73 1 : tunables 0 0 0 : slabdata 0 0 0 [ 55.894774][ T2464] crct10dif_pclmul [ 55.904905][ T439] [ 55.916416][ T2464] crc32_pclmul crc32c_intel intel_wmi_thunderbolt wmi_bmof fb_sys_fops ghash_clmulni_intel rapl intel_cstate [ 55.921993][ T439] ext4_io_end_vec 0 0 48 85 1 : tunables 0 0 0 : slabdata 0 0 0 [ 55.922703][ T2464] ahci mei_wdt libahci intel_uncore [ 55.933870][ T439] [ 55.945209][ T2464] mei_me i2c_designware_platform libata i2c_designware_core drm idma64 mei intel_pch_thermal [ 55.950355][ T439] ext4_io_end 0 0 96 42 1 : tunables 0 0 0 : slabdata 0 0 0 [ 55.951079][ T2464] wmi video [ 55.962498][ T439] [ 55.964087][ T439] ext4_bio_post_read_ctx 128 128 64 64 1 : tunables 0 0 0 : slabdata 2 2 0 [ 55.973846][ T2464] intel_pmc_core acpi_pad ip_tables [ 55.973849][ T2464] CPU: 11 PID: 2464 Comm: i915_module_loa Not tainted 5.18.0-rc4-00009-g81503894b262 #1 [ 55.978971][ T439] [ 55.981161][ T2464] Hardware name: Dell Inc. OptiPlex 7060/0C96W1, BIOS 1.4.2 06/11/2019 [ 55.981163][ T2464] RIP: 0010:drm_mm_takedown+0x3d/0x80 [drm] [ 55.992780][ T439] ext4_pending_reservation 0 0 48 85 1 : tunables 0 0 0 : slabdata 0 0 0 [ 56.002540][ T2464] Code: 38 48 89 ea 53 48 89 fb 48 c1 ea 03 80 3c 02 00 75 1d 48 8b 43 38 48 39 c5 75 03 5b 5d c3 48 c7 c7 40 47 52 c0 e8 40 f7 01 c3 <0f> 0b 5b 5d c3 48 89 ef e8 36 6b 46 c1 eb d9 66 66 2e 0f 1f 84 00 [ 56.005591][ T439] [ 56.007091][ T439] ext4_extent_status 0 0 56 73 1 : tunables 0 0 0 : slabdata 0 0 0 [ 56.007783][ T2464] RSP: 0018:ffffc9000661fb70 EFLAGS: 00010286 [ 56.019562][ T439] [ 56.024695][ T2464] [ 56.024696][ T2464] RAX: 0000000000000000 RBX: ffff8882890a5690 RCX: 0000000000000000 [ 56.024698][ T2464] RDX: 0000000000000027 RSI: 0000000000000004 RDI: fffff52000cc3f60 [ 56.035705][ T439] mbcache 0 0 88 46 1 : tunables 0 0 0 : slabdata 0 0 0 [ 56.036430][ T2464] RBP: ffff8882890a56c8 R08: 0000000000000001 R09: ffff8887357a774b [ 56.044496][ T439] [ 56.045973][ T439] io_kiocb 0 0 320 25 2 : tunables 0 0 0 : slabdata 0 0 0 [ 56.050234][ T2464] R10: ffffed10e6af4ee9 R11: 0000000000000001 R12: 0000000000000002 [ 56.050236][ T2464] R13: ffffffffc128b2c0 R14: dffffc0000000000 R15: ffff8882890a6458 [ 56.062182][ T439] [ 56.081547][ T2464] FS: 00007f43b5b46c00(0000) GS:ffff888735780000(0000) knlGS:0000000000000000 [ 56.081549][ T2464] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 56.085225][ T439] kioctx 0 0 704 23 4 : tunables 0 0 0 : slabdata 0 0 0 [ 56.095174][ T2464] CR2: 0000565235713758 CR3: 0000000209e8e006 CR4: 00000000003706e0 [ 56.101072][ T439] [ 56.103271][ T2464] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 56.103272][ T2464] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 56.103273][ T2464] Call Trace: [ 56.103275][ T2464] <TASK> [ 56.106939][ T439] aio_kiocb 0 0 256 32 2 : tunables 0 0 0 : slabdata 0 0 0 [ 56.113257][ T2464] release_stolen_smem+0x5a/0x80 [i915] [ 56.121055][ T439] [ 56.122589][ T439] userfaultfd_ctx_cache 0 0 192 21 1 : tunables 0 0 0 : slabdata 0 0 0 [ 56.132403][ T2464] intel_memory_regions_driver_release+0x9e/0x180 [i915] [ 56.140200][ T439] [ 56.141703][ T439] fanotify_perm_event 0 0 104 39 1 : tunables 0 0 0 : slabdata 0 0 0 [ 56.142400][ T2464] ? i915_gem_driver_release+0xca/0x200 [i915] [ 56.153732][ T439] [ 56.155246][ T439] fanotify_path_event 0 0 96 42 1 : tunables 0 0 0 : slabdata 0 0 0 [ 56.161524][ T2464] i915_driver_release+0x8f/0x1c0 [i915] [ 56.169331][ T439] [ 56.171523][ T2464] devm_drm_dev_init_release+0x82/0x100 [drm] [ 56.181764][ T439] fanotify_fid_event 0 0 104 39 1 : tunables 0 0 0 : slabdata 0 0 0 [ 56.186693][ T2464] release_nodes+0xb1/0x240 [ 56.198030][ T439] [ 56.199507][ T439] fsnotify_mark 0 0 104 39 1 : tunables 0 0 0 : slabdata 0 0 0 [ 56.205837][ T2464] devres_release_all+0x106/0x180 [ 56.208025][ T439] [ 56.209502][ T439] dnotify_mark 0 0 112 36 1 : tunables 0 0 0 : slabdata 0 0 0 [ 56.215824][ T2464] ? devres_remove_group+0x580/0x580 [ 56.223618][ T439] [ 56.225096][ T439] dnotify_struct 0 0 48 85 1 : tunables 0 0 0 : slabdata 0 0 0 [ 56.226759][ T2464] ? mutex_unlock+0x80/0x100 [ 56.229555][ T439] [ 56.231042][ T439] dio 0 0 768 21 4 : tunables 0 0 0 : slabdata 0 0 0 [ 56.240884][ T2464] ? __mutex_unlock_slowpath+0x2c0/0x2c0 [ 56.246266][ T439] [ 56.247756][ T439] fasync_cache 0 0 64 64 1 : tunables 0 0 0 : slabdata 0 0 0 [ 56.248450][ T2464] device_unbind_cleanup+0x16/0x1c0 [ 56.260144][ T439] [ 56.261618][ T439] audit_tree_mark 0 0 112 36 1 : tunables 0 0 0 : slabdata 0 0 0 [ 56.267009][ T2464] device_release_driver_internal+0x3cb/0x5c0 [ 56.269199][ T439] [ 56.270674][ T439] pid_namespace 0 0 200 20 1 : tunables 0 0 0 : slabdata 0 0 0 [ 56.280721][ T2464] driver_detach+0xc0/0x180 [ 56.286712][ T439] [ 56.288203][ T439] posix_timers_cache 0 0 320 25 2 : tunables 0 0 0 : slabdata 0 0 0 [ 56.288904][ T2464] ? i915_pci_register_driver+0x40/0x40 [i915] [ 56.300410][ T439] [ 56.305889][ T2464] bus_remove_driver+0xe4/0x300 [ 56.305892][ T2464] ? i915_pci_register_driver+0x40/0x40 [i915] [ 56.309558][ T439] rpc_inode_cache 39 39 832 39 8 : tunables 0 0 0 : slabdata 1 1 0 [ 56.313981][ T2464] pci_unregister_driver+0x26/0x280 [ 56.325402][ T439] [ 56.326876][ T439] rpc_buffers 15 15 2176 15 8 : tunables 0 0 0 : slabdata 1 1 0 [ 56.329754][ T2464] ? unregister_sysctl_table+0x7d/0x180 [ 56.331946][ T439] [ 56.333425][ T439] rpc_tasks 25 25 320 25 2 : tunables 0 0 0 : slabdata 1 1 0 [ 56.343288][ T2464] ? i915_pci_register_driver+0x40/0x40 [i915] [ 56.348153][ T439] [ 56.349631][ T439] UNIX-STREAM 601 728 1216 26 8 : tunables 0 0 0 : slabdata 28 28 0 [ 56.350344][ T2464] i915_exit+0x7e/0xc8 [i915] [ 56.361680][ T439] [ 56.363158][ T439] UNIX 312 312 1216 26 8 : tunables 0 0 0 : slabdata 12 12 0 [ 56.366810][ T2464] __do_sys_delete_module+0x2d6/0x500 [ 56.369004][ T439] [ 56.370479][ T439] ip4-frags 0 0 264 31 2 : tunables 0 0 0 : slabdata 0 0 0 [ 56.380352][ T2464] ? free_module+0x5c0/0x5c0 [ 56.384785][ T439] [ 56.386263][ T439] ip_mrt_cache 0 0 256 32 2 : tunables 0 0 0 : slabdata 0 0 0 [ 56.386982][ T2464] ? task_work_run+0xef/0x180 [ 56.398319][ T439] [ 56.404828][ T2464] ? exit_to_user_mode_loop+0xbc/0x140 [ 56.408487][ T439] UDP-Lite 0 0 1280 25 8 : tunables 0 0 0 : slabdata 0 0 0 [ 56.418351][ T2464] do_syscall_64+0x3b/0xc0 [ 56.423390][ T439] [ 56.424864][ T439] tcp_bind_bucket 96 96 128 32 1 : tunables 0 0 0 : slabdata 3 3 0 [ 56.425572][ T2464] entry_SYSCALL_64_after_hwframe+0x44/0xae [ 56.436951][ T439] [ 56.442815][ T2464] RIP: 0033:0x7f43b94f3807 [ 56.442818][ T2464] Code: 73 01 c3 48 8b 0d 89 06 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 b8 b0 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 59 06 0c 00 f7 d8 64 89 01 48 [ 56.446526][ T439] inet_peer_cache 0 0 256 32 2 : tunables 0 0 0 : slabdata 0 0 0 [ 56.456370][ T2464] RSP: 002b:00007ffcb1ddb9c8 EFLAGS: 00000206 ORIG_RAX: 00000000000000b0 [ 56.460718][ T439] [ 56.462909][ T2464] RAX: ffffffffffffffda RBX: 000056523570dbc0 RCX: 00007f43b94f3807 [ 56.462910][ T2464] RDX: 0000000000000000 RSI: 0000000000000800 RDI: 000056523570dc28 [ 56.462912][ T2464] RBP: 00007f43b967ffc2 R08: 000056523570dc28 R09: 00007f43b9573e80 [ 56.462913][ T2464] R10: fffffffffffff80d R11: 0000000000000206 R12: 0000000000000000 [ 56.462914][ T2464] R13: 0000000000000000 R14: 0000000000000000 R15: 000056523570dbc0 [ 56.475823][ T439] xfrm_dst_cache 0 0 384 21 2 : tunables 0 0 0 : slabdata 0 0 0 [ 56.480333][ T2464] </TASK> [ 56.482522][ T439] [ 56.487204][ T2464] ---[ end trace 0000000000000000 ]--- ... [ 72.764392][ T2464] ============================================================================= [ 72.773226][ T2464] BUG i915_vma_resource (Tainted: G B W ): Objects remaining in i915_vma_resource on __kmem_cache_shutdown() [ 72.785604][ T2464] ----------------------------------------------------------------------------- [ 72.785604][ T2464] [ 72.796594][ T2464] Slab 0x000000005697c6d8 objects=21 used=2 fp=0x0000000014a9417a flags=0x17ffffc0010200(slab|head|node=0|zone=2|lastcpupid=0x1fffff) [ 72.810086][ T2464] CPU: 0 PID: 2464 Comm: i915_module_loa Tainted: G B W 5.18.0-rc4-00009-g81503894b262 #1 [ 72.820905][ T2464] Hardware name: Dell Inc. OptiPlex 7060/0C96W1, BIOS 1.4.2 06/11/2019 [ 72.828960][ T2464] Call Trace: [ 72.832099][ T2464] <TASK> [ 72.834887][ T2464] dump_stack_lvl+0x34/0x44 [ 72.839227][ T2464] slab_err+0x95/0x100 [ 72.843147][ T2464] ? _raw_write_lock_irq+0x100/0x100 [ 72.848273][ T2464] __kmem_cache_shutdown+0x176/0x380 [ 72.853393][ T2464] ? i915_vma_resource_bind_dep_await+0x2c0/0x2c0 [i915] [ 72.860329][ T2464] kmem_cache_destroy+0x53/0x140 [ 72.865103][ T2464] i915_exit+0x7e/0xc8 [i915] [ 72.869708][ T2464] __do_sys_delete_module+0x2d6/0x500 [ 72.875946][ T2464] ? free_module+0x5c0/0x5c0 [ 72.880379][ T2464] ? task_work_run+0xef/0x180 [ 72.884897][ T2464] ? exit_to_user_mode_loop+0xbc/0x140 [ 72.890187][ T2464] do_syscall_64+0x3b/0xc0 [ 72.894440][ T2464] entry_SYSCALL_64_after_hwframe+0x44/0xae [ 72.900168][ T2464] RIP: 0033:0x7f43b94f3807 [ 72.904421][ T2464] Code: 73 01 c3 48 8b 0d 89 06 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 b8 b0 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 59 06 0c 00 f7 d8 64 89 01 48 [ 72.923778][ T2464] RSP: 002b:00007ffcb1ddb9c8 EFLAGS: 00000206 ORIG_RAX: 00000000000000b0 [ 72.932001][ T2464] RAX: ffffffffffffffda RBX: 000056523570dbc0 RCX: 00007f43b94f3807 [ 72.939790][ T2464] RDX: 0000000000000000 RSI: 0000000000000800 RDI: 000056523570dc28 [ 72.947592][ T2464] RBP: 00007f43b967ffc2 R08: 000056523570dc28 R09: 00007f43b9573e80 [ 72.955389][ T2464] R10: fffffffffffff80d R11: 0000000000000206 R12: 0000000000000000 [ 72.963187][ T2464] R13: 0000000000000000 R14: 0000000000000000 R15: 000056523570dbc0 [ 72.970980][ T2464] </TASK> [ 72.973851][ T2464] Object 0x000000008bd30ce1 @offset=0 [ 72.979061][ T2464] Object 0x00000000530ee48b @offset=768 To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. -- 0-DAY CI Kernel Test Service https://01.org/lkp

3 months, 2 weeks

1
0
0 / 0

[memcg] a8c49af3be: hackbench.throughput -13.7% regression

by kernel test robot

Greeting, FYI, we noticed a -13.7% regression of hackbench.throughput due to commit: commit: a8c49af3be5f0b4e105ef678bcf14ef102c270be ("memcg: add per-memcg total kernel memory stat") https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master in testcase: hackbench on test machine: 144 threads 4 sockets Intel(R) Xeon(R) Gold 5318H CPU @ 2.50GHz with 128G memory with following parameters: nr_threads: 100% iterations: 4 mode: process ipc: socket cpufreq_governor: performance ucode: 0x7002402 test-description: Hackbench is both a benchmark and a stress test for the Linux kernel scheduler. test-url: https://github.com/linux-test-project/ltp/blob/master/testcases/kernel/sc... If you fix the issue, kindly add following tag Reported-by: kernel test robot <oliver.sang(a)intel.com> Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests sudo bin/lkp install job.yaml # job file is attached in this email bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run sudo bin/lkp run generated-yaml-file # if come across any failure that blocks the test, # please remove ~/.lkp and /lkp dir to run from a clean state. ========================================================================================= compiler/cpufreq_governor/ipc/iterations/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode: gcc-11/performance/socket/4/x86_64-rhel-8.3/process/100%/debian-10.4-x86_64-20200603.cgz/lkp-cpl-4sp1/hackbench/0x7002402 commit: 086f694a75 ("memcg: replace in_interrupt() with !in_task()") a8c49af3be ("memcg: add per-memcg total kernel memory stat") 086f694a75e1a283 a8c49af3be5f0b4e105ef678bcf ---------------- --------------------------- %stddev %change %stddev \ | \ 146519 -13.7% 126397 hackbench.throughput 465.89 +16.0% 540.43 hackbench.time.elapsed_time 465.89 +16.0% 540.43 hackbench.time.elapsed_time.max 1.365e+08 +134.1% 3.195e+08 ± 4% hackbench.time.involuntary_context_switches 1081515 -1.2% 1068489 hackbench.time.minor_page_faults 64911 +16.3% 75465 hackbench.time.system_time 881.14 +13.8% 1002 ± 2% hackbench.time.user_time 4.932e+08 +64.6% 8.118e+08 ± 2% hackbench.time.voluntary_context_switches 8890038 ± 2% -9.7% 8027307 ± 5% cpuidle..usage 0.92 ± 8% -0.2 0.75 ± 3% mpstat.cpu.all.idle% 520.66 +14.4% 595.64 uptime.boot 4116231 ± 24% -31.2% 2829999 vmstat.memory.cache 2419 +15.2% 2787 vmstat.procs.r 1365633 +53.8% 2100818 ± 3% vmstat.system.cs 474436 +7.1% 508066 vmstat.system.in 6918013 ± 2% -10.6% 6186096 ± 6% turbostat.C1 0.17 ± 2% -0.0 0.13 ± 8% turbostat.C1% 2.219e+08 +24.2% 2.756e+08 turbostat.IRQ 77.06 ± 41% +89.9 166.98 ± 18% turbostat.PKG_% 168785 ± 4% -13.4% 146121 ± 6% turbostat.POLL 12.90 -3.0% 12.51 turbostat.RAMWatt 22559 ± 31% -72.5% 6205 ± 17% numa-vmstat.node1.nr_mapped 44041 ± 72% -83.4% 7326 ± 29% numa-vmstat.node2.nr_mapped 356860 ± 83% -72.4% 98563 ± 35% numa-vmstat.node3.nr_file_pages 298316 ± 98% -81.4% 55524 ± 39% numa-vmstat.node3.nr_inactive_anon 173115 ± 67% -81.7% 31623 ± 31% numa-vmstat.node3.nr_mapped 331661 ± 84% -73.6% 87449 ± 20% numa-vmstat.node3.nr_shmem 298316 ± 98% -81.4% 55524 ± 39% numa-vmstat.node3.nr_zone_inactive_anon 89451 ± 30% -72.7% 24378 ± 16% numa-meminfo.node1.Mapped 646515 ± 44% -40.7% 383140 ± 10% numa-meminfo.node1.MemUsed 176662 ± 74% -83.8% 28692 ± 31% numa-meminfo.node2.Mapped 1412634 ± 82% -72.5% 388045 ± 37% numa-meminfo.node3.FilePages 1177774 ± 97% -81.5% 218044 ± 39% numa-meminfo.node3.Inactive 1177724 ± 97% -81.5% 218020 ± 39% numa-meminfo.node3.Inactive(anon) 683613 ± 66% -82.0% 122794 ± 30% numa-meminfo.node3.Mapped 1311837 ± 83% -73.8% 343589 ± 20% numa-meminfo.node3.Shmem 264986 ± 14% -25.0% 198630 meminfo.AnonHugePages 565103 ± 6% -15.3% 478657 meminfo.AnonPages 3964125 ± 25% -32.5% 2674706 meminfo.Cached 4438897 ± 23% -31.1% 3056960 meminfo.Committed_AS 2072000 ± 50% -67.2% 680434 ± 3% meminfo.Inactive 2071852 ± 50% -67.2% 680284 ± 3% meminfo.Inactive(anon) 1089862 ± 40% -76.3% 258095 ± 8% meminfo.Mapped 6895125 ± 16% -23.8% 5253586 meminfo.Memused 1702379 ± 58% -75.7% 413429 ± 9% meminfo.Shmem 8070861 ± 9% -15.9% 6789345 meminfo.max_used_kB 141199 ± 7% -15.3% 119614 proc-vmstat.nr_anon_pages 991360 ± 25% -32.5% 669416 proc-vmstat.nr_file_pages 518274 ± 50% -67.1% 170500 ± 3% proc-vmstat.nr_inactive_anon 273252 ± 40% -76.2% 65048 ± 7% proc-vmstat.nr_mapped 425922 ± 58% -75.6% 104096 ± 9% proc-vmstat.nr_shmem 171279 -2.1% 167755 proc-vmstat.nr_slab_unreclaimable 518274 ± 50% -67.1% 170500 ± 3% proc-vmstat.nr_zone_inactive_anon 469239 ± 6% -15.6% 396202 ± 6% proc-vmstat.numa_hint_faults 185166 ± 12% -28.6% 132127 ± 6% proc-vmstat.numa_hint_faults_local 3355174 ± 6% -9.3% 3042305 proc-vmstat.numa_hit 808.67 ± 49% -77.9% 178.83 ± 30% proc-vmstat.numa_huge_pte_updates 3159673 ± 7% -10.2% 2838054 proc-vmstat.numa_local 1090825 ± 20% -35.3% 706208 ± 8% proc-vmstat.numa_pte_updates 3354920 ± 6% -9.7% 3030203 proc-vmstat.pgalloc_normal 128080 +5.2% 134798 proc-vmstat.pgreuse 15.63 +17.7% 18.39 ± 2% sched_debug.cfs_rq:/.h_nr_running.avg 29887102 +17.5% 35111287 sched_debug.cfs_rq:/.min_vruntime.avg 31706400 +19.7% 37943439 sched_debug.cfs_rq:/.min_vruntime.max 28371071 +17.7% 33383999 sched_debug.cfs_rq:/.min_vruntime.min 16172 +15.1% 18619 sched_debug.cfs_rq:/.runnable_avg.avg 28777 ± 2% +12.6% 32399 ± 4% sched_debug.cfs_rq:/.runnable_avg.max 4370 ± 3% +21.2% 5295 sched_debug.cfs_rq:/.runnable_avg.stddev -970533 +134.4% -2274896 sched_debug.cfs_rq:/.spread0.avg -2495736 +59.8% -3988405 sched_debug.cfs_rq:/.spread0.min 652.14 +17.4% 765.56 ± 2% sched_debug.cfs_rq:/.util_est_enqueued.avg 268143 +12.2% 300732 sched_debug.cpu.clock.avg 268614 +12.2% 301319 sched_debug.cpu.clock.max 267598 +12.1% 300055 sched_debug.cpu.clock.min 265605 +12.2% 297967 sched_debug.cpu.clock_task.avg 266221 +12.2% 298692 sched_debug.cpu.clock_task.max 255412 +13.1% 288952 sched_debug.cpu.clock_task.min 614363 ± 12% -15.2% 521164 ± 3% sched_debug.cpu.max_idle_balance_cost.max 15786 ± 75% -83.1% 2670 ±128% sched_debug.cpu.max_idle_balance_cost.stddev 15.62 +17.6% 18.37 ± 2% sched_debug.cpu.nr_running.avg 2018911 +84.0% 3714095 ± 3% sched_debug.cpu.nr_switches.avg 2458462 +96.3% 4825151 ± 7% sched_debug.cpu.nr_switches.max 1666277 ± 2% +82.2% 3036247 ± 2% sched_debug.cpu.nr_switches.min 223152 ± 5% +55.8% 347737 ± 24% sched_debug.cpu.nr_switches.stddev 267560 +12.1% 300014 sched_debug.cpu_clk 266694 +12.2% 299146 sched_debug.ktime 267988 +12.5% 301408 sched_debug.sched_clk 9.18 +13.0% 10.38 perf-stat.i.MPKI 1.666e+10 -5.8% 1.569e+10 perf-stat.i.branch-instructions 0.66 +0.1 0.74 perf-stat.i.branch-miss-rate% 1.077e+08 +6.1% 1.143e+08 perf-stat.i.branch-misses 29.90 +2.1 31.97 perf-stat.i.cache-miss-rate% 2.342e+08 ± 2% +11.6% 2.612e+08 perf-stat.i.cache-misses 7.854e+08 +4.5% 8.208e+08 perf-stat.i.cache-references 1383443 +50.8% 2085643 ± 2% perf-stat.i.context-switches 5.45 +8.5% 5.92 perf-stat.i.cpi 2018 ± 2% -10.9% 1798 perf-stat.i.cycles-between-cache-misses 0.04 ± 8% +0.0 0.05 ± 5% perf-stat.i.dTLB-load-miss-rate% 10109576 ± 8% +23.4% 12476386 ± 4% perf-stat.i.dTLB-load-misses 2.532e+10 -6.9% 2.356e+10 perf-stat.i.dTLB-loads 1.519e+10 -6.8% 1.415e+10 perf-stat.i.dTLB-stores 78.43 -9.1 69.30 perf-stat.i.iTLB-load-miss-rate% 11711446 +62.4% 19016979 ± 2% perf-stat.i.iTLB-loads 8.626e+10 -6.3% 8.082e+10 perf-stat.i.instructions 2055 ± 3% -7.7% 1896 ± 2% perf-stat.i.instructions-per-iTLB-miss 0.19 -6.3% 0.18 perf-stat.i.ipc 401.73 -6.5% 375.76 perf-stat.i.metric.M/sec 8239 -8.9% 7507 perf-stat.i.minor-faults 54.62 +10.0 64.63 perf-stat.i.node-load-miss-rate% 33956668 +21.8% 41363894 ± 2% perf-stat.i.node-load-misses 28154709 ± 2% -20.2% 22471179 ± 2% perf-stat.i.node-loads 42.25 +6.7 48.93 ± 2% perf-stat.i.node-store-miss-rate% 30479438 -27.6% 22069554 ± 3% perf-stat.i.node-stores 8283 -8.8% 7551 perf-stat.i.page-faults 9.07 +11.1% 10.08 perf-stat.overall.MPKI 0.64 +0.1 0.73 perf-stat.overall.branch-miss-rate% 30.15 +2.0 32.12 perf-stat.overall.cache-miss-rate% 5.43 +6.3% 5.77 perf-stat.overall.cpi 1986 -10.3% 1782 perf-stat.overall.cycles-between-cache-misses 0.04 ± 8% +0.0 0.05 ± 4% perf-stat.overall.dTLB-load-miss-rate% 78.66 -9.2 69.43 perf-stat.overall.iTLB-load-miss-rate% 2032 ± 3% -8.2% 1866 ± 2% perf-stat.overall.instructions-per-iTLB-miss 0.18 -5.9% 0.17 perf-stat.overall.ipc 53.32 +10.4 63.69 perf-stat.overall.node-load-miss-rate% 40.73 +7.3 48.00 ± 2% perf-stat.overall.node-store-miss-rate% 1.66e+10 -5.3% 1.572e+10 perf-stat.ps.branch-instructions 1.065e+08 +7.2% 1.141e+08 perf-stat.ps.branch-misses 2.353e+08 +11.4% 2.62e+08 perf-stat.ps.cache-misses 7.803e+08 +4.6% 8.158e+08 perf-stat.ps.cache-references 1363684 +54.1% 2101320 ± 3% perf-stat.ps.context-switches 9967137 ± 8% +25.5% 12506012 ± 4% perf-stat.ps.dTLB-load-misses 2.525e+10 -6.7% 2.357e+10 perf-stat.ps.dTLB-loads 1.515e+10 -6.6% 1.415e+10 perf-stat.ps.dTLB-stores 11478062 +66.4% 19099333 ± 3% perf-stat.ps.iTLB-loads 8.601e+10 -5.9% 8.091e+10 perf-stat.ps.instructions 6594 -14.3% 5654 perf-stat.ps.minor-faults 32996552 +22.6% 40437559 perf-stat.ps.node-load-misses 28888598 ± 2% -20.2% 23051761 perf-stat.ps.node-loads 31218471 -27.8% 22546119 ± 2% perf-stat.ps.node-stores 6619 -14.2% 5676 perf-stat.ps.page-faults 4.015e+13 +9.1% 4.38e+13 perf-stat.total.instructions 13.60 -13.6 0.00 perf-profile.calltrace.cycles-pp.obj_cgroup_charge_pages.obj_cgroup_charge.slab_pre_alloc_hook.__kmalloc_node_track_caller.kmalloc_reserve 12.93 ± 2% -12.9 0.00 perf-profile.calltrace.cycles-pp.page_counter_charge.obj_cgroup_charge_pages.obj_cgroup_charge.slab_pre_alloc_hook.__kmalloc_node_track_caller 6.85 -6.9 0.00 perf-profile.calltrace.cycles-pp.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags 6.51 -6.5 0.00 perf-profile.calltrace.cycles-pp.page_counter_charge.obj_cgroup_charge_pages.obj_cgroup_charge.kmem_cache_alloc_node.__alloc_skb 13.00 -0.9 12.06 ± 4% perf-profile.calltrace.cycles-pp.page_counter_uncharge.obj_cgroup_uncharge_pages.memcg_slab_free_hook.kfree.skb_release_data 2.33 ± 4% -0.9 1.40 ± 4% perf-profile.calltrace.cycles-pp.skb_release_head_state.consume_skb.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter 2.31 ± 4% -0.9 1.38 ± 4% perf-profile.calltrace.cycles-pp.unix_destruct_scm.skb_release_head_state.consume_skb.unix_stream_read_generic.unix_stream_recvmsg 2.26 ± 4% -0.9 1.35 ± 4% perf-profile.calltrace.cycles-pp.sock_wfree.unix_destruct_scm.skb_release_head_state.consume_skb.unix_stream_read_generic 1.50 ± 12% -0.9 0.64 ± 3% perf-profile.calltrace.cycles-pp.skb_queue_tail.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write 1.47 ± 12% -0.9 0.62 ± 2% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.skb_queue_tail.unix_stream_sendmsg.sock_sendmsg.sock_write_iter 49.06 -0.8 48.22 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read 48.95 -0.8 48.11 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 1.99 ± 8% -0.8 1.17 ± 3% perf-profile.calltrace.cycles-pp._raw_spin_lock.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write 49.90 -0.8 49.10 perf-profile.calltrace.cycles-pp.read 48.36 -0.8 47.57 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 48.16 -0.8 47.38 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read 47.58 -0.8 46.81 perf-profile.calltrace.cycles-pp.sock_read_iter.new_sync_read.vfs_read.ksys_read.do_syscall_64 47.73 -0.8 46.96 perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.46 ± 8% -0.8 0.71 ± 5% perf-profile.calltrace.cycles-pp.skb_unlink.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read 1.43 ± 9% -0.7 0.68 ± 5% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.skb_unlink.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter 1.68 ± 7% -0.7 0.97 ± 4% perf-profile.calltrace.cycles-pp._raw_spin_lock.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read 1.69 ± 10% -0.7 1.04 ± 5% perf-profile.calltrace.cycles-pp.skb_set_owner_w.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter 6.50 -0.6 5.96 ± 4% perf-profile.calltrace.cycles-pp.page_counter_uncharge.obj_cgroup_uncharge_pages.memcg_slab_free_hook.kmem_cache_free.unix_stream_read_generic 1.59 ± 6% -0.5 1.12 ± 6% perf-profile.calltrace.cycles-pp.__slab_free.kmem_cache_free.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter 0.91 ± 8% -0.5 0.44 ± 45% perf-profile.calltrace.cycles-pp.mutex_unlock.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read 2.05 ± 2% -0.4 1.68 ± 2% perf-profile.calltrace.cycles-pp.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter 2.06 ± 2% -0.4 1.70 ± 2% perf-profile.calltrace.cycles-pp.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter.new_sync_read 2.03 ± 2% -0.4 1.67 ± 2% perf-profile.calltrace.cycles-pp.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic.unix_stream_recvmsg 1.20 ± 8% -0.3 0.88 ± 6% perf-profile.calltrace.cycles-pp.__slab_free.kfree.skb_release_data.consume_skb.unix_stream_read_generic 0.85 ± 6% -0.2 0.63 ± 2% perf-profile.calltrace.cycles-pp.__check_object_size.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor 0.89 ± 5% -0.2 0.68 ± 2% perf-profile.calltrace.cycles-pp.simple_copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic 1.09 -0.1 0.95 ± 2% perf-profile.calltrace.cycles-pp._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor.unix_stream_read_generic 0.93 -0.1 0.80 ± 2% perf-profile.calltrace.cycles-pp.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter.unix_stream_read_actor 0.87 -0.1 0.75 ± 3% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout._copy_to_iter.__skb_datagram_iter.skb_copy_datagram_iter 0.90 ± 2% -0.1 0.84 perf-profile.calltrace.cycles-pp.skb_copy_datagram_from_iter.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write 0.98 ± 6% +0.2 1.18 ± 5% perf-profile.calltrace.cycles-pp.memcg_slab_post_alloc_hook.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb 0.99 ± 6% +0.2 1.19 ± 5% perf-profile.calltrace.cycles-pp.memcg_slab_post_alloc_hook.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb.alloc_skb_with_frags 0.70 ± 9% +0.2 0.91 ± 6% perf-profile.calltrace.cycles-pp.switch_mm_irqs_off.__schedule.schedule.schedule_timeout.unix_stream_data_wait 0.62 ± 9% +0.2 0.85 ± 7% perf-profile.calltrace.cycles-pp.__mod_memcg_lruvec_state.mod_objcg_state.memcg_slab_post_alloc_hook.kmem_cache_alloc_node.__alloc_skb 0.63 ± 9% +0.2 0.86 ± 7% perf-profile.calltrace.cycles-pp.__mod_memcg_lruvec_state.mod_objcg_state.memcg_slab_post_alloc_hook.__kmalloc_node_track_caller.kmalloc_reserve 0.71 ± 8% +0.2 0.95 ± 7% perf-profile.calltrace.cycles-pp.mod_objcg_state.memcg_slab_post_alloc_hook.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags 0.71 ± 8% +0.2 0.96 ± 7% perf-profile.calltrace.cycles-pp.mod_objcg_state.memcg_slab_post_alloc_hook.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb 0.60 ± 6% +0.3 0.92 ± 6% perf-profile.calltrace.cycles-pp.mod_objcg_state.memcg_slab_free_hook.kmem_cache_free.unix_stream_read_generic.unix_stream_recvmsg 0.44 ± 45% +0.4 0.83 ± 7% perf-profile.calltrace.cycles-pp.__mod_memcg_lruvec_state.mod_objcg_state.memcg_slab_free_hook.kmem_cache_free.unix_stream_read_generic 1.10 ± 6% +0.5 1.57 ± 6% perf-profile.calltrace.cycles-pp.propagate_protected_usage.page_counter_uncharge.obj_cgroup_uncharge_pages.memcg_slab_free_hook.kmem_cache_free 0.00 +0.5 0.52 ± 2% perf-profile.calltrace.cycles-pp.get_obj_cgroup_from_current.slab_pre_alloc_hook.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb 0.61 ± 46% +0.5 1.13 ± 17% perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_switch.__schedule.schedule.exit_to_user_mode_loop 0.63 ± 46% +0.5 1.17 ± 17% perf-profile.calltrace.cycles-pp.perf_trace_sched_switch.__schedule.schedule.exit_to_user_mode_loop.exit_to_user_mode_prepare 0.00 +0.6 0.60 ± 8% perf-profile.calltrace.cycles-pp.__mod_memcg_state.memcg_account_kmem.obj_cgroup_charge.slab_pre_alloc_hook.__kmalloc_node_track_caller 0.00 +0.6 0.62 ± 8% perf-profile.calltrace.cycles-pp.memcg_account_kmem.obj_cgroup_charge.slab_pre_alloc_hook.__kmalloc_node_track_caller.kmalloc_reserve 6.82 +0.6 7.46 ± 4% perf-profile.calltrace.cycles-pp.obj_cgroup_uncharge_pages.memcg_slab_free_hook.kmem_cache_free.unix_stream_read_generic.unix_stream_recvmsg 6.90 +0.7 7.60 ± 4% perf-profile.calltrace.cycles-pp.obj_cgroup_charge.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb 1.31 ± 14% +0.7 2.02 ± 15% perf-profile.calltrace.cycles-pp.__schedule.schedule.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode 1.31 ± 14% +0.7 2.04 ± 15% perf-profile.calltrace.cycles-pp.schedule.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64 1.33 ± 14% +0.7 2.06 ± 15% perf-profile.calltrace.cycles-pp.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe 1.44 ± 14% +0.7 2.18 ± 15% perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 1.48 ± 13% +0.7 2.23 ± 15% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 8.04 +0.8 8.82 ± 4% perf-profile.calltrace.cycles-pp.memcg_slab_free_hook.kmem_cache_free.unix_stream_read_generic.unix_stream_recvmsg.sock_read_iter 17.07 ± 2% +0.9 17.95 ± 4% perf-profile.calltrace.cycles-pp.kfree.skb_release_data.consume_skb.unix_stream_read_generic.unix_stream_recvmsg 2.22 ± 7% +1.0 3.20 ± 6% perf-profile.calltrace.cycles-pp.propagate_protected_usage.page_counter_uncharge.obj_cgroup_uncharge_pages.memcg_slab_free_hook.kfree 0.00 +1.0 0.98 ± 3% perf-profile.calltrace.cycles-pp.get_obj_cgroup_from_current.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb 2.10 ± 18% +1.0 3.13 ± 12% perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_tp_event.perf_trace_sched_wakeup_template.try_to_wake_up 2.11 ± 18% +1.0 3.14 ± 12% perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_tp_event.perf_trace_sched_wakeup_template.try_to_wake_up.autoremove_wake_function 2.02 ± 18% +1.0 3.06 ± 12% perf-profile.calltrace.cycles-pp.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_tp_event.perf_trace_sched_wakeup_template 2.00 ± 19% +1.1 3.08 ± 13% perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.enqueue_entity 2.06 ± 19% +1.1 3.15 ± 13% perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.enqueue_entity.enqueue_task_fair 2.21 ± 18% +1.1 3.31 ± 12% perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_wakeup_template.try_to_wake_up.autoremove_wake_function.__wake_up_common 2.29 ± 18% +1.1 3.39 ± 12% perf-profile.calltrace.cycles-pp.perf_trace_sched_wakeup_template.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 2.28 ± 18% +1.1 3.39 ± 13% perf-profile.calltrace.cycles-pp.update_curr.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up 2.13 ± 19% +1.1 3.24 ± 13% perf-profile.calltrace.cycles-pp.perf_trace_sched_stat_runtime.update_curr.enqueue_entity.enqueue_task_fair.ttwu_do_activate 2.24 ± 18% +1.2 3.43 ± 13% perf-profile.calltrace.cycles-pp.__perf_event_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.dequeue_entity 2.66 ± 16% +1.2 3.86 ± 13% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function 2.30 ± 19% +1.2 3.52 ± 13% perf-profile.calltrace.cycles-pp.perf_tp_event.perf_trace_sched_stat_runtime.update_curr.dequeue_entity.dequeue_task_fair 2.36 ± 19% +1.2 3.59 ± 12% perf-profile.calltrace.cycles-pp.perf_trace_sched_stat_runtime.update_curr.dequeue_entity.dequeue_task_fair.__schedule 2.67 ± 17% +1.2 3.92 ± 12% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.schedule_timeout 2.46 ± 25% +1.3 3.71 ± 14% perf-profile.calltrace.cycles-pp.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_tp_event.perf_trace_sched_switch 2.47 ± 18% +1.3 3.74 ± 12% perf-profile.calltrace.cycles-pp.update_curr.dequeue_entity.dequeue_task_fair.__schedule.schedule 3.05 ± 16% +1.3 4.37 ± 12% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.schedule_timeout.unix_stream_data_wait 45.75 +1.3 47.10 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 13.65 +1.4 15.01 ± 4% perf-profile.calltrace.cycles-pp.obj_cgroup_charge.slab_pre_alloc_hook.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb 15.23 +1.4 16.59 ± 4% perf-profile.calltrace.cycles-pp.memcg_slab_free_hook.kfree.skb_release_data.consume_skb.unix_stream_read_generic 3.14 ± 15% +1.4 4.52 ± 12% perf-profile.calltrace.cycles-pp.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock 3.10 ± 15% +1.4 4.49 ± 12% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.try_to_wake_up.autoremove_wake_function.__wake_up_common 45.99 +1.4 47.38 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 45.30 +1.4 46.70 perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe 9.04 +1.4 10.46 ± 4% perf-profile.calltrace.cycles-pp.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg 2.01 ± 45% +1.4 3.44 ± 13% perf-profile.calltrace.cycles-pp.perf_callchain_user.get_perf_callchain.perf_callchain.perf_prepare_sample.perf_event_output_forward 44.40 +1.4 45.85 perf-profile.calltrace.cycles-pp.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write.vfs_write 44.71 +1.5 46.17 perf-profile.calltrace.cycles-pp.sock_sendmsg.sock_write_iter.new_sync_write.vfs_write.ksys_write 13.63 +1.5 15.12 ± 4% perf-profile.calltrace.cycles-pp.obj_cgroup_uncharge_pages.memcg_slab_free_hook.kfree.skb_release_data.consume_skb 44.93 +1.5 46.43 perf-profile.calltrace.cycles-pp.sock_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64 0.00 +1.6 1.59 ± 7% perf-profile.calltrace.cycles-pp.propagate_protected_usage.page_counter_charge.obj_cgroup_charge.kmem_cache_alloc_node.__alloc_skb 16.08 +1.7 17.75 ± 4% perf-profile.calltrace.cycles-pp.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb 16.12 +1.7 17.80 ± 4% perf-profile.calltrace.cycles-pp.kmalloc_reserve.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg 1.50 ± 52% +1.7 3.19 ± 18% perf-profile.calltrace.cycles-pp.unwind_next_frame.perf_callchain_kernel.get_perf_callchain.perf_callchain.perf_prepare_sample 14.02 +1.7 15.74 ± 4% perf-profile.calltrace.cycles-pp.slab_pre_alloc_hook.__kmalloc_node_track_caller.kmalloc_reserve.__alloc_skb.alloc_skb_with_frags 1.02 ± 76% +1.8 2.82 ± 13% perf-profile.calltrace.cycles-pp.__unwind_start.perf_callchain_kernel.get_perf_callchain.perf_callchain.perf_prepare_sample 28.62 +1.9 30.50 ± 4% perf-profile.calltrace.cycles-pp.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter.new_sync_write 47.60 +2.2 49.76 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write 48.33 +2.2 50.51 perf-profile.calltrace.cycles-pp.write 47.73 +2.2 49.91 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write 4.22 ± 19% +2.3 6.49 ± 13% perf-profile.calltrace.cycles-pp.perf_event_output_forward.__perf_event_overflow.perf_tp_event.perf_trace_sched_stat_runtime.update_curr 4.08 ± 19% +2.3 6.36 ± 13% perf-profile.calltrace.cycles-pp.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_tp_event.perf_trace_sched_stat_runtime 7.93 ± 14% +2.9 10.81 ± 12% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.sock_def_readable 26.00 +2.9 28.90 ± 4% perf-profile.calltrace.cycles-pp.__alloc_skb.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg 26.06 +2.9 28.96 ± 4% perf-profile.calltrace.cycles-pp.alloc_skb_with_frags.sock_alloc_send_pskb.unix_stream_sendmsg.sock_sendmsg.sock_write_iter 0.00 +3.1 3.14 ± 6% perf-profile.calltrace.cycles-pp.propagate_protected_usage.page_counter_charge.obj_cgroup_charge.slab_pre_alloc_hook.__kmalloc_node_track_caller 5.15 ± 19% +3.2 8.32 ± 15% perf-profile.calltrace.cycles-pp.perf_callchain_kernel.get_perf_callchain.perf_callchain.perf_prepare_sample.perf_event_output_forward 8.10 ± 20% +4.4 12.51 ± 13% perf-profile.calltrace.cycles-pp.get_perf_callchain.perf_callchain.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow 8.14 ± 20% +4.4 12.56 ± 13% perf-profile.calltrace.cycles-pp.perf_callchain.perf_prepare_sample.perf_event_output_forward.__perf_event_overflow.perf_tp_event 0.00 +6.0 5.98 ± 4% perf-profile.calltrace.cycles-pp.page_counter_charge.obj_cgroup_charge.kmem_cache_alloc_node.__alloc_skb.alloc_skb_with_frags 0.00 +11.9 11.87 ± 5% perf-profile.calltrace.cycles-pp.page_counter_charge.obj_cgroup_charge.slab_pre_alloc_hook.__kmalloc_node_track_caller.kmalloc_reserve 20.47 -20.5 0.00 perf-profile.children.cycles-pp.obj_cgroup_charge_pages 5.80 ± 8% -2.8 3.03 ± 9% perf-profile.children.cycles-pp._raw_spin_lock_irqsave 19.49 -1.6 17.88 ± 4% perf-profile.children.cycles-pp.page_counter_charge 20.00 -1.6 18.44 ± 4% perf-profile.children.cycles-pp.page_counter_uncharge 5.82 -1.3 4.56 ± 5% perf-profile.children.cycles-pp._raw_spin_lock 2.32 ± 4% -0.9 1.38 ± 4% perf-profile.children.cycles-pp.unix_destruct_scm 2.33 ± 4% -0.9 1.40 ± 4% perf-profile.children.cycles-pp.skb_release_head_state 2.27 ± 4% -0.9 1.35 ± 4% perf-profile.children.cycles-pp.sock_wfree 1.50 ± 12% -0.9 0.64 ± 3% perf-profile.children.cycles-pp.skb_queue_tail 50.05 -0.8 49.25 perf-profile.children.cycles-pp.read 48.37 -0.8 47.58 perf-profile.children.cycles-pp.ksys_read 2.80 ± 7% -0.8 2.02 ± 6% perf-profile.children.cycles-pp.__slab_free 48.18 -0.8 47.39 perf-profile.children.cycles-pp.vfs_read 47.58 -0.8 46.82 perf-profile.children.cycles-pp.sock_read_iter 47.74 -0.8 46.98 perf-profile.children.cycles-pp.new_sync_read 1.46 ± 8% -0.8 0.71 ± 5% perf-profile.children.cycles-pp.skb_unlink 0.74 ± 34% -0.7 0.02 ± 99% perf-profile.children.cycles-pp.secondary_startup_64_no_verify 0.74 ± 34% -0.7 0.02 ± 99% perf-profile.children.cycles-pp.cpu_startup_entry 0.74 ± 34% -0.7 0.02 ± 99% perf-profile.children.cycles-pp.do_idle 3.69 ± 6% -0.7 3.01 ± 6% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath 1.70 ± 10% -0.7 1.04 ± 5% perf-profile.children.cycles-pp.skb_set_owner_w 0.63 ± 21% -0.5 0.11 ± 7% perf-profile.children.cycles-pp.do_user_addr_fault 0.92 ± 7% -0.4 0.53 ± 5% perf-profile.children.cycles-pp.mutex_unlock 2.07 ± 2% -0.4 1.70 ± 2% perf-profile.children.cycles-pp.unix_stream_read_actor 2.06 ± 2% -0.4 1.69 ± 2% perf-profile.children.cycles-pp.skb_copy_datagram_iter 2.04 ± 2% -0.4 1.67 ± 2% perf-profile.children.cycles-pp.__skb_datagram_iter 1.13 ± 17% -0.4 0.77 ± 11% perf-profile.children.cycles-pp.exc_page_fault 1.31 ± 7% -0.3 0.96 ± 20% perf-profile.children.cycles-pp.___slab_alloc 1.06 ± 10% -0.3 0.74 ± 28% perf-profile.children.cycles-pp.__unfreeze_partials 0.76 ± 6% -0.3 0.48 ± 3% perf-profile.children.cycles-pp.unix_write_space 1.26 ± 5% -0.3 1.00 perf-profile.children.cycles-pp.__check_object_size 0.26 ± 12% -0.2 0.03 ±103% perf-profile.children.cycles-pp.asm_sysvec_call_function_single 0.84 ± 8% -0.2 0.62 ± 25% perf-profile.children.cycles-pp.get_partial_node 0.89 ± 5% -0.2 0.68 ± 2% perf-profile.children.cycles-pp.simple_copy_to_iter 0.63 ± 5% -0.2 0.42 ± 6% perf-profile.children.cycles-pp.prepare_to_wait 0.24 ± 14% -0.2 0.03 ±101% perf-profile.children.cycles-pp.sysvec_call_function_single 0.23 ± 13% -0.2 0.03 ±101% perf-profile.children.cycles-pp.__sysvec_call_function_single 1.20 ± 2% -0.2 1.02 ± 2% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string 0.65 ± 5% -0.2 0.48 perf-profile.children.cycles-pp.mutex_lock 1.10 -0.1 0.96 ± 2% perf-profile.children.cycles-pp._copy_to_iter 0.93 -0.1 0.81 ± 3% perf-profile.children.cycles-pp.copyout 0.35 ± 13% -0.1 0.23 ± 9% perf-profile.children.cycles-pp.set_task_cpu 0.16 ± 30% -0.1 0.08 ± 17% perf-profile.children.cycles-pp.__generic_file_write_iter 0.16 ± 30% -0.1 0.08 ± 17% perf-profile.children.cycles-pp.generic_perform_write 0.16 ± 30% -0.1 0.08 ± 19% perf-profile.children.cycles-pp.generic_file_write_iter 0.91 ± 2% -0.1 0.84 perf-profile.children.cycles-pp.skb_copy_datagram_from_iter 0.22 ± 8% -0.1 0.16 ± 11% perf-profile.children.cycles-pp.finish_task_switch 0.33 ± 5% -0.1 0.27 perf-profile.children.cycles-pp.copyin 0.42 ± 3% -0.1 0.36 ± 2% perf-profile.children.cycles-pp.aa_sk_perm 0.51 -0.1 0.46 ± 6% perf-profile.children.cycles-pp.page_counter_try_charge 0.54 ± 2% -0.1 0.49 ± 5% perf-profile.children.cycles-pp.try_charge_memcg 0.48 ± 2% -0.1 0.43 perf-profile.children.cycles-pp._copy_from_iter 0.45 ± 2% -0.1 0.40 ± 2% perf-profile.children.cycles-pp.syscall_return_via_sysret 0.35 ± 2% -0.0 0.30 ± 5% perf-profile.children.cycles-pp.apparmor_file_permission 0.48 ± 3% -0.0 0.44 perf-profile.children.cycles-pp.__entry_text_start 0.45 ± 2% -0.0 0.41 ± 5% perf-profile.children.cycles-pp.update_cfs_group 0.44 ± 2% -0.0 0.41 perf-profile.children.cycles-pp.__might_resched 0.30 ± 3% -0.0 0.26 perf-profile.children.cycles-pp.__check_heap_object 0.40 ± 2% -0.0 0.36 ± 4% perf-profile.children.cycles-pp.security_file_permission 0.14 ± 9% -0.0 0.10 ± 6% perf-profile.children.cycles-pp.__list_del_entry_valid 0.28 ± 5% -0.0 0.24 ± 2% perf-profile.children.cycles-pp.__cond_resched 0.25 ± 3% -0.0 0.22 ± 2% perf-profile.children.cycles-pp.security_socket_recvmsg 0.20 ± 2% -0.0 0.17 ± 4% perf-profile.children.cycles-pp.__might_sleep 0.14 ± 3% -0.0 0.12 perf-profile.children.cycles-pp.wait_for_unix_gc 0.16 -0.0 0.14 ± 4% perf-profile.children.cycles-pp.__might_fault 0.09 ± 4% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.check_stack_object 0.10 ± 5% -0.0 0.08 ± 12% perf-profile.children.cycles-pp.finish_wait 0.05 +0.0 0.08 perf-profile.children.cycles-pp.__build_skb_around 0.04 ± 45% +0.0 0.08 ± 14% perf-profile.children.cycles-pp.get_callchain_entry 0.03 ± 70% +0.0 0.07 ± 13% perf-profile.children.cycles-pp.___perf_sw_event 0.10 ± 12% +0.0 0.14 ± 11% perf-profile.children.cycles-pp.error_entry 0.06 ± 46% +0.1 0.11 ± 14% perf-profile.children.cycles-pp.kvm_guest_state 0.10 ± 18% +0.1 0.15 ± 14% perf-profile.children.cycles-pp.bad_get_user 0.00 +0.1 0.06 ± 9% perf-profile.children.cycles-pp.is_ftrace_trampoline 0.01 ±223% +0.1 0.06 ± 11% perf-profile.children.cycles-pp.rb_insert_color 0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.__wrgsbase_inactive 0.26 ± 4% +0.1 0.32 ± 7% perf-profile.children.cycles-pp.__switch_to 0.14 ± 6% +0.1 0.21 ± 6% perf-profile.children.cycles-pp.__switch_to_asm 0.14 ± 20% +0.1 0.22 ± 10% perf-profile.children.cycles-pp.perf_output_begin_forward 0.22 ± 8% +0.1 0.31 ± 9% perf-profile.children.cycles-pp.check_preempt_curr 0.19 ± 10% +0.1 0.27 ± 9% perf-profile.children.cycles-pp.check_preempt_wakeup 0.19 ± 20% +0.1 0.28 ± 12% perf-profile.children.cycles-pp.core_kernel_text 0.24 ± 7% +0.1 0.34 ± 8% perf-profile.children.cycles-pp.ttwu_do_wakeup 0.26 ± 19% +0.1 0.36 ± 10% perf-profile.children.cycles-pp.__perf_event_header__init_id 0.28 ± 11% +0.2 0.43 ± 8% perf-profile.children.cycles-pp.reweight_entity 0.51 ± 17% +0.2 0.73 ± 11% perf-profile.children.cycles-pp.native_irq_return_iret 1.05 ± 7% +0.3 1.32 ± 7% perf-profile.children.cycles-pp.switch_mm_irqs_off 0.72 ± 19% +0.3 0.99 ± 12% perf-profile.children.cycles-pp.__kernel_text_address 0.63 ± 19% +0.3 0.92 ± 12% perf-profile.children.cycles-pp.deref_stack_reg 0.85 ± 19% +0.3 1.18 ± 12% perf-profile.children.cycles-pp.unwind_get_return_address 1.98 ± 6% +0.4 2.37 ± 5% perf-profile.children.cycles-pp.memcg_slab_post_alloc_hook 1.25 ± 18% +0.6 1.83 ± 12% perf-profile.children.cycles-pp.__orc_find 1.60 ± 12% +0.7 2.25 ± 14% perf-profile.children.cycles-pp.exit_to_user_mode_loop 1.92 ± 11% +0.7 2.61 ± 14% perf-profile.children.cycles-pp.exit_to_user_mode_prepare 2.00 ± 11% +0.7 2.70 ± 13% perf-profile.children.cycles-pp.syscall_exit_to_user_mode 2.57 ± 9% +0.8 3.38 ± 7% perf-profile.children.cycles-pp.__mod_memcg_lruvec_state 17.08 ± 2% +0.9 17.96 ± 4% perf-profile.children.cycles-pp.kfree 2.90 ± 8% +0.9 3.78 ± 7% perf-profile.children.cycles-pp.mod_objcg_state 2.36 ± 18% +1.0 3.36 ± 13% perf-profile.children.cycles-pp.__unwind_start 2.41 ± 18% +1.1 3.49 ± 12% perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template 0.40 ± 3% +1.1 1.51 ± 3% perf-profile.children.cycles-pp.get_obj_cgroup_from_current 96.82 +1.1 97.94 perf-profile.children.cycles-pp.do_syscall_64 97.04 +1.1 98.20 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 3.45 ± 14% +1.2 4.64 ± 11% perf-profile.children.cycles-pp.enqueue_task_fair 3.47 ± 14% +1.2 4.68 ± 11% perf-profile.children.cycles-pp.ttwu_do_activate 2.60 ± 18% +1.2 3.82 ± 12% perf-profile.children.cycles-pp.__get_user_nocheck_8 2.85 ± 17% +1.2 4.08 ± 12% perf-profile.children.cycles-pp.dequeue_entity 3.27 ± 15% +1.3 4.54 ± 12% perf-profile.children.cycles-pp.dequeue_task_fair 2.78 ± 18% +1.3 4.11 ± 12% perf-profile.children.cycles-pp.perf_callchain_user 45.75 +1.4 47.10 perf-profile.children.cycles-pp.vfs_write 45.99 +1.4 47.39 perf-profile.children.cycles-pp.ksys_write 45.31 +1.4 46.71 perf-profile.children.cycles-pp.new_sync_write 9.07 +1.4 10.48 ± 4% perf-profile.children.cycles-pp.kmem_cache_alloc_node 44.42 +1.4 45.86 perf-profile.children.cycles-pp.unix_stream_sendmsg 44.72 +1.5 46.18 perf-profile.children.cycles-pp.sock_sendmsg 44.93 +1.5 46.43 perf-profile.children.cycles-pp.sock_write_iter 16.09 +1.7 17.76 ± 4% perf-profile.children.cycles-pp.__kmalloc_node_track_caller 16.13 +1.7 17.80 ± 4% perf-profile.children.cycles-pp.kmalloc_reserve 0.00 +1.7 1.70 ± 8% perf-profile.children.cycles-pp.__mod_memcg_state 14.03 +1.7 15.76 ± 4% perf-profile.children.cycles-pp.slab_pre_alloc_hook 0.00 +1.7 1.75 ± 8% perf-profile.children.cycles-pp.memcg_account_kmem 28.63 +1.9 30.50 ± 4% perf-profile.children.cycles-pp.sock_alloc_send_pskb 20.56 +2.1 22.62 ± 4% perf-profile.children.cycles-pp.obj_cgroup_charge 20.48 +2.1 22.59 ± 4% perf-profile.children.cycles-pp.obj_cgroup_uncharge_pages 23.29 +2.1 25.42 ± 4% perf-profile.children.cycles-pp.memcg_slab_free_hook 4.74 ± 18% +2.1 6.88 ± 13% perf-profile.children.cycles-pp.unwind_next_frame 48.48 +2.2 50.64 perf-profile.children.cycles-pp.write 5.10 ± 18% +2.3 7.40 ± 12% perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime 5.57 ± 18% +2.3 7.91 ± 11% perf-profile.children.cycles-pp.update_curr 7.46 ± 6% +2.7 10.18 ± 6% perf-profile.children.cycles-pp.propagate_protected_usage 6.32 ± 18% +2.8 9.11 ± 12% perf-profile.children.cycles-pp.perf_callchain_kernel 26.06 +2.9 28.96 ± 4% perf-profile.children.cycles-pp.alloc_skb_with_frags 26.01 +2.9 28.91 ± 4% perf-profile.children.cycles-pp.__alloc_skb 9.25 ± 18% +4.2 13.46 ± 12% perf-profile.children.cycles-pp.get_perf_callchain 9.29 ± 18% +4.2 13.51 ± 12% perf-profile.children.cycles-pp.perf_callchain 10.18 ± 18% +4.3 14.47 ± 12% perf-profile.children.cycles-pp.__perf_event_overflow 10.14 ± 18% +4.3 14.42 ± 12% perf-profile.children.cycles-pp.perf_event_output_forward 9.77 ± 18% +4.4 14.14 ± 12% perf-profile.children.cycles-pp.perf_prepare_sample 10.54 ± 18% +4.4 14.96 ± 12% perf-profile.children.cycles-pp.perf_tp_event 16.13 ± 2% -2.9 13.22 ± 3% perf-profile.self.cycles-pp.page_counter_uncharge 15.90 ± 2% -2.9 13.00 ± 4% perf-profile.self.cycles-pp.page_counter_charge 3.68 ± 8% -1.8 1.92 perf-profile.self.cycles-pp._raw_spin_lock_irqsave 4.22 ± 5% -1.6 2.62 perf-profile.self.cycles-pp._raw_spin_lock 2.77 ± 7% -0.8 1.99 ± 6% perf-profile.self.cycles-pp.__slab_free 1.55 ± 8% -0.8 0.79 ± 6% perf-profile.self.cycles-pp.sock_def_readable 3.68 ± 6% -0.7 3.00 ± 6% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath 1.68 ± 10% -0.7 1.03 ± 5% perf-profile.self.cycles-pp.skb_set_owner_w 1.48 ± 6% -0.6 0.86 ± 5% perf-profile.self.cycles-pp.sock_wfree 1.21 ± 5% -0.4 0.76 ± 4% perf-profile.self.cycles-pp.unix_stream_read_generic 0.90 ± 8% -0.4 0.52 ± 5% perf-profile.self.cycles-pp.mutex_unlock 1.25 ± 7% -0.4 0.88 ± 3% perf-profile.self.cycles-pp.memcg_slab_free_hook 0.64 ± 10% -0.3 0.37 ± 3% perf-profile.self.cycles-pp.unix_stream_sendmsg 0.68 ± 8% -0.2 0.47 perf-profile.self.cycles-pp.__alloc_skb 0.40 ± 6% -0.2 0.22 ± 4% perf-profile.self.cycles-pp.consume_skb 1.19 ± 2% -0.2 1.01 ± 2% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string 0.66 ± 7% -0.2 0.48 ± 3% perf-profile.self.cycles-pp.__check_object_size 0.51 ± 7% -0.2 0.35 perf-profile.self.cycles-pp.mutex_lock 0.42 ± 8% -0.1 0.28 ± 4% perf-profile.self.cycles-pp.kmem_cache_free 0.32 ± 7% -0.1 0.18 ± 2% perf-profile.self.cycles-pp.unix_write_space 0.46 ± 7% -0.1 0.34 ± 11% perf-profile.self.cycles-pp.___slab_alloc 0.54 ± 2% -0.1 0.45 perf-profile.self.cycles-pp.memcg_slab_post_alloc_hook 0.36 ± 6% -0.1 0.27 ± 3% perf-profile.self.cycles-pp.__kmalloc_node_track_caller 0.37 ± 4% -0.1 0.30 ± 8% perf-profile.self.cycles-pp.update_load_avg 0.24 ± 2% -0.1 0.18 ± 2% perf-profile.self.cycles-pp.sock_read_iter 0.44 ± 2% -0.0 0.39 ± 2% perf-profile.self.cycles-pp.syscall_return_via_sysret 0.45 ± 2% -0.0 0.40 ± 5% perf-profile.self.cycles-pp.update_cfs_group 0.13 ± 7% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.sock_alloc_send_pskb 0.29 ± 3% -0.0 0.25 perf-profile.self.cycles-pp.__check_heap_object 0.32 ± 3% -0.0 0.28 ± 7% perf-profile.self.cycles-pp.skb_release_data 0.22 ± 3% -0.0 0.18 ± 4% perf-profile.self.cycles-pp.aa_sk_perm 0.43 ± 2% -0.0 0.40 perf-profile.self.cycles-pp.__might_resched 0.13 ± 7% -0.0 0.10 ± 4% perf-profile.self.cycles-pp.__list_del_entry_valid 0.23 ± 4% -0.0 0.20 ± 7% perf-profile.self.cycles-pp.apparmor_file_permission 0.20 ± 3% -0.0 0.17 ± 4% perf-profile.self.cycles-pp.kmem_cache_alloc_node 0.16 ± 3% -0.0 0.12 ± 6% perf-profile.self.cycles-pp.page_counter_try_charge 0.22 ± 2% -0.0 0.20 ± 4% perf-profile.self.cycles-pp.vfs_write 0.18 ± 2% -0.0 0.15 ± 4% perf-profile.self.cycles-pp.__might_sleep 0.20 -0.0 0.18 ± 3% perf-profile.self.cycles-pp.new_sync_write 0.10 ± 5% -0.0 0.08 perf-profile.self.cycles-pp.kfree 0.08 ± 5% -0.0 0.07 ± 7% perf-profile.self.cycles-pp.check_stack_object 0.10 ± 4% -0.0 0.09 perf-profile.self.cycles-pp.__cond_resched 0.06 ± 6% +0.0 0.08 ± 6% perf-profile.self.cycles-pp.skb_copy_datagram_from_iter 0.23 ± 3% +0.0 0.25 ± 3% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe 0.10 ± 3% +0.0 0.12 ± 6% perf-profile.self.cycles-pp.do_syscall_64 0.11 ± 6% +0.0 0.14 ± 9% perf-profile.self.cycles-pp.enqueue_task_fair 0.11 ± 10% +0.0 0.14 ± 8% perf-profile.self.cycles-pp.native_sched_clock 0.04 ± 45% +0.0 0.08 ± 14% perf-profile.self.cycles-pp.get_callchain_entry 0.04 ± 44% +0.0 0.08 ± 7% perf-profile.self.cycles-pp.ksys_write 0.04 ± 44% +0.0 0.08 perf-profile.self.cycles-pp.__build_skb_around 0.08 ± 13% +0.0 0.12 ± 12% perf-profile.self.cycles-pp.error_entry 0.05 ± 45% +0.0 0.09 ± 10% perf-profile.self.cycles-pp.__perf_event_header__init_id 0.11 ± 16% +0.0 0.15 ± 11% perf-profile.self.cycles-pp.__kernel_text_address 0.01 ±223% +0.0 0.06 ± 9% perf-profile.self.cycles-pp.select_task_rq_fair 0.10 ± 22% +0.0 0.14 ± 11% perf-profile.self.cycles-pp.__task_pid_nr_ns 0.08 ± 18% +0.0 0.13 ± 13% perf-profile.self.cycles-pp.asm_exc_page_fault 0.21 ± 3% +0.0 0.26 ± 6% perf-profile.self.cycles-pp.sock_write_iter 0.06 ± 46% +0.1 0.11 ± 12% perf-profile.self.cycles-pp.kvm_guest_state 0.01 ±223% +0.1 0.06 ± 13% perf-profile.self.cycles-pp.___perf_sw_event 0.00 +0.1 0.06 ± 9% perf-profile.self.cycles-pp.is_ftrace_trampoline 0.12 ± 17% +0.1 0.18 ± 14% perf-profile.self.cycles-pp.ftrace_graph_ret_addr 0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.rb_insert_color 0.16 ± 9% +0.1 0.22 ± 12% perf-profile.self.cycles-pp.enqueue_entity 0.00 +0.1 0.06 ± 9% perf-profile.self.cycles-pp.schedule 0.11 ± 17% +0.1 0.17 ± 9% perf-profile.self.cycles-pp.check_preempt_wakeup 0.12 ± 19% +0.1 0.18 ± 11% perf-profile.self.cycles-pp.core_kernel_text 0.31 +0.1 0.38 ± 7% perf-profile.self.cycles-pp.mod_objcg_state 0.14 ± 6% +0.1 0.21 ± 7% perf-profile.self.cycles-pp.__switch_to_asm 0.13 ± 22% +0.1 0.20 ± 11% perf-profile.self.cycles-pp.perf_output_begin_forward 0.00 +0.1 0.07 ± 11% perf-profile.self.cycles-pp.refill_stock 0.24 ± 16% +0.1 0.33 ± 8% perf-profile.self.cycles-pp.perf_tp_event 0.20 ± 19% +0.1 0.30 ± 13% perf-profile.self.cycles-pp.__unwind_start 0.24 ± 19% +0.1 0.34 ± 14% perf-profile.self.cycles-pp.kernel_text_address 0.14 ± 19% +0.1 0.24 ± 8% perf-profile.self.cycles-pp.perf_callchain_user 0.13 ± 9% +0.2 0.28 ± 6% perf-profile.self.cycles-pp.reweight_entity 0.51 ± 17% +0.2 0.73 ± 11% perf-profile.self.cycles-pp.native_irq_return_iret 0.53 ± 19% +0.2 0.78 ± 12% perf-profile.self.cycles-pp.perf_callchain_kernel 0.58 ± 18% +0.3 0.84 ± 12% perf-profile.self.cycles-pp.deref_stack_reg 1.04 ± 7% +0.3 1.30 ± 7% perf-profile.self.cycles-pp.switch_mm_irqs_off 1.25 ± 18% +0.6 1.83 ± 12% perf-profile.self.cycles-pp.__orc_find 1.42 ± 18% +0.7 2.12 ± 13% perf-profile.self.cycles-pp.__get_user_nocheck_8 2.54 ± 9% +0.8 3.36 ± 7% perf-profile.self.cycles-pp.__mod_memcg_lruvec_state 2.06 ± 18% +0.9 2.99 ± 12% perf-profile.self.cycles-pp.unwind_next_frame 0.39 ± 4% +1.1 1.49 ± 3% perf-profile.self.cycles-pp.get_obj_cgroup_from_current 0.00 +1.7 1.68 ± 8% perf-profile.self.cycles-pp.__mod_memcg_state 7.37 ± 6% +2.7 10.08 ± 6% perf-profile.self.cycles-pp.propagate_protected_usage 0.44 ± 21% +2.8 3.20 ± 8% perf-profile.self.cycles-pp.obj_cgroup_uncharge_pages 0.09 ± 8% +3.2 3.27 ± 8% perf-profile.self.cycles-pp.obj_cgroup_charge Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. -- 0-DAY CI Kernel Test Service https://01.org/lkp

3 months, 2 weeks

4
8
0 / 0

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

LKP April 2022