[xfs] 270a6968dc: xfstests.xfs.009.fail
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 270a6968dcb3a73da03b8e4f1c873ce23033854a ("[PATCH 1/2] xfs: kill the XFS_IOC_{ALLOC,FREE}SP* ioctls")
url: https://github.com/0day-ci/linux/commits/Darrick-J-Wong/xfs-kill-the-XFS_...
in testcase: xfstests
version: xfstests-x86_64-972d710-1_20220114
with following parameters:
disk: 4HDD
fs: xfs
test: xfs-group-00
ucode: 0x21
test-description: xfstests is a regression test suite for xfs and other files ystems.
test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git
on test machine: 4 threads 1 sockets Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 8G memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
2022-01-17 15:09:47 export TEST_DIR=/fs/sdb2
2022-01-17 15:09:47 export TEST_DEV=/dev/sdb2
2022-01-17 15:09:47 export FSTYP=xfs
2022-01-17 15:09:47 export SCRATCH_MNT=/fs/scratch
2022-01-17 15:09:47 mkdir /fs/scratch -p
2022-01-17 15:09:47 export SCRATCH_DEV=/dev/sdb5
2022-01-17 15:09:47 export SCRATCH_LOGDEV=/dev/sdb3
2022-01-17 15:09:47 export SCRATCH_XFS_LIST_METADATA_FIELDS=u3.sfdir3.hdr.parent.i4
2022-01-17 15:09:47 export SCRATCH_XFS_LIST_FUZZ_VERBS=random
2022-01-17 15:09:47 sed "s:^:xfs/:" //lkp/benchmarks/xfstests/tests/xfs-group-00
2022-01-17 15:09:47 ./check xfs/001 xfs/002 xfs/003 xfs/004 xfs/005 xfs/006 xfs/007 xfs/008 xfs/009
FSTYP -- xfs (debug)
PLATFORM -- Linux/x86_64 lkp-ivb-d04 5.16.0-00001-g270a6968dcb3 #1 SMP Mon Jan 17 21:52:55 CST 2022
MKFS_OPTIONS -- -f /dev/sdb5
MOUNT_OPTIONS -- /dev/sdb5 /fs/scratch
xfs/001 6s
xfs/002 67s
xfs/003 329s
xfs/004 3s
xfs/005 3s
xfs/006 14s
xfs/007 5s
xfs/008 2s
xfs/009 - output mismatch (see /lkp/benchmarks/xfstests/results//xfs/009.out.bad)
--- tests/xfs/009.out 2022-01-14 05:25:22.000000000 +0000
+++ /lkp/benchmarks/xfstests/results//xfs/009.out.bad 2022-01-17 15:17:03.821161103 +0000
@@ -23,17 +23,15 @@
[0,1000]: BLOCKRANGE
filesize = 0
*** test 3 - alloc & filesize
+allocsp: Inappropriate ioctl for device
blocksize BSIZE
CMD allocsp, off=1000, len=-1
- MAP off=1000, len=-1 [1000-]
...
(Run 'diff -u /lkp/benchmarks/xfstests/tests/xfs/009.out /lkp/benchmarks/xfstests/results//xfs/009.out.bad' to see the entire diff)
Ran: xfs/001 xfs/002 xfs/003 xfs/004 xfs/005 xfs/006 xfs/007 xfs/008 xfs/009
Failures: xfs/009
Failed 1 of 9 tests
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
sudo bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
sudo bin/lkp run generated-yaml-file
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang
6 months, 3 weeks
- 1
- 0
[af_unix] afd20b9290: stress-ng.sockdiag.ops_per_sec -26.3% regression
by kernel test robot
(this commit was previously reported as
"[af_unix] afd20b9290: stress-ng.sockdiag.ops_per_sec -26.3% regression"
when it's still on linux-next/master
https://lore.kernel.org/all/[email protected]/
report again as a reminder the regression still exists on mainline)
Greeting,
FYI, we noticed a -26.3% regression of stress-ng.sockdiag.ops_per_sec due to commit:
commit: afd20b9290e184c203fe22f2d6b80dc7127ba724 ("af_unix: Replace the big lock with small locks.")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: stress-ng
on test machine: 128 threads 2 sockets Intel(R) Xeon(R) Platinum 8358 CPU @ 2.60GHz with 128G memory
with following parameters:
nr_threads: 100%
testtime: 60s
class: network
test: sockdiag
cpufreq_governor: performance
ucode: 0xd000280
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
sudo bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
sudo bin/lkp run generated-yaml-file
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
=========================================================================================
class/compiler/cpufreq_governor/kconfig/nr_threads/rootfs/tbox_group/test/testcase/testtime/ucode:
network/gcc-9/performance/x86_64-rhel-8.3/100%/debian-10.4-x86_64-20200603.cgz/lkp-icl-2sp6/sockdiag/stress-ng/60s/0xd000280
commit:
e6b4b87389 ("af_unix: Save hash in sk_hash.")
afd20b9290 ("af_unix: Replace the big lock with small locks.")
e6b4b873896f0e92 afd20b9290e184c203fe22f2d6b
---------------- ---------------------------
%stddev %change %stddev
\ | \
3.129e+08 -26.3% 2.306e+08 stress-ng.sockdiag.ops
5214640 -26.3% 3842782 stress-ng.sockdiag.ops_per_sec
82895 -6.9% 77178 stress-ng.time.involuntary_context_switches
103737 -9.5% 93892 stress-ng.time.voluntary_context_switches
7067 -6.3% 6620 vmstat.system.cs
0.05 -0.0 0.04 ± 6% mpstat.cpu.all.soft%
0.13 ± 3% -0.0 0.12 ± 5% mpstat.cpu.all.usr%
1783836 ± 7% -21.6% 1397649 ± 12% numa-vmstat.node1.numa_hit
1689477 ± 8% -22.9% 1303128 ± 13% numa-vmstat.node1.numa_local
894897 ± 22% +46.6% 1312222 ± 11% turbostat.C1E
3.85 ± 55% +3.5 7.33 ± 10% turbostat.C1E%
2451882 ± 4% -24.3% 1855676 ± 2% numa-numastat.node0.local_node
2501404 ± 3% -23.8% 1905161 ± 3% numa-numastat.node0.numa_hit
2437526 -24.1% 1849165 ± 3% numa-numastat.node1.local_node
2503693 -23.5% 1915338 ± 3% numa-numastat.node1.numa_hit
7977 ± 19% -22.6% 6178 ± 8% softirqs.CPU2.RCU
7989 ± 25% -23.4% 6121 ± 3% softirqs.CPU25.RCU
8011 ± 24% -26.8% 5862 ± 3% softirqs.CPU8.RCU
890963 ± 3% -17.4% 735738 softirqs.RCU
74920 -3.6% 72233 proc-vmstat.nr_slab_unreclaimable
5007343 -23.7% 3821593 proc-vmstat.numa_hit
4891675 -24.2% 3705934 proc-vmstat.numa_local
5007443 -23.7% 3821701 proc-vmstat.pgalloc_normal
4796850 -24.7% 3610677 proc-vmstat.pgfree
0.71 ± 17% -41.1% 0.42 perf-stat.i.MPKI
0.12 ± 12% -0.0 0.10 ± 8% perf-stat.i.branch-miss-rate%
10044516 ± 13% -23.6% 7678759 ± 3% perf-stat.i.cache-misses
42758000 ± 6% -28.5% 30580693 perf-stat.i.cache-references
6920 -5.9% 6510 perf-stat.i.context-switches
571.08 ± 2% -13.4% 494.31 ± 2% perf-stat.i.cpu-migrations
39356 ± 12% +29.2% 50865 ± 3% perf-stat.i.cycles-between-cache-misses
0.01 ± 36% -0.0 0.00 ± 24% perf-stat.i.dTLB-load-miss-rate%
0.01 ± 23% -0.0 0.00 ± 14% perf-stat.i.dTLB-store-miss-rate%
8.447e+08 +27.0% 1.073e+09 perf-stat.i.dTLB-stores
13.36 -2.2% 13.07 perf-stat.i.major-faults
364.56 ± 9% -24.9% 273.60 perf-stat.i.metric.K/sec
350.63 +0.7% 353.23 perf-stat.i.metric.M/sec
87.88 +1.4 89.23 perf-stat.i.node-load-miss-rate%
1381985 ± 12% -27.7% 999393 ± 3% perf-stat.i.node-load-misses
198989 ± 6% -31.9% 135458 ± 4% perf-stat.i.node-loads
4305132 -27.4% 3124590 perf-stat.i.node-store-misses
581796 ± 5% -25.6% 432807 ± 3% perf-stat.i.node-stores
0.46 ± 5% -28.7% 0.33 perf-stat.overall.MPKI
39894 ± 12% +28.6% 51310 ± 3% perf-stat.overall.cycles-between-cache-misses
0.01 ± 22% -0.0 0.00 ± 12% perf-stat.overall.dTLB-store-miss-rate%
9916145 ± 13% -23.8% 7560589 ± 3% perf-stat.ps.cache-misses
42385546 ± 5% -28.7% 30225277 perf-stat.ps.cache-references
6786 -5.9% 6385 perf-stat.ps.context-switches
562.65 ± 2% -13.5% 486.73 ± 2% perf-stat.ps.cpu-migrations
8.314e+08 +26.8% 1.055e+09 perf-stat.ps.dTLB-stores
1359293 ± 11% -27.7% 982331 ± 3% perf-stat.ps.node-load-misses
205280 ± 6% -33.3% 136979 ± 5% perf-stat.ps.node-loads
4237942 -27.5% 3070934 perf-stat.ps.node-store-misses
585102 ± 5% -26.6% 429702 ± 3% perf-stat.ps.node-stores
5.844e+12 +0.9% 5.897e+12 perf-stat.total.instructions
99.26 +0.5 99.72 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.sendmsg
99.25 +0.5 99.72 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.sendmsg
99.25 +0.5 99.72 perf-profile.calltrace.cycles-pp.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe.sendmsg
99.26 +0.5 99.73 perf-profile.calltrace.cycles-pp.sendmsg
99.24 +0.5 99.71 perf-profile.calltrace.cycles-pp.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe
99.24 +0.5 99.71 perf-profile.calltrace.cycles-pp.sock_sendmsg.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg.do_syscall_64
99.25 +0.5 99.72 perf-profile.calltrace.cycles-pp.___sys_sendmsg.__sys_sendmsg.do_syscall_64.entry_SYSCALL_64_after_hwframe.sendmsg
99.24 +0.5 99.71 perf-profile.calltrace.cycles-pp.netlink_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg.__sys_sendmsg
97.56 +0.5 98.04 perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.sock_diag_rcv.netlink_unicast.netlink_sendmsg
99.22 +0.5 99.70 perf-profile.calltrace.cycles-pp.netlink_unicast.netlink_sendmsg.sock_sendmsg.____sys_sendmsg.___sys_sendmsg
99.19 +0.5 99.68 perf-profile.calltrace.cycles-pp.sock_diag_rcv.netlink_unicast.netlink_sendmsg.sock_sendmsg.____sys_sendmsg
98.41 +0.5 98.90 perf-profile.calltrace.cycles-pp.__mutex_lock.sock_diag_rcv.netlink_unicast.netlink_sendmsg.sock_sendmsg
0.48 -0.4 0.07 ± 5% perf-profile.children.cycles-pp.recvmsg
0.46 ± 2% -0.4 0.06 perf-profile.children.cycles-pp.___sys_recvmsg
0.47 ± 2% -0.4 0.07 ± 6% perf-profile.children.cycles-pp.__sys_recvmsg
0.45 -0.4 0.06 ± 9% perf-profile.children.cycles-pp.____sys_recvmsg
1.14 -0.4 0.76 perf-profile.children.cycles-pp.netlink_dump
1.09 -0.4 0.73 perf-profile.children.cycles-pp.unix_diag_dump
0.66 -0.3 0.37 ± 2% perf-profile.children.cycles-pp._raw_spin_lock
0.26 ± 2% -0.1 0.19 ± 2% perf-profile.children.cycles-pp.sk_diag_fill
0.07 ± 5% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.__x64_sys_socket
0.07 ± 5% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.__sys_socket
0.07 -0.0 0.04 ± 57% perf-profile.children.cycles-pp.__close
0.12 ± 4% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.memset_erms
0.11 ± 4% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.nla_put
0.08 ± 5% -0.0 0.06 perf-profile.children.cycles-pp.__nlmsg_put
0.08 ± 5% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.__socket
0.08 -0.0 0.06 ± 7% perf-profile.children.cycles-pp.__nla_put
0.07 -0.0 0.05 perf-profile.children.cycles-pp.__nla_reserve
0.07 ± 5% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.rcu_core
0.08 ± 5% -0.0 0.06 perf-profile.children.cycles-pp.__softirqentry_text_start
0.07 -0.0 0.05 ± 8% perf-profile.children.cycles-pp.rcu_do_batch
0.06 ± 7% -0.0 0.05 perf-profile.children.cycles-pp.sock_i_ino
99.89 +0.0 99.92 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
99.89 +0.0 99.92 perf-profile.children.cycles-pp.do_syscall_64
0.00 +0.1 0.08 perf-profile.children.cycles-pp.__raw_callee_save___native_queued_spin_unlock
99.26 +0.5 99.73 perf-profile.children.cycles-pp.sendmsg
99.25 +0.5 99.72 perf-profile.children.cycles-pp.__sys_sendmsg
99.25 +0.5 99.72 perf-profile.children.cycles-pp.___sys_sendmsg
99.24 +0.5 99.71 perf-profile.children.cycles-pp.____sys_sendmsg
99.24 +0.5 99.71 perf-profile.children.cycles-pp.sock_sendmsg
99.24 +0.5 99.71 perf-profile.children.cycles-pp.netlink_sendmsg
99.22 +0.5 99.70 perf-profile.children.cycles-pp.netlink_unicast
97.59 +0.5 98.08 perf-profile.children.cycles-pp.osq_lock
99.19 +0.5 99.68 perf-profile.children.cycles-pp.sock_diag_rcv
98.41 +0.5 98.90 perf-profile.children.cycles-pp.__mutex_lock
0.12 ± 5% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.unix_diag_dump
0.11 -0.0 0.08 perf-profile.self.cycles-pp.memset_erms
0.00 +0.1 0.06 perf-profile.self.cycles-pp.__raw_callee_save___native_queued_spin_unlock
0.28 ± 5% +0.1 0.35 ± 2% perf-profile.self.cycles-pp._raw_spin_lock
97.23 +0.5 97.72 perf-profile.self.cycles-pp.osq_lock
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang
6 months, 3 weeks
- 1
- 0
[btrfs] 1a61b300c0: fsmark.files_per_sec -69.3% regression
by kernel test robot
Greeting,
FYI, we noticed a -69.3% regression of fsmark.files_per_sec due to commit:
commit: 1a61b300c09b1d034534372349e8f9d3aba6c392 ("btrfs: fix log tree cleanup after a transaction abort")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: fsmark
on test machine: 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
with following parameters:
iterations: 8
disk: 1SSD
nr_threads: 4
fs: btrfs
filesize: 8K
test_size: 24G
sync_method: fsyncBeforeClose
nr_directories: 16d
nr_files_per_directory: 256fpd
cpufreq_governor: performance
ucode: 0x5003006
test-description: The fsmark is a file system benchmark to test synchronous write workloads, for example, mail servers workload.
test-url: https://sourceforge.net/projects/fsmark/
In addition to that, the commit also has significant impact on the following tests:
+------------------+-------------------------------------------------------------------------------------+
| testcase: change | fsmark: fsmark.files_per_sec -79.6% regression |
| test machine | 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory |
| test parameters | cpufreq_governor=performance |
| | disk=1SSD |
| | filesize=9B |
| | fs=btrfs |
| | iterations=8 |
| | nr_directories=16d |
| | nr_files_per_directory=256fpd |
| | nr_threads=4 |
| | sync_method=fsyncBeforeClose |
| | test_size=16G |
| | ucode=0x5003006 |
+------------------+-------------------------------------------------------------------------------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
sudo bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
sudo bin/lkp run generated-yaml-file
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
=========================================================================================
compiler/cpufreq_governor/disk/filesize/fs/iterations/kconfig/nr_directories/nr_files_per_directory/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode:
gcc-9/performance/1SSD/8K/btrfs/8/x86_64-rhel-8.3/16d/256fpd/4/debian-10.4-x86_64-20200603.cgz/fsyncBeforeClose/lkp-csl-2ap4/24G/fsmark/0x5003006
commit:
dd503c2d5d ("btrfs: remove write and wait of struct walk_control")
1a61b300c0 ("btrfs: fix log tree cleanup after a transaction abort")
dd503c2d5db4f864 1a61b300c09b1d034534372349e
---------------- ---------------------------
%stddev %change %stddev
\ | \
1693267 +27.7% 2162171 fsmark.app_overhead
10798 -69.3% 3316 fsmark.files_per_sec
309.11 +214.5% 972.20 fsmark.time.elapsed_time
309.11 +214.5% 972.20 fsmark.time.elapsed_time.max
3.284e+08 -5.2% 3.112e+08 fsmark.time.file_system_outputs
1441 ± 4% +149.9% 3601 ± 5% fsmark.time.involuntary_context_switches
186.17 +35.1% 251.50 fsmark.time.percent_of_cpu_this_job_got
565.65 +330.6% 2435 fsmark.time.system_time
16705992 +10.4% 18445401 fsmark.time.voluntary_context_switches
2.68 ± 10% +21.2% 3.25 ± 12% iostat.cpu.system
59912963 +189.9% 1.737e+08 ± 18% turbostat.IRQ
5.763e+10 +211.5% 1.795e+11 cpuidle..time
1.422e+08 +161.1% 3.715e+08 ± 13% cpuidle..usage
360.08 +183.3% 1020 uptime.boot
66292 +184.3% 188463 uptime.idle
0.15 ± 2% -0.1 0.03 ± 4% mpstat.cpu.all.iowait%
1.01 ± 2% +0.3 1.34 mpstat.cpu.all.sys%
0.04 ± 6% -0.0 0.02 ± 2% mpstat.cpu.all.usr%
7453 ± 8% -17.1% 6179 ± 4% numa-vmstat.node1.nr_kernel_stack
1708 ± 31% -62.7% 636.83 ±109% numa-vmstat.node3.nr_mapped
7873 ± 16% -47.9% 4100 ± 27% numa-vmstat.node3.nr_shmem
550115 -69.6% 167016 vmstat.io.bo
132793 -64.2% 47581 vmstat.system.cs
415010 -10.3% 372330 ± 13% vmstat.system.in
7453 ± 8% -17.1% 6178 ± 4% numa-meminfo.node1.KernelStack
2842 ± 97% -77.4% 642.00 ±202% numa-meminfo.node2.Mapped
6989 ± 40% -64.6% 2475 ±113% numa-meminfo.node3.Mapped
30481 ± 17% -46.7% 16242 ± 28% numa-meminfo.node3.Shmem
35959 ±110% +1474.0% 565979 ± 31% numa-numastat.node1.local_node
111652 ± 27% +484.9% 653045 ± 27% numa-numastat.node1.numa_hit
223279 ± 20% +82.7% 407926 ± 20% numa-numastat.node3.local_node
310312 ± 15% +59.5% 494965 ± 16% numa-numastat.node3.numa_hit
6974599 ± 2% -27.2% 5074968 ± 4% meminfo.Active
12971 ± 2% +64.3% 21312 ± 5% meminfo.Active(anon)
6961627 ± 2% -27.4% 5053654 ± 4% meminfo.Active(file)
31060 -10.4% 27841 meminfo.KernelStack
41619 -11.3% 36929 meminfo.Mapped
3246 ± 2% +63.7% 5315 ± 5% proc-vmstat.nr_active_anon
1740701 ± 2% -27.4% 1263351 ± 4% proc-vmstat.nr_active_file
76345 -3.1% 73949 proc-vmstat.nr_anon_pages
41235116 -5.2% 39106395 proc-vmstat.nr_dirtied
43614 +3.7% 45222 proc-vmstat.nr_dirty
5617766 -7.5% 5199209 proc-vmstat.nr_file_pages
42179045 +1.1% 42663739 proc-vmstat.nr_free_pages
84985 -6.7% 79262 proc-vmstat.nr_inactive_anon
3223721 +1.9% 3283642 proc-vmstat.nr_inactive_file
31071 -10.4% 27834 proc-vmstat.nr_kernel_stack
10853 -12.6% 9483 proc-vmstat.nr_mapped
1067 -6.2% 1001 proc-vmstat.nr_page_table_pages
11852 -9.3% 10748 ± 3% proc-vmstat.nr_shmem
841480 +2.3% 860894 proc-vmstat.nr_slab_reclaimable
356995 -1.5% 351806 proc-vmstat.nr_slab_unreclaimable
41233733 -5.2% 39103309 proc-vmstat.nr_written
3246 ± 2% +63.7% 5315 ± 5% proc-vmstat.nr_zone_active_anon
1740701 ± 2% -27.4% 1263351 ± 4% proc-vmstat.nr_zone_active_file
84985 -6.7% 79262 proc-vmstat.nr_zone_inactive_anon
3223721 +1.9% 3283642 proc-vmstat.nr_zone_inactive_file
43649 +3.6% 45237 proc-vmstat.nr_zone_write_pending
10743944 +11.0% 11920715 proc-vmstat.numa_hit
10486008 +11.2% 11660052 proc-vmstat.numa_local
256213 ± 4% +30.9% 335278 ± 4% proc-vmstat.numa_pte_updates
1427645 ± 3% -23.9% 1085954 ± 9% proc-vmstat.pgactivate
10759480 +11.1% 11959093 proc-vmstat.pgalloc_normal
1493167 +163.2% 3930462 proc-vmstat.pgfault
10721038 ± 2% +11.8% 11989241 proc-vmstat.pgfree
1.717e+08 -5.2% 1.628e+08 proc-vmstat.pgpgout
80248 +176.9% 222186 ± 2% proc-vmstat.pgreuse
10.92 ± 41% +251.5% 38.40 ± 28% perf-stat.i.MPKI
1.686e+09 -25.0% 1.264e+09 ± 2% perf-stat.i.branch-instructions
1.02 ± 51% +1.1 2.15 ± 44% perf-stat.i.branch-miss-rate%
11.78 ± 18% -8.4 3.34 ± 10% perf-stat.i.cache-miss-rate%
8696874 ± 16% -40.1% 5206070 ± 34% perf-stat.i.cache-misses
93006209 ± 40% +113.7% 1.988e+08 ± 27% perf-stat.i.cache-references
133991 -64.4% 47669 perf-stat.i.context-switches
1.61 ± 10% +77.9% 2.86 ± 12% perf-stat.i.cpi
207.27 -4.3% 198.27 perf-stat.i.cpu-migrations
1734 ± 6% +116.5% 3755 ± 31% perf-stat.i.cycles-between-cache-misses
2.27e+09 -36.4% 1.444e+09 ± 2% perf-stat.i.dTLB-loads
1.079e+09 -51.3% 5.25e+08 ± 3% perf-stat.i.dTLB-stores
2773451 ± 3% -36.8% 1752389 ± 7% perf-stat.i.iTLB-load-misses
6627866 ± 6% -45.5% 3612274 ± 21% perf-stat.i.iTLB-loads
8.541e+09 -36.0% 5.466e+09 ± 2% perf-stat.i.instructions
0.63 ± 8% -41.7% 0.37 ± 12% perf-stat.i.ipc
1.25 -67.0% 0.41 ± 7% perf-stat.i.major-faults
26.22 -33.4% 17.47 ± 3% perf-stat.i.metric.M/sec
4353 -11.6% 3849 perf-stat.i.minor-faults
28.34 ± 13% +20.4 48.76 ± 3% perf-stat.i.node-load-miss-rate%
1784907 -68.1% 569781 perf-stat.i.node-loads
17.67 ± 27% +14.5 32.19 ± 10% perf-stat.i.node-store-miss-rate%
1006231 ± 3% -64.7% 355642 ± 6% perf-stat.i.node-stores
4355 -11.6% 3849 perf-stat.i.page-faults
10.89 ± 40% +235.4% 36.51 ± 28% perf-stat.overall.MPKI
1.03 ± 49% +1.1 2.12 ± 44% perf-stat.overall.branch-miss-rate%
9.93 ± 14% -7.4 2.56 ± 8% perf-stat.overall.cache-miss-rate%
1.59 ± 9% +73.4% 2.76 ± 12% perf-stat.overall.cpi
1579 ± 5% +100.2% 3162 ± 24% perf-stat.overall.cycles-between-cache-misses
0.63 ± 8% -41.9% 0.37 ± 12% perf-stat.overall.ipc
24.89 ± 13% +21.3 46.16 ± 8% perf-stat.overall.node-load-miss-rate%
17.64 ± 25% +13.7 31.38 ± 15% perf-stat.overall.node-store-miss-rate%
1.681e+09 -24.9% 1.263e+09 ± 2% perf-stat.ps.branch-instructions
8670511 ± 16% -40.0% 5200670 ± 34% perf-stat.ps.cache-misses
92696590 ± 40% +114.2% 1.986e+08 ± 27% perf-stat.ps.cache-references
133536 -64.3% 47605 perf-stat.ps.context-switches
206.59 -4.1% 198.06 perf-stat.ps.cpu-migrations
2.262e+09 -36.2% 1.443e+09 ± 2% perf-stat.ps.dTLB-loads
1.075e+09 -51.2% 5.244e+08 ± 3% perf-stat.ps.dTLB-stores
2764305 ± 3% -36.7% 1750404 ± 7% perf-stat.ps.iTLB-load-misses
6605641 ± 6% -45.4% 3608091 ± 21% perf-stat.ps.iTLB-loads
8.513e+09 -35.9% 5.46e+09 ± 2% perf-stat.ps.instructions
1.25 -67.0% 0.41 ± 7% perf-stat.ps.major-faults
4337 -11.4% 3844 perf-stat.ps.minor-faults
1779749 -68.0% 569282 perf-stat.ps.node-loads
1003217 ± 3% -64.6% 355265 ± 6% perf-stat.ps.node-stores
4338 -11.4% 3844 perf-stat.ps.page-faults
2.64e+12 +101.3% 5.315e+12 ± 2% perf-stat.total.instructions
47976 ± 15% +257.9% 171687 ± 19% softirqs.CPU0.RCU
47168 +180.0% 132067 ± 4% softirqs.CPU0.SCHED
51434 ± 22% +275.5% 193128 ± 21% softirqs.CPU1.RCU
43547 ± 15% +239.0% 147607 ± 22% softirqs.CPU1.SCHED
53628 ± 22% +260.3% 193225 ± 12% softirqs.CPU10.RCU
46209 ± 7% +240.8% 157488 ± 16% softirqs.CPU10.SCHED
41543 ± 19% +270.4% 153875 ± 18% softirqs.CPU100.RCU
41317 +198.7% 123436 ± 2% softirqs.CPU100.SCHED
42175 ± 18% +264.2% 153611 ± 18% softirqs.CPU101.RCU
41592 ± 2% +191.0% 121049 ± 3% softirqs.CPU101.SCHED
43980 ± 19% +249.1% 153528 ± 16% softirqs.CPU102.RCU
41317 ± 2% +202.6% 125009 softirqs.CPU102.SCHED
41478 ± 19% +265.9% 151785 ± 18% softirqs.CPU103.RCU
40483 ± 3% +201.7% 122122 ± 2% softirqs.CPU103.SCHED
40685 ± 18% +254.6% 144288 ± 16% softirqs.CPU104.RCU
40294 ± 3% +189.8% 116773 ± 4% softirqs.CPU104.SCHED
42983 ± 18% +250.3% 150574 ± 19% softirqs.CPU105.RCU
41556 +191.9% 121290 ± 7% softirqs.CPU105.SCHED
43022 ± 17% +257.3% 153739 ± 19% softirqs.CPU106.RCU
37758 ± 25% +216.4% 119467 ± 6% softirqs.CPU106.SCHED
42788 ± 21% +258.1% 153241 ± 15% softirqs.CPU107.RCU
41843 ± 2% +183.8% 118749 ± 7% softirqs.CPU107.SCHED
42845 ± 15% +267.4% 157401 ± 18% softirqs.CPU108.RCU
42237 +187.3% 121351 ± 4% softirqs.CPU108.SCHED
42293 ± 17% +236.1% 142135 ± 16% softirqs.CPU109.RCU
41362 ± 2% +200.8% 124425 ± 3% softirqs.CPU109.SCHED
48453 ± 12% +261.6% 175223 ± 19% softirqs.CPU11.RCU
48735 ± 18% +183.4% 138131 ± 13% softirqs.CPU11.SCHED
40644 ± 20% +253.7% 143757 ± 17% softirqs.CPU110.RCU
41110 ± 3% +190.2% 119302 ± 4% softirqs.CPU110.SCHED
41486 ± 18% +261.4% 149920 ± 16% softirqs.CPU111.RCU
41832 ± 2% +191.0% 121750 ± 3% softirqs.CPU111.SCHED
39377 ± 18% +226.7% 128641 ± 18% softirqs.CPU112.RCU
40013 ± 8% +204.3% 121773 ± 3% softirqs.CPU112.SCHED
49821 ± 27% +202.9% 150883 ± 14% softirqs.CPU113.RCU
44545 ± 12% +210.8% 138439 ± 9% softirqs.CPU113.SCHED
41024 ± 21% +232.3% 136334 ± 18% softirqs.CPU114.RCU
42679 ± 2% +174.9% 117341 ± 6% softirqs.CPU114.SCHED
51244 ± 29% +196.3% 151833 ± 13% softirqs.CPU115.RCU
45818 ± 8% +208.4% 141320 ± 10% softirqs.CPU115.SCHED
48095 ± 14% +196.4% 142558 ± 20% softirqs.CPU116.RCU
44696 ± 5% +190.3% 129754 ± 18% softirqs.CPU116.SCHED
43739 ± 18% +212.5% 136681 ± 18% softirqs.CPU117.RCU
43118 ± 3% +183.4% 122201 ± 4% softirqs.CPU117.SCHED
47700 ± 26% +218.8% 152070 ± 25% softirqs.CPU118.RCU
44380 ± 6% +187.7% 127669 ± 27% softirqs.CPU118.SCHED
47016 ± 16% +203.3% 142611 ± 18% softirqs.CPU119.RCU
41382 ± 19% +179.5% 115658 ± 18% softirqs.CPU119.SCHED
44608 ± 18% +279.6% 169333 ± 17% softirqs.CPU12.RCU
43775 ± 2% +193.5% 128499 ± 2% softirqs.CPU12.SCHED
44136 ± 17% +223.6% 142847 ± 16% softirqs.CPU120.RCU
43181 +198.7% 128978 softirqs.CPU120.SCHED
39889 ± 20% +211.9% 124411 ± 17% softirqs.CPU121.RCU
39687 ± 18% +225.4% 129141 softirqs.CPU121.SCHED
40695 ± 19% +205.1% 124161 ± 14% softirqs.CPU122.RCU
42719 +201.9% 128991 softirqs.CPU122.SCHED
42156 ± 17% +234.7% 141093 ± 13% softirqs.CPU123.RCU
40098 ± 16% +222.4% 129267 softirqs.CPU123.SCHED
42220 ± 18% +239.9% 143519 ± 14% softirqs.CPU124.RCU
43005 +199.6% 128831 softirqs.CPU124.SCHED
42387 ± 18% +241.0% 144536 ± 13% softirqs.CPU125.RCU
42942 +199.7% 128688 softirqs.CPU125.SCHED
41968 ± 17% +238.0% 141872 ± 14% softirqs.CPU126.RCU
43047 +199.2% 128796 softirqs.CPU126.SCHED
40429 ± 18% +229.9% 133370 ± 15% softirqs.CPU127.RCU
42890 +200.5% 128904 softirqs.CPU127.SCHED
48217 ± 16% +244.5% 166100 ± 13% softirqs.CPU128.RCU
42893 +199.7% 128534 softirqs.CPU128.SCHED
48941 ± 17% +262.6% 177454 ± 15% softirqs.CPU129.RCU
42940 +176.2% 118609 ± 18% softirqs.CPU129.SCHED
55036 ± 23% +233.4% 183509 ± 10% softirqs.CPU13.RCU
52316 ± 21% +207.1% 160681 ± 14% softirqs.CPU13.SCHED
48310 ± 16% +253.7% 170891 ± 13% softirqs.CPU130.RCU
42924 +199.8% 128689 softirqs.CPU130.SCHED
50605 ± 18% +261.4% 182894 ± 15% softirqs.CPU131.RCU
42946 +199.8% 128751 softirqs.CPU131.SCHED
50618 ± 17% +257.9% 181155 ± 14% softirqs.CPU132.RCU
42950 +199.9% 128823 softirqs.CPU132.SCHED
47107 ± 16% +228.9% 154953 ± 14% softirqs.CPU133.RCU
42859 +199.7% 128457 softirqs.CPU133.SCHED
47255 ± 16% +253.5% 167059 ± 13% softirqs.CPU134.RCU
42869 +199.9% 128578 softirqs.CPU134.SCHED
48997 ± 17% +263.0% 177884 ± 16% softirqs.CPU135.RCU
43088 +198.5% 128617 softirqs.CPU135.SCHED
48290 ± 17% +231.1% 159866 ± 12% softirqs.CPU136.RCU
42871 +199.7% 128486 softirqs.CPU136.SCHED
50797 ± 18% +253.8% 179726 ± 15% softirqs.CPU137.RCU
42855 +200.4% 128740 softirqs.CPU137.SCHED
50699 ± 17% +250.8% 177866 ± 19% softirqs.CPU138.RCU
42914 +199.5% 128513 softirqs.CPU138.SCHED
50423 ± 17% +245.4% 174159 ± 15% softirqs.CPU139.RCU
42979 +199.6% 128778 softirqs.CPU139.SCHED
52819 ± 20% +219.3% 168636 ± 18% softirqs.CPU14.RCU
43159 ± 13% +209.6% 133628 ± 16% softirqs.CPU14.SCHED
46894 ± 16% +278.5% 177496 ± 16% softirqs.CPU140.RCU
43124 +198.4% 128690 softirqs.CPU140.SCHED
49658 ± 17% +245.7% 171649 ± 12% softirqs.CPU141.RCU
43089 +197.8% 128335 softirqs.CPU141.SCHED
46164 ± 29% +291.6% 180797 ± 15% softirqs.CPU142.RCU
42946 +200.1% 128881 softirqs.CPU142.SCHED
49975 ± 17% +233.4% 166629 ± 20% softirqs.CPU143.RCU
43226 +197.7% 128696 softirqs.CPU143.SCHED
47691 ± 16% +254.9% 169272 ± 16% softirqs.CPU144.RCU
39846 ± 18% +219.0% 127096 ± 3% softirqs.CPU144.SCHED
47014 ± 16% +237.7% 158783 ± 9% softirqs.CPU145.RCU
42817 +196.6% 127008 ± 2% softirqs.CPU145.SCHED
44737 ± 18% +238.4% 151384 ± 13% softirqs.CPU146.RCU
42881 +196.0% 126941 ± 3% softirqs.CPU146.SCHED
48710 ± 18% +263.8% 177218 ± 15% softirqs.CPU147.RCU
42869 +198.1% 127792 ± 2% softirqs.CPU147.SCHED
48313 ± 19% +266.6% 177140 ± 17% softirqs.CPU148.RCU
42667 +197.8% 127064 ± 2% softirqs.CPU148.SCHED
48745 ± 19% +267.5% 179137 ± 17% softirqs.CPU149.RCU
42779 +191.5% 124719 ± 5% softirqs.CPU149.SCHED
55797 ± 22% +202.4% 168757 ± 25% softirqs.CPU15.RCU
47221 ± 11% +185.3% 134730 ± 17% softirqs.CPU15.SCHED
49276 ± 18% +263.5% 179135 ± 16% softirqs.CPU150.RCU
42737 +198.9% 127761 ± 2% softirqs.CPU150.SCHED
48546 ± 19% +257.1% 173353 ± 14% softirqs.CPU151.RCU
42744 +197.7% 127256 ± 2% softirqs.CPU151.SCHED
47510 ± 19% +268.4% 175050 ± 17% softirqs.CPU152.RCU
43159 +195.2% 127387 ± 2% softirqs.CPU152.SCHED
47736 ± 17% +254.1% 169020 ± 14% softirqs.CPU153.RCU
42572 +198.8% 127216 ± 2% softirqs.CPU153.SCHED
49147 ± 18% +260.8% 177322 ± 15% softirqs.CPU154.RCU
42684 +192.1% 124671 ± 6% softirqs.CPU154.SCHED
49797 ± 19% +259.2% 178865 ± 16% softirqs.CPU155.RCU
42812 +191.2% 124665 ± 4% softirqs.CPU155.SCHED
45522 ± 16% +257.2% 162586 ± 14% softirqs.CPU156.RCU
42444 ± 2% +198.5% 126691 ± 2% softirqs.CPU156.SCHED
45992 ± 17% +253.9% 162770 ± 14% softirqs.CPU157.RCU
42499 +198.1% 126676 ± 3% softirqs.CPU157.SCHED
48781 ± 19% +259.2% 175202 ± 17% softirqs.CPU158.RCU
42565 +199.9% 127672 ± 2% softirqs.CPU158.SCHED
43221 ± 13% +282.9% 165496 ± 15% softirqs.CPU159.RCU
42456 +199.7% 127247 ± 2% softirqs.CPU159.SCHED
43889 ± 15% +217.8% 139494 ± 20% softirqs.CPU16.RCU
43807 ± 4% +189.4% 126785 ± 4% softirqs.CPU16.SCHED
46851 ± 18% +223.7% 151649 ± 20% softirqs.CPU160.RCU
42661 +198.0% 127128 ± 3% softirqs.CPU160.SCHED
48331 ± 17% +229.3% 159146 ± 19% softirqs.CPU161.RCU
43157 +194.8% 127235 ± 2% softirqs.CPU161.SCHED
43141 ± 20% +214.8% 135819 ± 22% softirqs.CPU162.RCU
42300 ± 2% +199.3% 126619 ± 3% softirqs.CPU162.SCHED
46485 ± 17% +234.6% 155555 ± 18% softirqs.CPU163.RCU
42606 +196.8% 126464 ± 3% softirqs.CPU163.SCHED
50580 ± 17% +217.2% 160421 ± 15% softirqs.CPU164.RCU
43720 ± 5% +208.9% 135065 ± 11% softirqs.CPU164.SCHED
46832 ± 16% +227.4% 153312 ± 18% softirqs.CPU165.RCU
43201 +194.5% 127249 ± 2% softirqs.CPU165.SCHED
48015 ± 16% +239.6% 163069 ± 18% softirqs.CPU166.RCU
42996 +196.3% 127414 ± 2% softirqs.CPU166.SCHED
49610 ± 17% +217.9% 157708 ± 16% softirqs.CPU167.RCU
42104 ± 6% +181.6% 118568 ± 14% softirqs.CPU167.SCHED
45412 ± 18% +242.1% 155368 ± 15% softirqs.CPU168.RCU
37913 ± 28% +235.9% 127357 ± 2% softirqs.CPU168.SCHED
42364 ± 17% +237.9% 143165 ± 16% softirqs.CPU169.RCU
42947 +196.9% 127511 ± 2% softirqs.CPU169.SCHED
41809 ± 16% +226.8% 136639 ± 18% softirqs.CPU17.RCU
43062 ± 2% +184.6% 122557 ± 3% softirqs.CPU17.SCHED
41355 ± 18% +235.0% 138528 ± 17% softirqs.CPU170.RCU
42981 +195.6% 127038 ± 2% softirqs.CPU170.SCHED
44314 ± 17% +254.2% 156976 ± 15% softirqs.CPU171.RCU
42797 +198.4% 127690 ± 2% softirqs.CPU171.SCHED
42907 ± 18% +255.1% 152357 ± 15% softirqs.CPU172.RCU
42782 +197.2% 127138 ± 2% softirqs.CPU172.SCHED
44525 ± 17% +249.4% 155577 ± 16% softirqs.CPU173.RCU
42965 +196.8% 127535 ± 2% softirqs.CPU173.SCHED
44451 ± 17% +253.6% 157160 ± 16% softirqs.CPU174.RCU
39726 ± 17% +202.8% 120305 ± 12% softirqs.CPU174.SCHED
43013 ± 17% +243.7% 147830 ± 15% softirqs.CPU175.RCU
42875 +196.2% 127007 ± 2% softirqs.CPU175.SCHED
48247 ± 17% +265.0% 176099 ± 13% softirqs.CPU176.RCU
42918 +196.9% 127435 ± 2% softirqs.CPU176.SCHED
47684 ± 16% +259.4% 171352 ± 13% softirqs.CPU177.RCU
42930 +197.0% 127486 ± 2% softirqs.CPU177.SCHED
48461 ± 17% +270.9% 179734 ± 14% softirqs.CPU178.RCU
42903 +197.0% 127416 ± 2% softirqs.CPU178.SCHED
49351 ± 18% +258.6% 176969 ± 15% softirqs.CPU179.RCU
42835 +198.0% 127641 ± 2% softirqs.CPU179.SCHED
42112 ± 18% +232.2% 139876 ± 18% softirqs.CPU18.RCU
41917 ± 6% +188.8% 121070 ± 6% softirqs.CPU18.SCHED
46700 ± 15% +256.6% 166553 ± 15% softirqs.CPU180.RCU
42770 +197.1% 127081 ± 2% softirqs.CPU180.SCHED
46319 ± 16% +251.4% 162763 ± 13% softirqs.CPU181.RCU
42811 +196.3% 126870 ± 2% softirqs.CPU181.SCHED
49048 ± 17% +269.2% 181069 ± 15% softirqs.CPU182.RCU
42901 +197.1% 127479 ± 2% softirqs.CPU182.SCHED
46991 ± 15% +243.9% 161593 ± 13% softirqs.CPU183.RCU
42758 +197.2% 127081 ± 2% softirqs.CPU183.SCHED
48663 ± 16% +259.0% 174707 ± 13% softirqs.CPU184.RCU
42692 +198.8% 127565 ± 2% softirqs.CPU184.SCHED
49390 ± 17% +261.0% 178275 ± 14% softirqs.CPU185.RCU
42892 +197.0% 127411 ± 2% softirqs.CPU185.SCHED
40647 ± 24% +281.6% 155111 ± 16% softirqs.CPU186.RCU
43084 +194.4% 126861 ± 2% softirqs.CPU186.SCHED
49093 ± 15% +270.0% 181656 ± 15% softirqs.CPU187.RCU
42737 +197.7% 127220 ± 2% softirqs.CPU187.SCHED
48869 ± 18% +273.1% 182329 ± 16% softirqs.CPU188.RCU
42782 +197.7% 127359 ± 2% softirqs.CPU188.SCHED
46694 ± 16% +266.7% 171220 ± 14% softirqs.CPU189.RCU
42509 +199.1% 127150 ± 2% softirqs.CPU189.SCHED
40050 ± 19% +240.9% 136513 ± 18% softirqs.CPU19.RCU
39309 ± 17% +209.7% 121760 ± 6% softirqs.CPU19.SCHED
48637 ± 17% +272.5% 181180 ± 16% softirqs.CPU190.RCU
42877 ± 2% +206.4% 131354 ± 7% softirqs.CPU190.SCHED
47627 ± 15% +254.5% 168848 ± 13% softirqs.CPU191.RCU
28001 ± 23% +240.7% 95412 ± 29% softirqs.CPU191.SCHED
54426 ± 18% +221.3% 174885 ± 23% softirqs.CPU2.RCU
44916 ± 6% +187.0% 128892 ± 25% softirqs.CPU2.SCHED
40331 ± 19% +231.5% 133709 ± 17% softirqs.CPU20.RCU
39401 ± 17% +221.4% 126625 ± 5% softirqs.CPU20.SCHED
39891 ± 19% +243.9% 137191 ± 19% softirqs.CPU21.RCU
39521 ± 17% +236.4% 132930 ± 17% softirqs.CPU22.RCU
42309 +189.2% 122370 ± 5% softirqs.CPU22.SCHED
39369 ± 19% +243.9% 135409 ± 18% softirqs.CPU23.RCU
41982 +197.6% 124944 softirqs.CPU23.SCHED
43827 ± 17% +230.4% 144800 ± 17% softirqs.CPU24.RCU
43392 +175.1% 119368 ± 19% softirqs.CPU24.SCHED
39340 ± 18% +215.8% 124243 ± 20% softirqs.CPU25.RCU
42674 +201.6% 128703 softirqs.CPU25.SCHED
41063 ± 17% +220.5% 131589 ± 16% softirqs.CPU26.RCU
44950 ± 10% +190.5% 130563 ± 3% softirqs.CPU26.SCHED
42200 ± 17% +245.9% 145986 ± 14% softirqs.CPU27.RCU
43888 ± 3% +197.5% 130586 ± 3% softirqs.CPU27.SCHED
42448 ± 18% +239.8% 144233 ± 14% softirqs.CPU28.RCU
42899 +201.1% 129177 softirqs.CPU28.SCHED
40082 ± 18% +264.6% 146157 ± 13% softirqs.CPU29.RCU
53587 ± 20% +141.1% 129212 softirqs.CPU29.SCHED
45978 ± 24% +264.0% 167357 ± 22% softirqs.CPU3.RCU
42350 ± 4% +194.7% 124827 ± 2% softirqs.CPU3.SCHED
42308 ± 17% +238.6% 143261 ± 14% softirqs.CPU30.RCU
44139 ± 4% +190.6% 128281 softirqs.CPU30.SCHED
39958 ± 21% +241.3% 136377 ± 15% softirqs.CPU31.RCU
61474 ± 32% +109.1% 128561 softirqs.CPU31.SCHED
50434 ± 15% +237.7% 170309 ± 11% softirqs.CPU32.RCU
43540 ± 3% +196.0% 128860 softirqs.CPU32.SCHED
50391 ± 16% +251.2% 176949 ± 15% softirqs.CPU33.RCU
45705 ± 13% +181.7% 128738 softirqs.CPU33.SCHED
49965 ± 15% +253.6% 176666 ± 13% softirqs.CPU34.RCU
42883 +199.7% 128527 softirqs.CPU34.SCHED
51875 ± 17% +259.2% 186362 ± 13% softirqs.CPU35.RCU
43448 ± 2% +195.8% 128522 softirqs.CPU35.SCHED
52075 ± 15% +254.3% 184529 ± 13% softirqs.CPU36.RCU
42919 +199.6% 128584 softirqs.CPU36.SCHED
48685 ± 16% +229.1% 160202 ± 14% softirqs.CPU37.RCU
42690 +200.9% 128461 softirqs.CPU37.SCHED
49203 ± 16% +249.0% 171741 ± 13% softirqs.CPU38.RCU
42846 +182.4% 120982 ± 17% softirqs.CPU38.SCHED
50971 ± 16% +253.9% 180392 ± 16% softirqs.CPU39.RCU
42890 +200.2% 128754 softirqs.CPU39.SCHED
50852 ± 20% +276.7% 191550 ± 14% softirqs.CPU4.RCU
44115 ± 6% +253.5% 155969 ± 16% softirqs.CPU4.SCHED
49870 ± 15% +226.2% 162692 ± 13% softirqs.CPU40.RCU
42850 +205.4% 130844 ± 4% softirqs.CPU40.SCHED
11.83 ± 17% +42850.7% 5082 ±222% softirqs.CPU40.TIMER
51256 ± 16% +258.7% 183849 ± 15% softirqs.CPU41.RCU
46670 ± 17% +175.6% 128620 softirqs.CPU41.SCHED
52995 ± 13% +243.3% 181911 ± 17% softirqs.CPU42.RCU
42980 +198.9% 128479 softirqs.CPU42.SCHED
52444 ± 16% +240.5% 178580 ± 15% softirqs.CPU43.RCU
43010 +197.9% 128145 softirqs.CPU43.SCHED
50509 ± 15% +261.1% 182399 ± 15% softirqs.CPU44.RCU
43255 ± 2% +198.5% 129135 softirqs.CPU44.SCHED
51524 ± 16% +241.7% 176076 ± 12% softirqs.CPU45.RCU
43126 +197.9% 128493 softirqs.CPU45.SCHED
52276 ± 17% +250.2% 183055 ± 13% softirqs.CPU46.RCU
42954 +199.6% 128692 softirqs.CPU46.SCHED
52168 ± 16% +228.4% 171301 ± 20% softirqs.CPU47.RCU
42939 +200.2% 128907 softirqs.CPU47.SCHED
53681 ± 15% +231.6% 178016 ± 14% softirqs.CPU48.RCU
43740 ± 2% +191.9% 127684 ± 2% softirqs.CPU48.SCHED
49552 ± 16% +237.7% 167333 ± 8% softirqs.CPU49.RCU
42962 +196.1% 127208 ± 2% softirqs.CPU49.SCHED
49029 ± 14% +255.8% 174467 ± 18% softirqs.CPU5.RCU
43874 ± 4% +199.9% 131564 ± 5% softirqs.CPU5.SCHED
50757 ± 21% +215.7% 160254 ± 14% softirqs.CPU50.RCU
44004 ± 5% +193.6% 129191 ± 3% softirqs.CPU50.SCHED
51333 ± 16% +264.0% 186847 ± 13% softirqs.CPU51.RCU
43064 +173.7% 117859 ± 18% softirqs.CPU51.SCHED
51372 ± 16% +259.9% 184905 ± 15% softirqs.CPU52.RCU
42624 +199.8% 127808 ± 2% softirqs.CPU52.SCHED
52646 ± 16% +268.1% 193772 ± 12% softirqs.CPU53.RCU
43279 ± 2% +214.7% 136197 ± 13% softirqs.CPU53.SCHED
51606 ± 16% +261.5% 186539 ± 14% softirqs.CPU54.RCU
42691 +198.2% 127300 ± 2% softirqs.CPU54.SCHED
50188 ± 15% +252.5% 176918 ± 13% softirqs.CPU55.RCU
39940 ± 16% +220.0% 127793 softirqs.CPU55.SCHED
50110 ± 16% +279.9% 190347 ± 12% softirqs.CPU56.RCU
43453 ± 2% +218.5% 138402 ± 16% softirqs.CPU56.SCHED
49678 ± 15% +260.7% 179197 ± 11% softirqs.CPU57.RCU
42419 +204.0% 128955 ± 2% softirqs.CPU57.SCHED
51036 ± 17% +264.3% 185947 ± 13% softirqs.CPU58.RCU
42674 +200.9% 128427 softirqs.CPU58.SCHED
52214 ± 18% +268.3% 192302 ± 11% softirqs.CPU59.RCU
42919 +215.3% 135304 ± 11% softirqs.CPU59.SCHED
45835 ± 20% +246.6% 158888 ± 15% softirqs.CPU6.RCU
42428 +200.5% 127488 ± 2% softirqs.CPU6.SCHED
47933 ± 15% +255.5% 170407 ± 13% softirqs.CPU60.RCU
42799 +202.9% 129618 ± 4% softirqs.CPU60.SCHED
49088 ± 16% +246.0% 169846 ± 11% softirqs.CPU61.RCU
43356 ± 2% +193.9% 127410 ± 2% softirqs.CPU61.SCHED
53333 ± 18% +254.6% 189122 ± 11% softirqs.CPU62.RCU
43861 ± 4% +209.8% 135861 ± 12% softirqs.CPU62.SCHED
53241 ± 22% +236.8% 179298 ± 13% softirqs.CPU63.RCU
44674 ± 8% +205.8% 136632 ± 14% softirqs.CPU63.SCHED
49905 ± 14% +215.5% 157474 ± 18% softirqs.CPU64.RCU
43368 ± 2% +198.3% 129382 ± 2% softirqs.CPU64.SCHED
48982 ± 16% +226.6% 160001 ± 18% softirqs.CPU65.RCU
43072 +197.4% 128104 softirqs.CPU65.SCHED
45954 ± 20% +196.8% 136398 ± 22% softirqs.CPU66.RCU
42649 +199.1% 127549 ± 2% softirqs.CPU66.SCHED
47346 ± 17% +231.5% 156959 ± 14% softirqs.CPU67.RCU
42757 +197.7% 127294 ± 2% softirqs.CPU67.SCHED
21.00 ± 78% +35142.1% 7400 ±221% softirqs.CPU67.TIMER
48696 ± 17% +234.0% 162652 ± 22% softirqs.CPU68.RCU
42961 +196.8% 127499 ± 2% softirqs.CPU68.SCHED
46723 ± 19% +241.6% 159592 ± 14% softirqs.CPU69.RCU
42165 ± 2% +208.5% 130068 ± 5% softirqs.CPU69.SCHED
46511 ± 12% +311.3% 191298 ± 11% softirqs.CPU7.RCU
42704 ± 2% +267.8% 157047 ± 15% softirqs.CPU7.SCHED
48338 ± 18% +244.8% 166664 ± 17% softirqs.CPU70.RCU
42794 +198.1% 127548 ± 2% softirqs.CPU70.SCHED
46911 ± 19% +238.4% 158759 ± 18% softirqs.CPU71.RCU
43148 +195.7% 127600 ± 2% softirqs.CPU71.SCHED
47114 ± 16% +241.6% 160935 ± 15% softirqs.CPU72.RCU
42568 +191.3% 123982 ± 6% softirqs.CPU72.SCHED
44503 ± 17% +240.8% 151658 ± 15% softirqs.CPU73.RCU
42500 +184.6% 120955 ± 16% softirqs.CPU73.SCHED
43480 ± 19% +230.4% 143673 ± 18% softirqs.CPU74.RCU
42477 +183.4% 120389 ± 11% softirqs.CPU74.SCHED
45923 ± 17% +246.7% 159220 ± 14% softirqs.CPU75.RCU
42440 +199.4% 127053 ± 2% softirqs.CPU75.SCHED
45853 ± 19% +242.4% 156991 ± 15% softirqs.CPU76.RCU
42526 +201.0% 127994 ± 3% softirqs.CPU76.SCHED
45711 ± 17% +246.0% 158164 ± 16% softirqs.CPU77.RCU
42384 +199.7% 127037 ± 2% softirqs.CPU77.SCHED
45632 ± 16% +245.0% 157419 ± 14% softirqs.CPU78.RCU
42568 +197.3% 126542 ± 2% softirqs.CPU78.SCHED
45016 ± 17% +236.6% 151502 ± 14% softirqs.CPU79.RCU
42256 +199.1% 126390 ± 2% softirqs.CPU79.SCHED
45137 ± 11% +272.8% 168281 ± 19% softirqs.CPU8.RCU
44416 ± 9% +209.3% 137371 ± 16% softirqs.CPU8.SCHED
49887 ± 17% +265.9% 182560 ± 13% softirqs.CPU80.RCU
42640 +195.7% 126093 ± 2% softirqs.CPU80.SCHED
47646 ± 15% +262.9% 172885 ± 13% softirqs.CPU81.RCU
42582 +196.8% 126400 ± 2% softirqs.CPU81.SCHED
49622 ± 18% +270.0% 183592 ± 14% softirqs.CPU82.RCU
42458 +198.6% 126761 ± 2% softirqs.CPU82.SCHED
49861 ± 17% +258.5% 178732 ± 14% softirqs.CPU83.RCU
42577 +198.4% 127038 ± 2% softirqs.CPU83.SCHED
47320 ± 15% +253.2% 167129 ± 13% softirqs.CPU84.RCU
42307 +198.2% 126152 ± 2% softirqs.CPU84.SCHED
47744 ± 15% +250.8% 167497 ± 12% softirqs.CPU85.RCU
42189 +199.4% 126299 ± 3% softirqs.CPU85.SCHED
48849 ± 19% +275.9% 183609 ± 14% softirqs.CPU86.RCU
42347 +199.8% 126939 ± 2% softirqs.CPU86.SCHED
47686 ± 16% +242.0% 163098 ± 13% softirqs.CPU87.RCU
42395 +199.0% 126761 ± 2% softirqs.CPU87.SCHED
48776 ± 16% +259.3% 175253 ± 13% softirqs.CPU88.RCU
42344 +182.2% 119513 ± 12% softirqs.CPU88.SCHED
50336 ± 17% +258.6% 180495 ± 13% softirqs.CPU89.RCU
42601 +197.1% 126559 ± 2% softirqs.CPU89.SCHED
44394 ± 14% +259.4% 159563 ± 18% softirqs.CPU9.RCU
42487 +199.3% 127156 ± 3% softirqs.CPU9.SCHED
46308 ± 19% +242.4% 158563 ± 16% softirqs.CPU90.RCU
42469 +197.7% 126423 ± 2% softirqs.CPU90.SCHED
50144 ± 16% +268.2% 184632 ± 15% softirqs.CPU91.RCU
42500 +197.7% 126505 ± 2% softirqs.CPU91.SCHED
50364 ± 17% +264.4% 183530 ± 15% softirqs.CPU92.RCU
42544 +197.9% 126755 ± 2% softirqs.CPU92.SCHED
47189 ± 17% +268.9% 174087 ± 13% softirqs.CPU93.RCU
42182 +200.0% 126554 ± 2% softirqs.CPU93.SCHED
50818 ± 18% +263.4% 184692 ± 15% softirqs.CPU94.RCU
42768 +196.9% 126978 ± 2% softirqs.CPU94.SCHED
49496 ± 15% +247.3% 171917 ± 11% softirqs.CPU95.RCU
22401 ± 11% +270.9% 83076 ± 46% softirqs.CPU95.SCHED
42634 ± 18% +266.4% 156208 ± 19% softirqs.CPU96.RCU
41316 ± 17% +269.4% 152640 ± 18% softirqs.CPU97.RCU
41578 ± 3% +195.2% 122722 ± 2% softirqs.CPU97.SCHED
41991 ± 20% +266.1% 153710 ± 17% softirqs.CPU98.RCU
40589 ± 5% +197.9% 120925 ± 3% softirqs.CPU98.SCHED
43012 ± 18% +254.8% 152628 ± 18% softirqs.CPU99.RCU
42041 ± 2% +191.2% 122444 ± 2% softirqs.CPU99.SCHED
18511 ± 46% +211.2% 57608 ± 27% softirqs.NET_RX
9023846 ± 15% +248.2% 31418582 ± 12% softirqs.RCU
8211849 +197.7% 24442961 softirqs.SCHED
60379 ± 2% +163.2% 158940 ± 3% softirqs.TIMER
6.22 ± 4% -4.2 2.04 ± 22% perf-profile.calltrace.cycles-pp.btree_write_cache_pages.do_writepages.filemap_fdatawrite_wbc.filemap_fdatawrite_range.btrfs_write_marked_extents
62.31 ± 2% -4.2 58.15 ± 2% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
62.31 ± 2% -4.2 58.15 ± 2% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
62.27 ± 2% -4.2 58.11 ± 2% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
4.96 ± 5% -4.0 1.01 ± 41% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
62.50 ± 2% -3.8 58.74 ± 2% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
56.59 ± 2% -3.8 52.83 ± 2% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
5.68 ± 4% -3.6 2.04 ± 22% perf-profile.calltrace.cycles-pp.filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.do_fsync
5.68 ± 4% -3.6 2.04 ± 22% perf-profile.calltrace.cycles-pp.filemap_fdatawrite_wbc.filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file
5.67 ± 4% -3.6 2.04 ± 22% perf-profile.calltrace.cycles-pp.do_writepages.filemap_fdatawrite_wbc.filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log
5.10 ± 9% -3.4 1.73 ± 24% perf-profile.calltrace.cycles-pp.submit_one_bio.btree_write_cache_pages.do_writepages.filemap_fdatawrite_wbc.filemap_fdatawrite_range
5.09 ± 9% -3.4 1.72 ± 24% perf-profile.calltrace.cycles-pp.btrfs_submit_metadata_bio.submit_one_bio.btree_write_cache_pages.do_writepages.filemap_fdatawrite_wbc
4.90 ± 9% -3.3 1.63 ± 24% perf-profile.calltrace.cycles-pp.btree_csum_one_bio.btrfs_submit_metadata_bio.submit_one_bio.btree_write_cache_pages.do_writepages
4.88 ± 9% -3.2 1.63 ± 24% perf-profile.calltrace.cycles-pp.csum_one_extent_buffer.btree_csum_one_bio.btrfs_submit_metadata_bio.submit_one_bio.btree_write_cache_pages
2.94 ± 4% -1.9 1.08 ± 28% perf-profile.calltrace.cycles-pp.check_leaf.csum_one_extent_buffer.btree_csum_one_bio.btrfs_submit_metadata_bio.submit_one_bio
3.21 ± 3% -1.7 1.52 ± 25% perf-profile.calltrace.cycles-pp.open64
3.20 ± 3% -1.7 1.52 ± 25% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.open64
3.19 ± 3% -1.7 1.51 ± 25% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
3.19 ± 3% -1.7 1.52 ± 25% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
3.18 ± 3% -1.7 1.51 ± 25% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
3.14 ± 3% -1.6 1.49 ± 25% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.13 ± 3% -1.6 1.49 ± 25% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
2.62 ± 12% -1.5 1.08 ± 28% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
2.72 ± 11% -1.3 1.40 ± 44% perf-profile.calltrace.cycles-pp.ret_from_fork
2.72 ± 11% -1.3 1.40 ± 44% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
2.24 ± 12% -1.3 0.92 ± 30% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
1.96 ± 11% -1.3 0.69 ± 54% perf-profile.calltrace.cycles-pp.btrfs_work_helper.process_one_work.worker_thread.kthread.ret_from_fork
2.37 ± 3% -1.2 1.16 ± 26% perf-profile.calltrace.cycles-pp.btrfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
1.58 ± 6% -1.1 0.44 ± 74% perf-profile.calltrace.cycles-pp.start_ordered_ops.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
1.59 ± 9% -1.1 0.45 ± 73% perf-profile.calltrace.cycles-pp.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work.worker_thread.kthread
2.94 ± 4% -1.0 1.92 ± 8% perf-profile.calltrace.cycles-pp.copy_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
1.30 ± 2% -1.0 0.32 ±102% perf-profile.calltrace.cycles-pp.btrfs_get_32.check_leaf.csum_one_extent_buffer.btree_csum_one_bio.btrfs_submit_metadata_bio
1.30 ± 7% -1.0 0.34 ±100% perf-profile.calltrace.cycles-pp.write
1.29 ± 7% -1.0 0.33 ±100% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
1.29 ± 7% -1.0 0.33 ±100% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
1.28 ± 7% -1.0 0.33 ±100% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
1.27 ± 7% -0.9 0.33 ±100% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
1.25 ± 7% -0.9 0.32 ±101% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.59 ± 6% -0.9 0.68 ± 24% perf-profile.calltrace.cycles-pp.btrfs_wait_ordered_range.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
1.20 ± 6% -0.9 0.30 ±100% perf-profile.calltrace.cycles-pp.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
1.19 ± 6% -0.9 0.30 ±100% perf-profile.calltrace.cycles-pp.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write
1.55 ± 5% -0.9 0.69 ± 16% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
1.53 ± 5% -0.8 0.68 ± 15% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
0.89 ± 6% -0.6 0.33 ±101% perf-profile.calltrace.cycles-pp.btrfs_new_inode.btrfs_create.path_openat.do_filp_open.do_sys_openat2
1.93 ± 2% -0.5 1.43 ± 6% perf-profile.calltrace.cycles-pp.btrfs_csum_file_blocks.log_csums.copy_items.btrfs_log_inode.btrfs_log_inode_parent
1.93 ± 2% -0.5 1.43 ± 6% perf-profile.calltrace.cycles-pp.log_csums.copy_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe
1.27 ± 3% -0.2 1.05 ± 3% perf-profile.calltrace.cycles-pp.btrfs_lookup_csum.btrfs_csum_file_blocks.log_csums.copy_items.btrfs_log_inode
1.26 ± 3% -0.2 1.05 ± 3% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_csum.btrfs_csum_file_blocks.log_csums.copy_items
1.49 ± 9% +0.2 1.72 ± 8% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
6.84 ± 3% +1.3 8.16 ± 5% perf-profile.calltrace.cycles-pp.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync
0.36 ± 71% +1.4 1.78 ± 20% perf-profile.calltrace.cycles-pp.btrfs_alloc_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items
5.75 ± 4% +1.5 7.27 ± 4% perf-profile.calltrace.cycles-pp.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.do_fsync.__x64_sys_fsync
0.00 +1.6 1.56 ± 22% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.set_extent_bit.btrfs_alloc_tree_block.__btrfs_cow_block
0.00 +1.6 1.57 ± 22% perf-profile.calltrace.cycles-pp._raw_spin_lock.set_extent_bit.btrfs_alloc_tree_block.__btrfs_cow_block.btrfs_cow_block
0.00 +1.6 1.61 ± 22% perf-profile.calltrace.cycles-pp.set_extent_bit.btrfs_alloc_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot
0.00 +2.1 2.08 ± 10% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__clear_extent_bit.clear_extent_bit.delete_tree_block
0.00 +2.1 2.09 ± 10% perf-profile.calltrace.cycles-pp._raw_spin_lock.__clear_extent_bit.clear_extent_bit.delete_tree_block.__btrfs_cow_block
0.00 +2.1 2.12 ± 10% perf-profile.calltrace.cycles-pp.__clear_extent_bit.clear_extent_bit.delete_tree_block.__btrfs_cow_block.btrfs_cow_block
0.00 +2.1 2.12 ± 10% perf-profile.calltrace.cycles-pp.clear_extent_bit.delete_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot
1.10 ± 6% +2.2 3.26 ± 12% perf-profile.calltrace.cycles-pp.mutex_spin_on_owner.__mutex_lock.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
0.00 +2.2 2.18 ± 10% perf-profile.calltrace.cycles-pp.delete_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items
1.78 ± 3% +2.6 4.36 ± 11% perf-profile.calltrace.cycles-pp.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items.truncate_inode_items.btrfs_log_inode
1.77 ± 3% +2.6 4.36 ± 11% perf-profile.calltrace.cycles-pp.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items.truncate_inode_items
0.71 ± 4% +2.8 3.49 ± 19% perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
2.89 ± 3% +2.8 5.72 ± 7% perf-profile.calltrace.cycles-pp.btrfs_truncate_inode_items.truncate_inode_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe
2.89 ± 3% +2.8 5.72 ± 7% perf-profile.calltrace.cycles-pp.truncate_inode_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
2.83 ± 3% +2.8 5.68 ± 7% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_truncate_inode_items.truncate_inode_items.btrfs_log_inode.btrfs_log_inode_parent
0.00 +4.0 3.95 ± 17% perf-profile.calltrace.cycles-pp.rb_next.find_first_extent_bit_state.find_first_extent_bit.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents
0.00 +4.0 4.04 ± 14% perf-profile.calltrace.cycles-pp.rb_next.find_first_extent_bit_state.find_first_extent_bit.btrfs_write_marked_extents.btrfs_sync_log
0.68 ± 6% +4.6 5.31 ± 14% perf-profile.calltrace.cycles-pp.btrfs_wait_tree_log_extents.btrfs_sync_log.btrfs_sync_file.do_fsync.__x64_sys_fsync
0.68 ± 7% +4.6 5.31 ± 14% perf-profile.calltrace.cycles-pp.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents.btrfs_sync_log.btrfs_sync_file.do_fsync
1.83 ± 5% +4.9 6.76 ± 15% perf-profile.calltrace.cycles-pp.__mutex_lock.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync
0.00 +5.2 5.16 ± 15% perf-profile.calltrace.cycles-pp.find_first_extent_bit_state.find_first_extent_bit.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents.btrfs_sync_log
0.00 +5.2 5.18 ± 15% perf-profile.calltrace.cycles-pp.find_first_extent_bit.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents.btrfs_sync_log.btrfs_sync_file
0.00 +5.2 5.18 ± 13% perf-profile.calltrace.cycles-pp.find_first_extent_bit_state.find_first_extent_bit.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file
0.00 +5.2 5.20 ± 13% perf-profile.calltrace.cycles-pp.find_first_extent_bit.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.do_fsync
12.75 ± 3% +5.5 18.25 ± 9% perf-profile.calltrace.cycles-pp.btrfs_sync_log.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
8.80 ± 3% +6.2 15.01 ± 8% perf-profile.calltrace.cycles-pp.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
8.79 ± 3% +6.2 15.00 ± 8% perf-profile.calltrace.cycles-pp.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync.__x64_sys_fsync
26.42 ± 3% +8.4 34.83 ± 7% perf-profile.calltrace.cycles-pp.fsync
26.33 ± 3% +8.5 34.79 ± 7% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.fsync
26.32 ± 3% +8.5 34.78 ± 7% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.fsync
26.30 ± 3% +8.5 34.77 ± 7% perf-profile.calltrace.cycles-pp.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe.fsync
26.29 ± 3% +8.5 34.76 ± 7% perf-profile.calltrace.cycles-pp.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe
26.30 ± 3% +8.5 34.77 ± 7% perf-profile.calltrace.cycles-pp.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe.fsync
7.77 ± 4% -5.1 2.72 ± 24% perf-profile.children.cycles-pp.do_writepages
7.76 ± 4% -5.0 2.72 ± 24% perf-profile.children.cycles-pp.filemap_fdatawrite_range
7.75 ± 4% -5.0 2.71 ± 23% perf-profile.children.cycles-pp.filemap_fdatawrite_wbc
62.31 ± 2% -4.2 58.15 ± 2% perf-profile.children.cycles-pp.start_secondary
6.22 ± 4% -4.1 2.15 ± 25% perf-profile.children.cycles-pp.btree_write_cache_pages
5.00 ± 5% -4.0 1.03 ± 41% perf-profile.children.cycles-pp.poll_idle
62.50 ± 2% -3.8 58.73 ± 2% perf-profile.children.cycles-pp.do_idle
62.50 ± 2% -3.8 58.74 ± 2% perf-profile.children.cycles-pp.secondary_startup_64_no_verify
62.50 ± 2% -3.8 58.74 ± 2% perf-profile.children.cycles-pp.cpu_startup_entry
5.65 ± 4% -3.7 1.97 ± 26% perf-profile.children.cycles-pp.submit_one_bio
5.33 ± 5% -3.5 1.83 ± 27% perf-profile.children.cycles-pp.btrfs_submit_metadata_bio
5.14 ± 5% -3.4 1.74 ± 27% perf-profile.children.cycles-pp.btree_csum_one_bio
5.12 ± 5% -3.4 1.73 ± 27% perf-profile.children.cycles-pp.csum_one_extent_buffer
6.04 ± 4% -3.1 2.96 ± 19% perf-profile.children.cycles-pp.perf_tp_event
5.72 ± 4% -3.0 2.72 ± 18% perf-profile.children.cycles-pp.__schedule
5.88 ± 4% -3.0 2.89 ± 19% perf-profile.children.cycles-pp.perf_swevent_overflow
5.86 ± 3% -3.0 2.88 ± 19% perf-profile.children.cycles-pp.__perf_event_overflow
5.84 ± 3% -3.0 2.87 ± 19% perf-profile.children.cycles-pp.perf_event_output_forward
5.05 ± 3% -2.5 2.52 ± 19% perf-profile.children.cycles-pp.perf_prepare_sample
4.79 ± 3% -2.4 2.41 ± 19% perf-profile.children.cycles-pp.perf_callchain
4.78 ± 3% -2.4 2.40 ± 19% perf-profile.children.cycles-pp.get_perf_callchain
3.42 ± 3% -2.2 1.18 ± 32% perf-profile.children.cycles-pp.check_leaf
4.18 ± 3% -2.2 2.02 ± 19% perf-profile.children.cycles-pp.schedule
3.92 ± 3% -1.9 1.97 ± 18% perf-profile.children.cycles-pp.perf_callchain_kernel
3.21 ± 3% -1.7 1.52 ± 24% perf-profile.children.cycles-pp.open64
3.22 ± 3% -1.7 1.57 ± 24% perf-profile.children.cycles-pp.do_sys_open
3.22 ± 3% -1.6 1.57 ± 24% perf-profile.children.cycles-pp.do_sys_openat2
3.17 ± 3% -1.6 1.54 ± 24% perf-profile.children.cycles-pp.do_filp_open
3.16 ± 3% -1.6 1.54 ± 24% perf-profile.children.cycles-pp.path_openat
2.50 ± 9% -1.6 0.93 ± 24% perf-profile.children.cycles-pp.asm_common_interrupt
2.49 ± 9% -1.6 0.92 ± 25% perf-profile.children.cycles-pp.common_interrupt
2.62 ± 12% -1.5 1.08 ± 28% perf-profile.children.cycles-pp.worker_thread
2.42 ± 9% -1.5 0.90 ± 25% perf-profile.children.cycles-pp.__common_interrupt
2.42 ± 9% -1.5 0.90 ± 25% perf-profile.children.cycles-pp.handle_edge_irq
2.40 ± 9% -1.5 0.88 ± 25% perf-profile.children.cycles-pp.handle_irq_event
2.39 ± 9% -1.5 0.88 ± 25% perf-profile.children.cycles-pp.handle_irq_event_percpu
2.36 ± 9% -1.5 0.87 ± 25% perf-profile.children.cycles-pp.__handle_irq_event_percpu
3.01 ± 3% -1.5 1.52 ± 19% perf-profile.children.cycles-pp.unwind_next_frame
2.35 ± 9% -1.5 0.87 ± 25% perf-profile.children.cycles-pp.nvme_irq
2.61 ± 6% -1.4 1.19 ± 24% perf-profile.children.cycles-pp.try_to_wake_up
2.22 ± 9% -1.4 0.82 ± 25% perf-profile.children.cycles-pp.blk_mq_end_request_batch
2.14 ± 10% -1.4 0.79 ± 24% perf-profile.children.cycles-pp.blk_update_request
2.60 ± 8% -1.3 1.27 ± 27% perf-profile.children.cycles-pp.btrfs_insert_empty_items
2.73 ± 11% -1.3 1.40 ± 44% perf-profile.children.cycles-pp.ret_from_fork
2.72 ± 11% -1.3 1.40 ± 44% perf-profile.children.cycles-pp.kthread
2.24 ± 12% -1.3 0.92 ± 30% perf-profile.children.cycles-pp.process_one_work
2.34 ± 4% -1.3 1.05 ± 20% perf-profile.children.cycles-pp.perf_trace_sched_switch
2.37 ± 3% -1.2 1.16 ± 26% perf-profile.children.cycles-pp.btrfs_create
1.96 ± 11% -1.2 0.77 ± 33% perf-profile.children.cycles-pp.btrfs_work_helper
1.86 ± 10% -1.2 0.68 ± 24% perf-profile.children.cycles-pp.btrfs_end_bio
1.72 ± 6% -1.2 0.54 ± 19% perf-profile.children.cycles-pp.read_extent_buffer
1.86 ± 4% -1.1 0.72 ± 23% perf-profile.children.cycles-pp.folio_wait_bit
1.73 ± 2% -1.1 0.62 ± 36% perf-profile.children.cycles-pp.btrfs_get_32
1.67 ± 6% -1.1 0.55 ± 25% perf-profile.children.cycles-pp.__filemap_fdatawait_range
1.67 ± 6% -1.1 0.56 ± 25% perf-profile.children.cycles-pp.filemap_fdatawait_range
1.80 ± 4% -1.1 0.69 ± 22% perf-profile.children.cycles-pp.io_schedule
2.12 ± 4% -1.1 1.03 ± 19% perf-profile.children.cycles-pp.dequeue_task_fair
1.72 ± 9% -1.1 0.65 ± 22% perf-profile.children.cycles-pp.__wake_up_common
2.09 ± 4% -1.1 1.02 ± 19% perf-profile.children.cycles-pp.dequeue_entity
1.39 ± 21% -1.0 0.34 ±113% perf-profile.children.cycles-pp.btrfs_commit_transaction
2.95 ± 4% -1.0 1.92 ± 8% perf-profile.children.cycles-pp.copy_items
1.55 ± 6% -1.0 0.53 ± 25% perf-profile.children.cycles-pp.folio_wait_writeback
1.59 ± 9% -1.0 0.60 ± 22% perf-profile.children.cycles-pp.btrfs_finish_ordered_io
1.58 ± 6% -1.0 0.60 ± 21% perf-profile.children.cycles-pp.start_ordered_ops
1.85 ± 6% -1.0 0.87 ± 24% perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
1.52 ± 6% -1.0 0.56 ± 20% perf-profile.children.cycles-pp.extent_writepages
1.52 ± 6% -1.0 0.56 ± 21% perf-profile.children.cycles-pp.btrfs_fdatawrite_range
1.69 ± 7% -0.9 0.76 ± 25% perf-profile.children.cycles-pp.ksys_write
2.08 ± 4% -0.9 1.16 ± 15% perf-profile.children.cycles-pp.update_curr
1.68 ± 7% -0.9 0.76 ± 26% perf-profile.children.cycles-pp.vfs_write
1.59 ± 6% -0.9 0.68 ± 24% perf-profile.children.cycles-pp.btrfs_wait_ordered_range
1.66 ± 7% -0.9 0.74 ± 26% perf-profile.children.cycles-pp.new_sync_write
1.95 ± 4% -0.9 1.09 ± 15% perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime
1.55 ± 5% -0.9 0.70 ± 17% perf-profile.children.cycles-pp.schedule_idle
1.22 ± 7% -0.9 0.36 ± 18% perf-profile.children.cycles-pp.btrfs_check_node
1.27 ± 11% -0.8 0.43 ± 22% perf-profile.children.cycles-pp.folio_end_writeback
1.18 ± 2% -0.8 0.40 ± 22% perf-profile.children.cycles-pp.copy_extent_buffer_full
1.19 ± 9% -0.8 0.41 ± 18% perf-profile.children.cycles-pp.extent_write_cache_pages
1.18 ± 2% -0.8 0.40 ± 22% perf-profile.children.cycles-pp.copy_page
1.30 ± 7% -0.8 0.54 ± 25% perf-profile.children.cycles-pp.write
1.20 ± 6% -0.7 0.49 ± 25% perf-profile.children.cycles-pp.btrfs_file_write_iter
1.11 ± 10% -0.7 0.40 ± 22% perf-profile.children.cycles-pp.read_block_for_search
1.19 ± 6% -0.7 0.49 ± 25% perf-profile.children.cycles-pp.btrfs_buffered_write
1.09 ± 11% -0.7 0.39 ± 24% perf-profile.children.cycles-pp.folio_wake_bit
1.01 ± 10% -0.7 0.34 ± 22% perf-profile.children.cycles-pp.__extent_writepage
1.04 ± 11% -0.7 0.38 ± 24% perf-profile.children.cycles-pp.wake_page_function
2.15 ± 3% -0.6 1.50 ± 6% perf-profile.children.cycles-pp.btrfs_csum_file_blocks
1.00 ± 6% -0.6 0.36 ± 25% perf-profile.children.cycles-pp.btrfs_add_link
1.15 ± 7% -0.6 0.52 ± 18% perf-profile.children.cycles-pp.__unwind_start
0.96 ± 6% -0.6 0.33 ± 19% perf-profile.children.cycles-pp.find_extent_buffer
0.96 ± 6% -0.6 0.34 ± 24% perf-profile.children.cycles-pp.btrfs_insert_dir_item
1.12 ± 11% -0.6 0.50 ± 22% perf-profile.children.cycles-pp.end_bio_extent_writepage
1.26 ± 2% -0.6 0.68 ± 17% perf-profile.children.cycles-pp.__orc_find
0.79 ± 11% -0.6 0.23 ± 22% perf-profile.children.cycles-pp.writepage_delalloc
0.80 ± 8% -0.5 0.26 ± 26% perf-profile.children.cycles-pp.insert_with_overflow
0.73 ± 7% -0.5 0.20 ± 24% perf-profile.children.cycles-pp.btrfs_reserve_extent
0.66 ± 12% -0.5 0.15 ± 33% perf-profile.children.cycles-pp.end_bio_extent_buffer_writepage
0.69 ± 11% -0.5 0.19 ± 25% perf-profile.children.cycles-pp.btrfs_run_delalloc_range
1.93 ± 2% -0.5 1.43 ± 6% perf-profile.children.cycles-pp.log_csums
0.68 ± 10% -0.5 0.18 ± 25% perf-profile.children.cycles-pp.cow_file_range
0.77 ± 6% -0.5 0.28 ± 20% perf-profile.children.cycles-pp.find_extent_buffer_nolock
0.67 ± 7% -0.5 0.18 ± 24% perf-profile.children.cycles-pp.find_free_extent
1.02 ± 5% -0.5 0.55 ± 18% perf-profile.children.cycles-pp.orc_find
0.56 ± 8% -0.4 0.12 ±119% perf-profile.children.cycles-pp.btrfs_write_and_wait_transaction
0.66 ± 6% -0.4 0.23 ± 37% perf-profile.children.cycles-pp.setup_items_for_insert
0.71 ± 11% -0.4 0.28 ± 20% perf-profile.children.cycles-pp.insert_reserved_file_extent
0.70 ± 8% -0.4 0.28 ± 23% perf-profile.children.cycles-pp.__wake_up_common_lock
0.66 ± 5% -0.4 0.26 ± 21% perf-profile.children.cycles-pp.generic_bin_search
0.67 ± 6% -0.4 0.26 ± 21% perf-profile.children.cycles-pp.btrfs_lookup_match_dir
0.79 ± 3% -0.4 0.39 ± 25% perf-profile.children.cycles-pp.perf_callchain_user
0.62 ± 7% -0.4 0.23 ± 24% perf-profile.children.cycles-pp.btrfs_comp_cpu_keys
0.66 ± 9% -0.4 0.26 ± 23% perf-profile.children.cycles-pp.autoremove_wake_function
0.62 ± 4% -0.4 0.22 ± 20% perf-profile.children.cycles-pp.write_one_eb
0.42 ± 18% -0.4 0.03 ±103% perf-profile.children.cycles-pp.__irqentry_text_start
0.58 ± 5% -0.4 0.19 ± 28% perf-profile.children.cycles-pp.check_setget_bounds
0.75 ± 4% -0.4 0.37 ± 25% perf-profile.children.cycles-pp.__get_user_nocheck_8
1.12 ± 6% -0.4 0.76 ± 20% perf-profile.children.cycles-pp.__btrfs_tree_read_lock
0.66 ± 4% -0.3 0.31 ± 18% perf-profile.children.cycles-pp.btrfs_update_root
0.63 ± 8% -0.3 0.28 ± 21% perf-profile.children.cycles-pp.perf_output_sample
0.89 ± 6% -0.3 0.55 ± 23% perf-profile.children.cycles-pp.btrfs_new_inode
0.78 ± 5% -0.3 0.44 ± 35% perf-profile.children.cycles-pp.btrfs_read_lock_root_node
0.55 ± 6% -0.3 0.21 ± 22% perf-profile.children.cycles-pp.btrfs_lookup_dir_item
0.80 ± 8% -0.3 0.48 ± 21% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.51 ± 6% -0.3 0.20 ± 27% perf-profile.children.cycles-pp.folio_mark_dirty
0.49 ± 6% -0.3 0.18 ± 26% perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
1.40 ± 3% -0.3 1.09 ± 3% perf-profile.children.cycles-pp.btrfs_lookup_csum
0.61 ± 8% -0.3 0.31 ± 16% perf-profile.children.cycles-pp.unwind_get_return_address
0.47 ± 10% -0.3 0.16 ± 23% perf-profile.children.cycles-pp.btrfs_get_64
0.48 ± 7% -0.3 0.18 ± 25% perf-profile.children.cycles-pp.filemap_dirty_folio
0.69 ± 3% -0.3 0.39 ± 18% perf-profile.children.cycles-pp.asm_exc_page_fault
0.42 ± 9% -0.3 0.12 ± 25% perf-profile.children.cycles-pp.down_read
0.47 ± 10% -0.3 0.18 ± 25% perf-profile.children.cycles-pp.crc32c_pcl_intel_update
0.48 ± 5% -0.3 0.19 ± 24% perf-profile.children.cycles-pp.btrfs_mark_buffer_dirty
0.46 ± 12% -0.3 0.18 ± 23% perf-profile.children.cycles-pp.csum_tree_block
0.53 ± 6% -0.3 0.25 ± 20% perf-profile.children.cycles-pp.kmem_cache_alloc
0.45 ± 5% -0.3 0.18 ± 27% perf-profile.children.cycles-pp.btrfs_start_ordered_extent
0.56 ± 8% -0.3 0.29 ± 19% perf-profile.children.cycles-pp.__kernel_text_address
0.44 ± 5% -0.3 0.18 ± 24% perf-profile.children.cycles-pp.set_extent_buffer_dirty
0.46 ± 22% -0.3 0.20 ± 27% perf-profile.children.cycles-pp.pagecache_get_page
0.54 ± 5% -0.3 0.28 ± 26% perf-profile.children.cycles-pp.btrfs_release_path
0.45 ± 23% -0.3 0.19 ± 27% perf-profile.children.cycles-pp.__filemap_get_folio
0.42 ± 21% -0.3 0.16 ± 16% perf-profile.children.cycles-pp.alloc_extent_buffer
0.43 ± 13% -0.3 0.18 ± 22% perf-profile.children.cycles-pp.btrfs_drop_extents
0.44 ± 5% -0.3 0.19 ± 27% perf-profile.children.cycles-pp.queue_work_on
0.44 ± 5% -0.2 0.19 ± 27% perf-profile.children.cycles-pp.__queue_work
0.42 ± 7% -0.2 0.18 ± 21% perf-profile.children.cycles-pp.perf_output_copy
0.42 ± 8% -0.2 0.18 ± 27% perf-profile.children.cycles-pp.end_extent_writepage
0.49 ± 9% -0.2 0.26 ± 18% perf-profile.children.cycles-pp.kernel_text_address
0.42 ± 8% -0.2 0.18 ± 27% perf-profile.children.cycles-pp.btrfs_mark_ordered_io_finished
0.38 ± 11% -0.2 0.15 ± 23% perf-profile.children.cycles-pp.__radix_tree_lookup
0.91 ± 8% -0.2 0.68 ± 20% perf-profile.children.cycles-pp.rwsem_down_read_slowpath
0.41 ± 9% -0.2 0.18 ± 21% perf-profile.children.cycles-pp.memcpy_erms
0.34 ± 13% -0.2 0.11 ± 24% perf-profile.children.cycles-pp.__folio_end_writeback
0.42 ± 10% -0.2 0.19 ± 7% perf-profile.children.cycles-pp.split_leaf
0.32 ± 10% -0.2 0.10 ± 13% perf-profile.children.cycles-pp.btrfs_free_tree_block
0.32 ± 7% -0.2 0.11 ± 37% perf-profile.children.cycles-pp.btrfs_dirty_pages
0.34 ± 6% -0.2 0.14 ± 28% perf-profile.children.cycles-pp.btrfs_lookup
0.50 ± 6% -0.2 0.29 ± 19% perf-profile.children.cycles-pp.write_all_supers
0.34 ± 6% -0.2 0.14 ± 28% perf-profile.children.cycles-pp.btrfs_lookup_dentry
0.37 ± 11% -0.2 0.17 ± 27% perf-profile.children.cycles-pp.copy_page_from_iter_atomic
0.31 ± 7% -0.2 0.12 ± 21% perf-profile.children.cycles-pp.btrfs_check_ref_name_override
0.35 ± 9% -0.2 0.16 ± 29% perf-profile.children.cycles-pp.ttwu_do_activate
0.36 ± 11% -0.2 0.16 ± 28% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.36 ± 11% -0.2 0.16 ± 26% perf-profile.children.cycles-pp.copyin
0.36 ± 11% -0.2 0.18 ± 18% perf-profile.children.cycles-pp.btrfs_map_bio
0.22 ± 13% -0.2 0.04 ±106% perf-profile.children.cycles-pp.check_dir_item
0.41 ± 9% -0.2 0.23 ± 40% perf-profile.children.cycles-pp.__libc_write
0.30 ± 17% -0.2 0.12 ± 29% perf-profile.children.cycles-pp.btrfs_lookup_file_extent
0.22 ± 7% -0.2 0.04 ±100% perf-profile.children.cycles-pp.btrfs_lookup_csums_range
0.41 ± 9% -0.2 0.23 ± 40% perf-profile.children.cycles-pp.generic_file_write_iter
0.41 ± 9% -0.2 0.23 ± 40% perf-profile.children.cycles-pp.__generic_file_write_iter
0.41 ± 9% -0.2 0.23 ± 40% perf-profile.children.cycles-pp.generic_perform_write
0.33 ± 9% -0.2 0.16 ± 30% perf-profile.children.cycles-pp.enqueue_task_fair
0.32 ± 10% -0.2 0.15 ± 17% perf-profile.children.cycles-pp.pick_next_task_fair
0.31 ± 11% -0.2 0.14 ± 24% perf-profile.children.cycles-pp.btrfs_submit_data_bio
0.29 ± 7% -0.2 0.12 ± 32% perf-profile.children.cycles-pp.prepare_pages
0.28 ± 10% -0.2 0.10 ± 23% perf-profile.children.cycles-pp.__folio_mark_dirty
0.38 ± 12% -0.2 0.21 ± 20% perf-profile.children.cycles-pp.btrfs_next_old_leaf
0.25 ± 5% -0.2 0.08 ± 23% perf-profile.children.cycles-pp.__folio_start_writeback
0.26 ± 12% -0.2 0.09 ± 30% perf-profile.children.cycles-pp.check_extent_data_item
0.30 ± 6% -0.2 0.14 ± 31% perf-profile.children.cycles-pp.btrfs_update_inode
0.22 ± 21% -0.2 0.06 ± 16% perf-profile.children.cycles-pp.memmove
0.32 ± 18% -0.2 0.16 ± 18% perf-profile.children.cycles-pp.__module_address
0.25 ± 7% -0.2 0.10 ± 15% perf-profile.children.cycles-pp.pin_down_extent
0.22 ± 16% -0.2 0.07 ± 12% perf-profile.children.cycles-pp.__reserve_bytes
0.22 ± 8% -0.2 0.07 ± 58% perf-profile.children.cycles-pp.btrfs_set_token_32
0.30 ± 7% -0.1 0.16 ± 24% perf-profile.children.cycles-pp.btrfs_search_forward
0.26 ± 6% -0.1 0.12 ± 32% perf-profile.children.cycles-pp.btrfs_delayed_update_inode
0.22 ± 18% -0.1 0.08 ± 14% perf-profile.children.cycles-pp.btrfs_reserve_metadata_bytes
0.29 ± 11% -0.1 0.14 ± 25% perf-profile.children.cycles-pp.submit_bio_noacct
0.20 ± 12% -0.1 0.06 ± 26% perf-profile.children.cycles-pp.push_leaf_right
0.20 ± 31% -0.1 0.06 ± 49% perf-profile.children.cycles-pp.filemap_add_folio
0.26 ± 11% -0.1 0.12 ± 28% perf-profile.children.cycles-pp.enqueue_entity
0.18 ± 23% -0.1 0.04 ± 71% perf-profile.children.cycles-pp.mark_extent_buffer_accessed
0.23 ± 13% -0.1 0.09 ± 26% perf-profile.children.cycles-pp.btrfs_end_super_write
0.28 ± 10% -0.1 0.14 ± 25% perf-profile.children.cycles-pp.blk_mq_submit_bio
0.19 ± 12% -0.1 0.05 ± 51% perf-profile.children.cycles-pp.memcpy_extent_buffer
0.17 ± 12% -0.1 0.04 ±101% perf-profile.children.cycles-pp.btrfs_get_token_32
0.19 ± 30% -0.1 0.05 ± 49% perf-profile.children.cycles-pp.__filemap_add_folio
0.19 ± 14% -0.1 0.06 ± 51% perf-profile.children.cycles-pp.btrfs_root_node
0.29 ± 13% -0.1 0.16 ± 33% perf-profile.children.cycles-pp.finish_task_switch
0.24 ± 14% -0.1 0.11 ± 22% perf-profile.children.cycles-pp.btrfs_write_check
0.22 ± 5% -0.1 0.10 ± 15% perf-profile.children.cycles-pp.stack_access_ok
0.21 ± 7% -0.1 0.09 ± 24% perf-profile.children.cycles-pp.start_transaction
0.17 ± 2% -0.1 0.05 ± 73% perf-profile.children.cycles-pp.folio_clear_dirty_for_io
0.16 ± 27% -0.1 0.04 ±101% perf-profile.children.cycles-pp.btrfs_lookup_inode
0.16 ± 20% -0.1 0.03 ±103% perf-profile.children.cycles-pp.block_group_cache_tree_search
0.20 ± 16% -0.1 0.08 ± 21% perf-profile.children.cycles-pp.xas_load
0.30 ± 12% -0.1 0.17 ± 22% perf-profile.children.cycles-pp.find_next_csum_offset
0.22 ± 12% -0.1 0.10 ± 21% perf-profile.children.cycles-pp.dentry_needs_remove_privs
0.22 ± 14% -0.1 0.10 ± 21% perf-profile.children.cycles-pp.file_remove_privs
0.19 ± 10% -0.1 0.07 ± 28% perf-profile.children.cycles-pp.btrfs_copy_from_user
0.24 ± 9% -0.1 0.12 ± 33% perf-profile.children.cycles-pp.__poll
0.24 ± 9% -0.1 0.12 ± 33% perf-profile.children.cycles-pp.__x64_sys_poll
0.24 ± 9% -0.1 0.12 ± 33% perf-profile.children.cycles-pp.do_sys_poll
0.20 ± 11% -0.1 0.09 ± 32% perf-profile.children.cycles-pp.free_extent_buffer
0.21 ± 13% -0.1 0.09 ± 21% perf-profile.children.cycles-pp.cap_inode_need_killpriv
0.14 ± 11% -0.1 0.03 ±100% perf-profile.children.cycles-pp.find_get_pages_range_tag
0.24 ± 20% -0.1 0.13 ± 18% perf-profile.children.cycles-pp.is_module_text_address
0.21 ± 13% -0.1 0.10 ± 22% perf-profile.children.cycles-pp.security_inode_need_killpriv
0.15 ± 19% -0.1 0.03 ± 70% perf-profile.children.cycles-pp.__push_leaf_right
0.18 ± 5% -0.1 0.07 ± 46% perf-profile.children.cycles-pp.down_write
0.14 ± 17% -0.1 0.03 ±100% perf-profile.children.cycles-pp.read_tree_block
0.20 ± 13% -0.1 0.09 ± 20% perf-profile.children.cycles-pp.__vfs_getxattr
0.20 ± 10% -0.1 0.09 ± 14% perf-profile.children.cycles-pp.submit_extent_page
0.15 ± 12% -0.1 0.04 ± 72% perf-profile.children.cycles-pp.pagevec_lookup_range_tag
0.16 ± 12% -0.1 0.04 ± 75% perf-profile.children.cycles-pp.nvme_queue_rq
0.14 ± 19% -0.1 0.03 ±100% perf-profile.children.cycles-pp.btrfs_read_node_slot
0.22 ± 21% -0.1 0.11 ± 15% perf-profile.children.cycles-pp.__module_text_address
0.16 ± 13% -0.1 0.05 ± 74% perf-profile.children.cycles-pp.blk_mq_flush_plug_list
0.16 ± 13% -0.1 0.05 ± 74% perf-profile.children.cycles-pp.blk_flush_plug
0.16 ± 12% -0.1 0.06 ± 51% perf-profile.children.cycles-pp.__blk_mq_try_issue_directly
0.23 ± 8% -0.1 0.12 ± 44% perf-profile.children.cycles-pp.btrfs_free_path
0.17 ± 17% -0.1 0.07 ± 53% perf-profile.children.cycles-pp.__mod_lruvec_page_state
0.23 ± 9% -0.1 0.13 ± 27% perf-profile.children.cycles-pp.update_load_avg
0.20 ± 13% -0.1 0.10 ± 26% perf-profile.children.cycles-pp.__extent_writepage_io
0.21 ± 7% -0.1 0.10 ± 19% perf-profile.children.cycles-pp.mkdir
0.15 ± 13% -0.1 0.05 ± 75% perf-profile.children.cycles-pp.blk_mq_request_issue_directly
0.13 ± 7% -0.1 0.03 ±100% perf-profile.children.cycles-pp.inode_tree_add
0.17 ± 4% -0.1 0.07 ± 17% perf-profile.children.cycles-pp.__might_resched
0.18 ± 13% -0.1 0.08 ± 21% perf-profile.children.cycles-pp.btrfs_getxattr
0.14 ± 9% -0.1 0.04 ± 71% perf-profile.children.cycles-pp.btrfs_csum_one_bio
0.14 ± 15% -0.1 0.04 ± 72% perf-profile.children.cycles-pp.alloc_extent_state
0.16 ± 10% -0.1 0.07 ± 25% perf-profile.children.cycles-pp.blk_finish_plug
0.12 ± 10% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__crc32c_pcl_intel_finup
0.12 ± 27% -0.1 0.03 ±100% perf-profile.children.cycles-pp.btrfs_insert_delayed_dir_index
0.15 ± 13% -0.1 0.06 ± 46% perf-profile.children.cycles-pp.__perf_event_header__init_id
0.19 ± 6% -0.1 0.10 ± 19% perf-profile.children.cycles-pp.__x64_sys_mkdir
0.13 ± 17% -0.1 0.04 ± 75% perf-profile.children.cycles-pp.find_free_extent_clustered
0.16 ± 3% -0.1 0.08 ± 17% perf-profile.children.cycles-pp.insert_state
0.12 ± 9% -0.1 0.03 ±103% perf-profile.children.cycles-pp.btrfs_get_or_create_delayed_node
0.18 ± 14% -0.1 0.09 ± 11% perf-profile.children.cycles-pp.__close
0.11 ± 31% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__raw_callee_save___native_queued_spin_unlock
0.12 ± 8% -0.1 0.03 ±105% perf-profile.children.cycles-pp.btrfs_leaf_free_space
0.19 ± 8% -0.1 0.10 ± 21% perf-profile.children.cycles-pp.mutex_lock
0.18 ± 7% -0.1 0.10 ± 19% perf-profile.children.cycles-pp.release_extent_buffer
0.15 ± 13% -0.1 0.07 ± 20% perf-profile.children.cycles-pp.___slab_alloc
0.14 ± 17% -0.1 0.06 ± 16% perf-profile.children.cycles-pp.select_task_rq_fair
0.15 ± 14% -0.1 0.07 ± 23% perf-profile.children.cycles-pp.__slab_alloc
0.15 ± 14% -0.1 0.07 ± 18% perf-profile.children.cycles-pp.btrfs_lookup_xattr
0.11 ± 5% -0.1 0.03 ±100% perf-profile.children.cycles-pp.___perf_sw_event
0.14 ± 4% -0.1 0.06 ± 25% perf-profile.children.cycles-pp.set_next_entity
0.13 ± 7% -0.1 0.05 ± 47% perf-profile.children.cycles-pp.memzero_extent_buffer
0.11 ± 15% -0.1 0.03 ±102% perf-profile.children.cycles-pp.get_page_from_freelist
0.16 ± 8% -0.1 0.08 ± 17% perf-profile.children.cycles-pp.do_mkdirat
0.16 ± 10% -0.1 0.09 ± 8% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
0.12 ± 23% -0.1 0.04 ± 72% perf-profile.children.cycles-pp.btrfs_alloc_from_cluster
0.19 ± 7% -0.1 0.11 ± 30% perf-profile.children.cycles-pp.__etree_search
0.12 ± 12% -0.1 0.04 ±101% perf-profile.children.cycles-pp.new_inode
0.13 ± 18% -0.1 0.06 ± 18% perf-profile.children.cycles-pp.asm_sysvec_call_function_single
0.14 ± 10% -0.1 0.07 ± 26% perf-profile.children.cycles-pp.kmem_cache_free
0.14 ± 19% -0.1 0.06 ± 23% perf-profile.children.cycles-pp.__alloc_pages
0.15 ± 10% -0.1 0.08 ± 12% perf-profile.children.cycles-pp.filename_create
0.10 ± 11% -0.1 0.03 ±100% perf-profile.children.cycles-pp.dput
0.26 ± 9% -0.1 0.19 ± 11% perf-profile.children.cycles-pp.exc_page_fault
0.10 ± 7% -0.1 0.02 ± 99% perf-profile.children.cycles-pp.mutex_unlock
0.10 ± 8% -0.1 0.03 ±100% perf-profile.children.cycles-pp.allocate_slab
0.11 ± 15% -0.1 0.04 ± 73% perf-profile.children.cycles-pp.kernelmode_fixup_or_oops
0.15 ± 9% -0.1 0.08 ± 39% perf-profile.children.cycles-pp.perf_poll
0.10 ± 10% -0.1 0.03 ±100% perf-profile.children.cycles-pp.btrfs_alloc_reserved_file_extent
0.15 ± 11% -0.1 0.08 ± 8% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.10 ± 8% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__cond_resched
0.12 ± 11% -0.1 0.05 ± 45% perf-profile.children.cycles-pp.__vsprintf_chk
0.20 ± 13% -0.1 0.13 ± 16% perf-profile.children.cycles-pp.unlock_up
0.14 ± 14% -0.1 0.07 ± 21% perf-profile.children.cycles-pp.write_dev_supers
0.12 ± 9% -0.1 0.05 ± 47% perf-profile.children.cycles-pp.filename_parentat
0.10 ± 10% -0.1 0.03 ±100% perf-profile.children.cycles-pp.btrfs_add_delayed_data_ref
0.10 ± 12% -0.1 0.03 ±100% perf-profile.children.cycles-pp.shmem_getpage_gfp
0.10 ± 12% -0.1 0.03 ±100% perf-profile.children.cycles-pp.shmem_write_begin
0.11 ± 15% -0.1 0.05 ± 76% perf-profile.children.cycles-pp.new_inode_pseudo
0.11 ± 9% -0.1 0.05 ± 47% perf-profile.children.cycles-pp.path_parentat
0.10 ± 17% -0.1 0.04 ± 71% perf-profile.children.cycles-pp.sysvec_call_function_single
0.09 ± 13% -0.1 0.03 ±100% perf-profile.children.cycles-pp.clear_state_bit
0.23 ± 5% -0.1 0.17 ± 14% perf-profile.children.cycles-pp.btrfs_log_all_xattrs
0.10 ± 13% -0.1 0.05 ± 75% perf-profile.children.cycles-pp.alloc_inode
0.08 ± 17% -0.1 0.02 ± 99% perf-profile.children.cycles-pp.vfprintf
0.09 ± 15% -0.1 0.04 ± 75% perf-profile.children.cycles-pp.up_write
0.12 ± 14% -0.1 0.06 ± 7% perf-profile.children.cycles-pp.task_work_run
0.10 ± 11% -0.0 0.06 ± 13% perf-profile.children.cycles-pp.__fput
0.08 ± 13% -0.0 0.04 ± 71% perf-profile.children.cycles-pp.do_open
0.11 ± 22% -0.0 0.07 ± 11% perf-profile.children.cycles-pp.push_leaf_left
0.14 ± 10% -0.0 0.11 ± 10% perf-profile.children.cycles-pp.link_path_walk
0.18 ± 9% +0.1 0.24 ± 9% perf-profile.children.cycles-pp.task_tick_fair
0.95 ± 14% +0.3 1.24 ± 12% perf-profile.children.cycles-pp.scheduler_tick
0.62 ± 6% +0.4 1.02 ± 16% perf-profile.children.cycles-pp.rwsem_spin_on_owner
6.31 ± 4% +1.1 7.38 ± 3% perf-profile.children.cycles-pp.btrfs_write_marked_extents
6.84 ± 3% +1.3 8.16 ± 5% perf-profile.children.cycles-pp.btrfs_log_inode
0.95 ± 11% +1.4 2.30 ± 18% perf-profile.children.cycles-pp.btrfs_alloc_tree_block
0.50 ± 6% +1.6 2.11 ± 20% perf-profile.children.cycles-pp.set_extent_bit
0.21 ± 9% +2.1 2.28 ± 10% perf-profile.children.cycles-pp.__clear_extent_bit
0.16 ± 5% +2.1 2.26 ± 11% perf-profile.children.cycles-pp.clear_extent_bit
3.14 ± 3% +2.2 5.30 ± 9% perf-profile.children.cycles-pp.btrfs_cow_block
3.12 ± 3% +2.2 5.29 ± 9% perf-profile.children.cycles-pp.__btrfs_cow_block
0.00 +2.3 2.32 ± 10% perf-profile.children.cycles-pp.delete_tree_block
3.43 ± 3% +2.5 5.93 ± 13% perf-profile.children.cycles-pp.mutex_spin_on_owner
2.89 ± 3% +2.8 5.72 ± 7% perf-profile.children.cycles-pp.btrfs_truncate_inode_items
2.89 ± 3% +2.8 5.72 ± 7% perf-profile.children.cycles-pp.truncate_inode_items
2.35 ± 4% +3.3 5.64 ± 17% perf-profile.children.cycles-pp.osq_lock
1.58 ± 6% +3.3 4.90 ± 11% perf-profile.children.cycles-pp._raw_spin_lock
0.30 ± 16% +3.9 4.20 ± 15% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.68 ± 6% +4.6 5.31 ± 14% perf-profile.children.cycles-pp.btrfs_wait_tree_log_extents
0.68 ± 6% +4.6 5.31 ± 14% perf-profile.children.cycles-pp.__btrfs_wait_marked_extents
12.75 ± 3% +5.5 18.25 ± 9% perf-profile.children.cycles-pp.btrfs_sync_log
32.39 ± 3% +5.6 38.03 ± 5% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
32.38 ± 3% +5.6 38.02 ± 5% perf-profile.children.cycles-pp.do_syscall_64
5.70 ± 3% +5.7 11.38 ± 15% perf-profile.children.cycles-pp.__mutex_lock
8.80 ± 3% +6.2 15.01 ± 8% perf-profile.children.cycles-pp.btrfs_log_dentry_safe
8.79 ± 3% +6.2 15.00 ± 8% perf-profile.children.cycles-pp.btrfs_log_inode_parent
0.12 ± 32% +8.2 8.32 ± 16% perf-profile.children.cycles-pp.rb_next
26.42 ± 3% +8.4 34.83 ± 7% perf-profile.children.cycles-pp.fsync
26.30 ± 3% +8.5 34.76 ± 7% perf-profile.children.cycles-pp.btrfs_sync_file
26.30 ± 3% +8.5 34.77 ± 7% perf-profile.children.cycles-pp.__x64_sys_fsync
26.30 ± 3% +8.5 34.77 ± 7% perf-profile.children.cycles-pp.do_fsync
0.09 ± 10% +10.3 10.39 ± 14% perf-profile.children.cycles-pp.find_first_extent_bit
0.02 ±142% +10.4 10.38 ± 14% perf-profile.children.cycles-pp.find_first_extent_bit_state
4.06 ± 5% -3.3 0.78 ± 41% perf-profile.self.cycles-pp.poll_idle
1.64 ± 5% -1.1 0.52 ± 22% perf-profile.self.cycles-pp.read_extent_buffer
1.32 ± 2% -0.9 0.45 ± 32% perf-profile.self.cycles-pp.btrfs_get_32
1.15 ± 3% -0.8 0.39 ± 22% perf-profile.self.cycles-pp.copy_page
1.36 ± 4% -0.6 0.71 ± 18% perf-profile.self.cycles-pp._raw_spin_lock
1.26 ± 2% -0.6 0.68 ± 17% perf-profile.self.cycles-pp.__orc_find
1.00 ± 9% -0.5 0.47 ± 23% perf-profile.self.cycles-pp.unwind_next_frame
0.63 ± 5% -0.4 0.22 ± 25% perf-profile.self.cycles-pp.check_leaf
0.58 ± 8% -0.4 0.21 ± 23% perf-profile.self.cycles-pp.btrfs_comp_cpu_keys
0.52 ± 4% -0.3 0.17 ± 28% perf-profile.self.cycles-pp.check_setget_bounds
0.40 ± 9% -0.3 0.14 ± 19% perf-profile.self.cycles-pp.find_extent_buffer_nolock
0.68 ± 9% -0.3 0.43 ± 23% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.35 ± 10% -0.2 0.10 ± 27% perf-profile.self.cycles-pp.down_read
0.42 ± 6% -0.2 0.20 ± 27% perf-profile.self.cycles-pp.__get_user_nocheck_8
0.40 ± 9% -0.2 0.17 ± 24% perf-profile.self.cycles-pp.memcpy_erms
0.37 ± 11% -0.2 0.15 ± 23% perf-profile.self.cycles-pp.__radix_tree_lookup
0.34 ± 6% -0.2 0.13 ± 26% perf-profile.self.cycles-pp.btrfs_get_64
0.35 ± 11% -0.2 0.16 ± 28% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.29 ± 8% -0.2 0.12 ± 22% perf-profile.self.cycles-pp.generic_bin_search
0.28 ± 8% -0.2 0.11 ± 18% perf-profile.self.cycles-pp.__schedule
0.35 ± 9% -0.2 0.19 ± 16% perf-profile.self.cycles-pp.orc_find
0.31 ± 19% -0.2 0.16 ± 17% perf-profile.self.cycles-pp.__module_address
0.21 ± 11% -0.2 0.06 ± 18% perf-profile.self.cycles-pp.memmove
0.25 ± 8% -0.1 0.11 ± 29% perf-profile.self.cycles-pp.btrfs_search_slot
0.16 ± 6% -0.1 0.04 ±101% perf-profile.self.cycles-pp.__btrfs_cow_block
0.16 ± 15% -0.1 0.04 ± 77% perf-profile.self.cycles-pp.btrfs_set_token_32
0.21 ± 4% -0.1 0.09 ± 16% perf-profile.self.cycles-pp.stack_access_ok
0.18 ± 7% -0.1 0.06 ± 52% perf-profile.self.cycles-pp.btrfs_root_node
0.14 ± 9% -0.1 0.03 ±101% perf-profile.self.cycles-pp.btrfs_get_token_32
0.21 ± 5% -0.1 0.11 ± 20% perf-profile.self.cycles-pp.kmem_cache_alloc
0.20 ± 8% -0.1 0.10 ± 23% perf-profile.self.cycles-pp.perf_callchain_kernel
0.17 ± 5% -0.1 0.07 ± 18% perf-profile.self.cycles-pp.__might_resched
0.16 ± 17% -0.1 0.07 ± 21% perf-profile.self.cycles-pp.xas_load
0.14 ± 8% -0.1 0.06 ± 46% perf-profile.self.cycles-pp.down_write
0.14 ± 5% -0.1 0.05 ± 45% perf-profile.self.cycles-pp.perf_output_copy
0.12 ± 6% -0.1 0.04 ±101% perf-profile.self.cycles-pp.kmem_cache_free
0.12 ± 8% -0.1 0.04 ± 72% perf-profile.self.cycles-pp.memzero_extent_buffer
0.10 ± 7% -0.1 0.03 ±100% perf-profile.self.cycles-pp.___perf_sw_event
0.10 ± 7% -0.1 0.02 ± 99% perf-profile.self.cycles-pp.inode_tree_add
0.10 ± 13% -0.1 0.03 ±100% perf-profile.self.cycles-pp.kernel_text_address
0.17 ± 8% -0.1 0.10 ± 27% perf-profile.self.cycles-pp.__etree_search
0.14 ± 6% -0.1 0.08 ± 24% perf-profile.self.cycles-pp.mutex_lock
0.09 ± 15% -0.1 0.03 ±103% perf-profile.self.cycles-pp.up_write
0.08 ± 13% -0.1 0.03 ±100% perf-profile.self.cycles-pp.free_extent_buffer
0.07 ± 15% -0.0 0.04 ± 72% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.06 ± 32% +0.0 0.11 ± 39% perf-profile.self.cycles-pp.sysvec_apic_timer_interrupt
0.14 ± 18% +0.1 0.20 ± 15% perf-profile.self.cycles-pp.irqtime_account_irq
0.58 ± 7% +0.4 0.99 ± 16% perf-profile.self.cycles-pp.rwsem_spin_on_owner
0.00 +2.1 2.09 ± 12% perf-profile.self.cycles-pp.find_first_extent_bit_state
3.38 ± 3% +2.5 5.86 ± 13% perf-profile.self.cycles-pp.mutex_spin_on_owner
2.31 ± 4% +3.3 5.59 ± 17% perf-profile.self.cycles-pp.osq_lock
0.30 ± 15% +3.8 4.08 ± 15% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
0.11 ± 32% +7.9 8.04 ± 16% perf-profile.self.cycles-pp.rb_next
***************************************************************************************************
lkp-csl-2ap4: 192 threads 4 sockets Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
=========================================================================================
compiler/cpufreq_governor/disk/filesize/fs/iterations/kconfig/nr_directories/nr_files_per_directory/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode:
gcc-9/performance/1SSD/9B/btrfs/8/x86_64-rhel-8.3/16d/256fpd/4/debian-10.4-x86_64-20200603.cgz/fsyncBeforeClose/lkp-csl-2ap4/16G/fsmark/0x5003006
commit:
dd503c2d5d ("btrfs: remove write and wait of struct walk_control")
1a61b300c0 ("btrfs: fix log tree cleanup after a transaction abort")
dd503c2d5db4f864 1a61b300c09b1d034534372349e
---------------- ---------------------------
%stddev %change %stddev
\ | \
2244545 +22.9% 2758277 fsmark.app_overhead
13249 ± 2% -79.6% 2697 fsmark.files_per_sec
336.80 ± 2% +368.8% 1578 fsmark.time.elapsed_time
336.80 ± 2% +368.8% 1578 fsmark.time.elapsed_time.max
2.97e+08 ± 2% +3.5% 3.073e+08 fsmark.time.file_system_outputs
1518 ± 14% +276.6% 5717 ± 2% fsmark.time.involuntary_context_switches
150.83 +58.9% 239.67 fsmark.time.percent_of_cpu_this_job_got
495.22 ± 4% +661.6% 3771 fsmark.time.system_time
10447820 -10.8% 9322318 fsmark.time.voluntary_context_switches
6.28e+10 ± 2% +365.7% 2.924e+11 cpuidle..time
1.269e+08 ± 20% +302.3% 5.104e+08 ± 20% cpuidle..usage
57547330 ± 22% +335.0% 2.504e+08 ± 25% turbostat.IRQ
84.94 ± 2% -100.0% 0.00 turbostat.PkgWatt
386.64 ± 2% +321.7% 1630 uptime.boot
71228 ± 2% +324.3% 302205 uptime.idle
0.15 ± 4% -0.1 0.02 ± 3% mpstat.cpu.all.iowait%
0.82 ± 5% +0.5 1.27 mpstat.cpu.all.sys%
0.04 -0.0 0.02 ± 4% mpstat.cpu.all.usr%
106253 ± 69% +1076.7% 1250289 ± 52% numa-numastat.node1.local_node
190300 ± 39% +602.7% 1337292 ± 49% numa-numastat.node1.numa_hit
216240 ± 82% +747.8% 1833203 ±136% numa-numastat.node3.local_node
294059 ± 53% +547.5% 1903933 ±129% numa-numastat.node3.numa_hit
411999 -77.6% 92286 vmstat.io.bo
26486798 -28.0% 19073084 vmstat.memory.cache
1.00 +100.0% 2.00 vmstat.procs.r
67089 ± 2% -78.0% 14778 vmstat.system.cs
9672 ± 7% -15.3% 8190 ± 13% numa-meminfo.node0.KernelStack
7037 ± 5% -11.6% 6221 ± 7% numa-meminfo.node1.KernelStack
2525 ±152% -98.5% 38.17 ± 15% numa-meminfo.node2.Mapped
8280 ± 32% +9252.2% 774412 ±219% numa-meminfo.node3.Active
7168 ± 8% +106.4% 14799 ± 35% numa-meminfo.node3.Active(anon)
18538 ± 46% +2914.9% 558907 ±209% numa-meminfo.node3.KReclaimable
18538 ± 46% +2914.9% 558907 ±209% numa-meminfo.node3.SReclaimable
9679 ± 8% -15.4% 8187 ± 13% numa-vmstat.node0.nr_kernel_stack
7039 ± 5% -11.6% 6222 ± 7% numa-vmstat.node1.nr_kernel_stack
1796 ± 8% +106.0% 3700 ± 35% numa-vmstat.node3.nr_active_anon
4640 ± 46% +2912.0% 139768 ±209% numa-vmstat.node3.nr_slab_reclaimable
1796 ± 8% +106.0% 3700 ± 35% numa-vmstat.node3.nr_zone_active_anon
534483 ± 15% +223.9% 1731211 ±107% numa-vmstat.node3.numa_hit
430615 ± 22% +280.3% 1637437 ±116% numa-vmstat.node3.numa_local
11415411 ± 2% -60.8% 4476212 ± 3% meminfo.Active
12176 ± 3% +123.3% 27193 ± 2% meminfo.Active(anon)
11403234 ± 2% -61.0% 4449019 ± 3% meminfo.Active(file)
23361738 -32.3% 15805338 meminfo.Cached
272329 -14.2% 233545 meminfo.Dirty
30627 -11.2% 27204 meminfo.KernelStack
29731200 -26.5% 21846541 meminfo.Memused
37689 ± 2% +26.7% 47741 meminfo.Shmem
30540485 -27.9% 22026958 meminfo.max_used_kB
3038 ± 3% +123.7% 6797 ± 2% proc-vmstat.nr_active_anon
2850306 ± 2% -61.0% 1112326 ± 3% proc-vmstat.nr_active_file
79182 -3.2% 76623 proc-vmstat.nr_anon_pages
37250006 ± 2% +3.7% 38642606 proc-vmstat.nr_dirtied
68085 -14.2% 58414 proc-vmstat.nr_dirty
5839686 -32.3% 3951870 proc-vmstat.nr_file_pages
41996583 +4.7% 43966332 proc-vmstat.nr_free_pages
85461 -4.5% 81650 proc-vmstat.nr_inactive_anon
2338534 -6.5% 2186147 proc-vmstat.nr_inactive_file
30634 -11.2% 27203 proc-vmstat.nr_kernel_stack
10032 -7.9% 9243 proc-vmstat.nr_mapped
1062 -6.9% 989.17 proc-vmstat.nr_page_table_pages
9335 +27.8% 11928 proc-vmstat.nr_shmem
800757 +2.3% 819391 proc-vmstat.nr_slab_reclaimable
369020 -4.6% 352061 proc-vmstat.nr_slab_unreclaimable
37248723 ± 2% +3.7% 38639214 proc-vmstat.nr_written
3038 ± 3% +123.7% 6797 ± 2% proc-vmstat.nr_zone_active_anon
2850306 ± 2% -61.0% 1112326 ± 3% proc-vmstat.nr_zone_active_file
85461 -4.5% 81650 proc-vmstat.nr_zone_inactive_anon
2338534 -6.5% 2186147 proc-vmstat.nr_zone_inactive_file
68163 -14.2% 58457 proc-vmstat.nr_zone_write_pending
10406307 +5.5% 10978428 proc-vmstat.numa_hit
10147588 +5.6% 10719407 proc-vmstat.numa_local
318544 ± 7% +25.8% 400574 ± 4% proc-vmstat.numa_pte_updates
2820943 ± 4% -61.3% 1091827 ± 8% proc-vmstat.pgactivate
10418164 +6.0% 11038540 proc-vmstat.pgalloc_normal
1576108 +290.3% 6151439 proc-vmstat.pgfault
1.402e+08 ± 2% +4.1% 1.46e+08 proc-vmstat.pgpgout
86238 +305.7% 349864 proc-vmstat.pgreuse
18.60 ± 50% +137.4% 44.17 ± 31% perf-stat.i.MPKI
1.227e+09 ± 2% -13.9% 1.056e+09 ± 3% perf-stat.i.branch-instructions
12.58 ± 46% -9.6 2.96 ± 7% perf-stat.i.cache-miss-rate%
10514212 ± 10% -58.0% 4416388 ± 36% perf-stat.i.cache-misses
67622 ± 2% -78.1% 14779 perf-stat.i.context-switches
1.97 ± 13% +66.7% 3.28 ± 12% perf-stat.i.cpi
202.44 -4.1% 194.22 perf-stat.i.cpu-migrations
1259 ± 6% +227.7% 4126 ± 35% perf-stat.i.cycles-between-cache-misses
1.66e+09 ± 2% -30.5% 1.153e+09 ± 3% perf-stat.i.dTLB-loads
8.328e+08 ± 2% -54.2% 3.818e+08 ± 5% perf-stat.i.dTLB-stores
2445823 ± 6% -38.7% 1499909 ± 9% perf-stat.i.iTLB-load-misses
6.241e+09 ± 2% -30.4% 4.344e+09 ± 4% perf-stat.i.instructions
0.52 ± 13% -38.9% 0.32 ± 12% perf-stat.i.ipc
1.16 ± 2% -76.8% 0.27 ± 13% perf-stat.i.major-faults
19.38 ± 2% -27.4% 14.07 perf-stat.i.metric.M/sec
4223 -11.2% 3751 perf-stat.i.minor-faults
34.13 ± 25% +18.0 52.09 ± 9% perf-stat.i.node-load-miss-rate%
1032812 ± 50% -61.0% 403177 ± 20% perf-stat.i.node-load-misses
1813182 ± 7% -75.5% 443843 ± 7% perf-stat.i.node-loads
379204 ± 57% -63.8% 137132 ± 13% perf-stat.i.node-store-misses
842872 ± 14% -72.9% 228776 ± 8% perf-stat.i.node-stores
4224 -11.2% 3751 perf-stat.i.page-faults
18.27 ± 49% +133.0% 42.55 ± 31% perf-stat.overall.MPKI
11.65 ± 43% -9.3 2.36 ± 8% perf-stat.overall.cache-miss-rate%
1.94 ± 13% +65.0% 3.20 ± 12% perf-stat.overall.cpi
1149 ± 7% +203.0% 3483 ± 28% perf-stat.overall.cycles-between-cache-misses
0.53 ± 13% -39.5% 0.32 ± 12% perf-stat.overall.ipc
1.224e+09 ± 2% -13.7% 1.056e+09 ± 3% perf-stat.ps.branch-instructions
10484718 ± 10% -57.9% 4413301 ± 36% perf-stat.ps.cache-misses
67413 ± 2% -78.1% 14762 perf-stat.ps.context-switches
201.83 -3.8% 194.11 perf-stat.ps.cpu-migrations
1.655e+09 ± 2% -30.4% 1.152e+09 ± 3% perf-stat.ps.dTLB-loads
8.303e+08 ± 2% -54.1% 3.815e+08 ± 5% perf-stat.ps.dTLB-stores
2438383 ± 6% -38.5% 1498800 ± 9% perf-stat.ps.iTLB-load-misses
6.222e+09 ± 2% -30.2% 4.341e+09 ± 4% perf-stat.ps.instructions
1.16 ± 2% -76.7% 0.27 ± 13% perf-stat.ps.major-faults
4207 -10.9% 3748 perf-stat.ps.minor-faults
1029887 ± 50% -60.9% 402840 ± 20% perf-stat.ps.node-load-misses
1808344 ± 7% -75.5% 443539 ± 7% perf-stat.ps.node-loads
378187 ± 57% -63.8% 137029 ± 13% perf-stat.ps.node-store-misses
840484 ± 14% -72.8% 228574 ± 8% perf-stat.ps.node-stores
4208 -10.9% 3748 perf-stat.ps.page-faults
2.104e+12 ± 4% +226.3% 6.866e+12 ± 4% perf-stat.total.instructions
64.88 ± 4% -11.1 53.82 ± 4% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
64.38 ± 4% -10.8 53.60 ± 4% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
64.38 ± 4% -10.8 53.60 ± 4% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
64.34 ± 4% -10.8 53.57 ± 4% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
58.96 ± 5% -9.0 49.92 ± 5% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
58.20 ± 5% -8.9 49.28 ± 5% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
5.66 ± 10% -4.9 0.72 ± 10% perf-profile.calltrace.cycles-pp.btree_write_cache_pages.do_writepages.filemap_fdatawrite_wbc.filemap_fdatawrite_range.btrfs_write_marked_extents
39.59 ± 9% -4.7 34.85 ± 8% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
5.39 ± 9% -4.7 0.72 ± 9% perf-profile.calltrace.cycles-pp.filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.do_fsync
5.39 ± 9% -4.7 0.72 ± 9% perf-profile.calltrace.cycles-pp.filemap_fdatawrite_wbc.filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file
5.37 ± 9% -4.7 0.72 ± 9% perf-profile.calltrace.cycles-pp.do_writepages.filemap_fdatawrite_wbc.filemap_fdatawrite_range.btrfs_write_marked_extents.btrfs_sync_log
4.40 ± 9% -4.1 0.29 ±100% perf-profile.calltrace.cycles-pp.btrfs_submit_metadata_bio.submit_one_bio.btree_write_cache_pages.do_writepages.filemap_fdatawrite_wbc
4.40 ± 9% -4.0 0.37 ± 71% perf-profile.calltrace.cycles-pp.submit_one_bio.btree_write_cache_pages.do_writepages.filemap_fdatawrite_wbc.filemap_fdatawrite_range
4.61 ± 11% -3.9 0.66 ± 12% perf-profile.calltrace.cycles-pp.open64
4.59 ± 11% -3.9 0.66 ± 11% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.open64
4.59 ± 10% -3.9 0.66 ± 11% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
4.58 ± 10% -3.9 0.66 ± 11% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
4.57 ± 10% -3.9 0.66 ± 11% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe.open64
4.50 ± 10% -3.9 0.65 ± 11% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.49 ± 10% -3.8 0.65 ± 11% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
3.40 ± 10% -3.1 0.26 ±100% perf-profile.calltrace.cycles-pp.btrfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
1.38 ± 19% -1.1 0.26 ±100% perf-profile.calltrace.cycles-pp.record__finish_output.cmd_record.cmd_sched.run_builtin.main
1.38 ± 19% -1.1 0.26 ±100% perf-profile.calltrace.cycles-pp.perf_session__process_events.record__finish_output.cmd_record.cmd_sched.run_builtin
1.49 ± 17% -0.9 0.62 ± 3% perf-profile.calltrace.cycles-pp.cmd_record.cmd_sched.run_builtin.main.__libc_start_main
1.49 ± 17% -0.9 0.62 ± 3% perf-profile.calltrace.cycles-pp.cmd_sched.run_builtin.main.__libc_start_main
1.53 ± 19% -0.9 0.67 ± 5% perf-profile.calltrace.cycles-pp.__libc_start_main
1.53 ± 19% -0.9 0.67 ± 5% perf-profile.calltrace.cycles-pp.main.__libc_start_main
1.53 ± 19% -0.9 0.67 ± 5% perf-profile.calltrace.cycles-pp.run_builtin.main.__libc_start_main
0.79 ± 19% +1.3 2.10 ± 30% perf-profile.calltrace.cycles-pp.btrfs_alloc_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items
3.29 ± 7% +1.6 4.86 ± 19% perf-profile.calltrace.cycles-pp.mutex_spin_on_owner.__mutex_lock.wait_log_commit.btrfs_sync_log.btrfs_sync_file
0.00 +2.0 1.97 ± 30% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.set_extent_bit.btrfs_alloc_tree_block.__btrfs_cow_block
0.00 +2.0 1.98 ± 30% perf-profile.calltrace.cycles-pp._raw_spin_lock.set_extent_bit.btrfs_alloc_tree_block.__btrfs_cow_block.btrfs_cow_block
0.00 +2.0 2.00 ± 30% perf-profile.calltrace.cycles-pp.set_extent_bit.btrfs_alloc_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot
5.49 ± 9% +3.0 8.47 ± 7% perf-profile.calltrace.cycles-pp.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.do_fsync.__x64_sys_fsync
5.48 ± 9% +3.0 8.51 ± 6% perf-profile.calltrace.cycles-pp.wait_log_commit.btrfs_sync_log.btrfs_sync_file.do_fsync.__x64_sys_fsync
0.00 +3.1 3.14 ± 36% perf-profile.calltrace.cycles-pp.mutex_spin_on_owner.__mutex_lock.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
4.22 ± 8% +4.1 8.35 ± 6% perf-profile.calltrace.cycles-pp.__mutex_lock.wait_log_commit.btrfs_sync_log.btrfs_sync_file.do_fsync
5.13 ± 13% +4.5 9.62 ± 20% perf-profile.calltrace.cycles-pp.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync
0.00 +4.6 4.58 ± 20% perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
2.58 ± 12% +4.6 7.20 ± 5% perf-profile.calltrace.cycles-pp.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items.truncate_inode_items.btrfs_log_inode
2.57 ± 12% +4.6 7.20 ± 5% perf-profile.calltrace.cycles-pp.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items.truncate_inode_items
0.00 +4.8 4.82 ± 15% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__clear_extent_bit.clear_extent_bit.delete_tree_block
0.00 +4.8 4.82 ± 15% perf-profile.calltrace.cycles-pp._raw_spin_lock.__clear_extent_bit.clear_extent_bit.delete_tree_block.__btrfs_cow_block
0.00 +4.8 4.84 ± 15% perf-profile.calltrace.cycles-pp.__clear_extent_bit.clear_extent_bit.delete_tree_block.__btrfs_cow_block.btrfs_cow_block
0.00 +4.8 4.84 ± 15% perf-profile.calltrace.cycles-pp.clear_extent_bit.delete_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot
0.00 +4.9 4.88 ± 14% perf-profile.calltrace.cycles-pp.delete_tree_block.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items
0.00 +6.0 5.97 ± 7% perf-profile.calltrace.cycles-pp.rb_next.find_first_extent_bit_state.find_first_extent_bit.btrfs_write_marked_extents.btrfs_sync_log
3.28 ± 13% +6.0 9.32 ± 20% perf-profile.calltrace.cycles-pp.truncate_inode_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
3.28 ± 13% +6.0 9.32 ± 20% perf-profile.calltrace.cycles-pp.btrfs_truncate_inode_items.truncate_inode_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe
0.00 +6.1 6.08 ± 6% perf-profile.calltrace.cycles-pp.rb_next.find_first_extent_bit_state.find_first_extent_bit.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents
3.22 ± 13% +6.1 9.32 ± 20% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_truncate_inode_items.truncate_inode_items.btrfs_log_inode.btrfs_log_inode_parent
0.88 ± 6% +7.1 7.97 ± 6% perf-profile.calltrace.cycles-pp.btrfs_wait_tree_log_extents.btrfs_sync_log.btrfs_sync_file.do_fsync.__x64_sys_fsync
0.86 ± 6% +7.1 7.97 ± 6% perf-profile.calltrace.cycles-pp.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents.btrfs_sync_log.btrfs_sync_file.do_fsync
0.50 ± 45% +7.2 7.73 ± 6% perf-profile.calltrace.cycles-pp.__mutex_lock.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync
0.00 +7.7 7.71 ± 7% perf-profile.calltrace.cycles-pp.find_first_extent_bit_state.find_first_extent_bit.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file
0.00 +7.7 7.73 ± 7% perf-profile.calltrace.cycles-pp.find_first_extent_bit.btrfs_write_marked_extents.btrfs_sync_log.btrfs_sync_file.do_fsync
0.00 +7.9 7.89 ± 6% perf-profile.calltrace.cycles-pp.find_first_extent_bit_state.find_first_extent_bit.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents.btrfs_sync_log
0.00 +7.9 7.91 ± 6% perf-profile.calltrace.cycles-pp.find_first_extent_bit.__btrfs_wait_marked_extents.btrfs_wait_tree_log_extents.btrfs_sync_log.btrfs_sync_file
14.56 ± 8% +10.9 25.48 ± 6% perf-profile.calltrace.cycles-pp.btrfs_sync_log.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
5.85 ± 12% +11.5 17.36 ± 10% perf-profile.calltrace.cycles-pp.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
5.84 ± 13% +11.5 17.36 ± 10% perf-profile.calltrace.cycles-pp.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync.__x64_sys_fsync
23.60 ± 9% +19.6 43.17 ± 5% perf-profile.calltrace.cycles-pp.fsync
23.49 ± 9% +19.7 43.15 ± 5% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.fsync
23.48 ± 9% +19.7 43.15 ± 5% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.fsync
23.46 ± 9% +19.7 43.14 ± 5% perf-profile.calltrace.cycles-pp.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe.fsync
23.46 ± 9% +19.7 43.14 ± 5% perf-profile.calltrace.cycles-pp.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe.fsync
23.45 ± 9% +19.7 43.14 ± 5% perf-profile.calltrace.cycles-pp.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe
64.88 ± 4% -11.1 53.82 ± 4% perf-profile.children.cycles-pp.secondary_startup_64_no_verify
64.88 ± 4% -11.1 53.82 ± 4% perf-profile.children.cycles-pp.cpu_startup_entry
64.87 ± 4% -11.1 53.82 ± 4% perf-profile.children.cycles-pp.do_idle
64.38 ± 4% -10.8 53.60 ± 4% perf-profile.children.cycles-pp.start_secondary
59.43 ± 5% -9.3 50.13 ± 5% perf-profile.children.cycles-pp.cpuidle_enter
59.40 ± 5% -9.3 50.11 ± 5% perf-profile.children.cycles-pp.cpuidle_enter_state
7.94 ± 9% -7.0 0.99 ± 9% perf-profile.children.cycles-pp.filemap_fdatawrite_range
7.94 ± 9% -7.0 0.99 ± 9% perf-profile.children.cycles-pp.do_writepages
7.92 ± 9% -6.9 0.98 ± 9% perf-profile.children.cycles-pp.filemap_fdatawrite_wbc
5.66 ± 10% -4.9 0.72 ± 10% perf-profile.children.cycles-pp.btree_write_cache_pages
4.61 ± 11% -3.9 0.66 ± 12% perf-profile.children.cycles-pp.open64
4.65 ± 10% -3.9 0.73 ± 10% perf-profile.children.cycles-pp.do_sys_open
4.64 ± 10% -3.9 0.73 ± 10% perf-profile.children.cycles-pp.do_sys_openat2
4.41 ± 9% -3.9 0.53 ± 10% perf-profile.children.cycles-pp.submit_one_bio
4.40 ± 9% -3.9 0.53 ± 11% perf-profile.children.cycles-pp.btrfs_submit_metadata_bio
4.57 ± 10% -3.9 0.72 ± 10% perf-profile.children.cycles-pp.do_filp_open
4.57 ± 10% -3.9 0.72 ± 10% perf-profile.children.cycles-pp.path_openat
4.12 ± 9% -3.6 0.47 ± 11% perf-profile.children.cycles-pp.btree_csum_one_bio
4.10 ± 9% -3.6 0.47 ± 12% perf-profile.children.cycles-pp.csum_one_extent_buffer
3.33 ± 45% -3.1 0.20 ± 34% perf-profile.children.cycles-pp.poll_idle
3.76 ± 7% -3.1 0.68 ± 10% perf-profile.children.cycles-pp.__schedule
3.90 ± 8% -3.0 0.87 ± 12% perf-profile.children.cycles-pp.perf_tp_event
3.80 ± 8% -3.0 0.85 ± 11% perf-profile.children.cycles-pp.perf_swevent_overflow
3.80 ± 8% -3.0 0.85 ± 11% perf-profile.children.cycles-pp.__perf_event_overflow
3.78 ± 8% -2.9 0.84 ± 11% perf-profile.children.cycles-pp.perf_event_output_forward
3.40 ± 10% -2.9 0.46 ± 15% perf-profile.children.cycles-pp.btrfs_create
3.30 ± 9% -2.5 0.76 ± 12% perf-profile.children.cycles-pp.perf_prepare_sample
3.13 ± 9% -2.4 0.71 ± 12% perf-profile.children.cycles-pp.perf_callchain
3.12 ± 9% -2.4 0.71 ± 11% perf-profile.children.cycles-pp.get_perf_callchain
2.83 ± 8% -2.3 0.48 ± 10% perf-profile.children.cycles-pp.schedule
2.38 ± 9% -2.0 0.34 ± 18% perf-profile.children.cycles-pp.btrfs_insert_empty_items
2.27 ± 12% -2.0 0.27 ± 12% perf-profile.children.cycles-pp.start_ordered_ops
2.26 ± 11% -2.0 0.26 ± 12% perf-profile.children.cycles-pp.btrfs_fdatawrite_range
2.25 ± 11% -2.0 0.26 ± 11% perf-profile.children.cycles-pp.extent_writepages
2.22 ± 11% -2.0 0.26 ± 11% perf-profile.children.cycles-pp.extent_write_cache_pages
2.44 ± 9% -1.9 0.58 ± 11% perf-profile.children.cycles-pp.perf_callchain_kernel
2.02 ± 12% -1.8 0.22 ± 12% perf-profile.children.cycles-pp.__extent_writepage
2.00 ± 12% -1.8 0.22 ± 12% perf-profile.children.cycles-pp.writepage_delalloc
1.95 ± 7% -1.7 0.24 ± 11% perf-profile.children.cycles-pp.read_extent_buffer
1.92 ± 12% -1.7 0.21 ± 14% perf-profile.children.cycles-pp.btrfs_run_delalloc_range
1.90 ± 12% -1.7 0.20 ± 16% perf-profile.children.cycles-pp.cow_file_range
1.89 ± 10% -1.7 0.23 ± 10% perf-profile.children.cycles-pp.btrfs_check_node
2.01 ± 10% -1.6 0.37 ± 15% perf-profile.children.cycles-pp.ksys_write
1.99 ± 10% -1.6 0.36 ± 14% perf-profile.children.cycles-pp.vfs_write
1.95 ± 9% -1.6 0.36 ± 13% perf-profile.children.cycles-pp.new_sync_write
1.67 ± 18% -1.5 0.16 ± 16% perf-profile.children.cycles-pp.check_leaf
1.78 ± 10% -1.5 0.29 ± 18% perf-profile.children.cycles-pp.write
1.59 ± 13% -1.4 0.16 ± 15% perf-profile.children.cycles-pp.cow_file_range_inline
1.86 ± 9% -1.4 0.44 ± 7% perf-profile.children.cycles-pp.unwind_next_frame
1.62 ± 11% -1.4 0.24 ± 14% perf-profile.children.cycles-pp.btrfs_file_write_iter
1.61 ± 11% -1.4 0.24 ± 14% perf-profile.children.cycles-pp.btrfs_buffered_write
1.51 ± 9% -1.3 0.17 ± 19% perf-profile.children.cycles-pp.btrfs_add_link
1.45 ± 9% -1.3 0.16 ± 18% perf-profile.children.cycles-pp.btrfs_insert_dir_item
1.54 ± 8% -1.3 0.26 ± 12% perf-profile.children.cycles-pp.try_to_wake_up
1.48 ± 7% -1.3 0.22 ± 11% perf-profile.children.cycles-pp.perf_trace_sched_switch
1.49 ± 11% -1.2 0.25 ± 12% perf-profile.children.cycles-pp.dequeue_task_fair
1.41 ± 11% -1.2 0.17 ± 14% perf-profile.children.cycles-pp.copy_extent_buffer_full
1.41 ± 11% -1.2 0.18 ± 12% perf-profile.children.cycles-pp.copy_page
1.46 ± 11% -1.2 0.25 ± 12% perf-profile.children.cycles-pp.dequeue_entity
1.36 ± 11% -1.2 0.18 ± 20% perf-profile.children.cycles-pp.asm_common_interrupt
1.34 ± 11% -1.2 0.18 ± 20% perf-profile.children.cycles-pp.common_interrupt
1.29 ± 11% -1.1 0.17 ± 17% perf-profile.children.cycles-pp.__common_interrupt
1.28 ± 12% -1.1 0.17 ± 18% perf-profile.children.cycles-pp.handle_edge_irq
1.25 ± 14% -1.1 0.14 ± 17% perf-profile.children.cycles-pp.read_block_for_search
1.26 ± 11% -1.1 0.16 ± 16% perf-profile.children.cycles-pp.handle_irq_event
1.26 ± 11% -1.1 0.16 ± 18% perf-profile.children.cycles-pp.handle_irq_event_percpu
1.24 ± 11% -1.1 0.16 ± 16% perf-profile.children.cycles-pp.__handle_irq_event_percpu
1.24 ± 12% -1.1 0.16 ± 17% perf-profile.children.cycles-pp.nvme_irq
1.17 ± 8% -1.0 0.13 ± 23% perf-profile.children.cycles-pp.insert_with_overflow
1.16 ± 8% -1.0 0.16 ± 15% perf-profile.children.cycles-pp.__wake_up_common
1.18 ± 9% -1.0 0.18 ± 25% perf-profile.children.cycles-pp.btrfs_new_inode
1.12 ± 7% -1.0 0.13 ± 8% perf-profile.children.cycles-pp.folio_wait_bit
1.12 ± 11% -1.0 0.14 ± 19% perf-profile.children.cycles-pp.blk_mq_end_request_batch
1.50 ± 10% -1.0 0.53 ± 15% perf-profile.children.cycles-pp.update_curr
1.09 ± 11% -1.0 0.12 ± 19% perf-profile.children.cycles-pp.find_extent_buffer
1.07 ± 7% -1.0 0.12 ± 11% perf-profile.children.cycles-pp.io_schedule
1.07 ± 12% -0.9 0.12 ± 18% perf-profile.children.cycles-pp.blk_update_request
1.41 ± 11% -0.9 0.50 ± 16% perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime
1.08 ± 8% -0.9 0.17 ± 13% perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
1.00 ± 13% -0.9 0.10 ± 13% perf-profile.children.cycles-pp.btrfs_drop_extents
1.38 ± 19% -0.9 0.50 ± 4% perf-profile.children.cycles-pp.record__finish_output
1.38 ± 19% -0.9 0.50 ± 4% perf-profile.children.cycles-pp.perf_session__process_events
1.49 ± 17% -0.9 0.62 ± 3% perf-profile.children.cycles-pp.cmd_record
1.49 ± 17% -0.9 0.62 ± 3% perf-profile.children.cycles-pp.cmd_sched
1.53 ± 19% -0.9 0.67 ± 5% perf-profile.children.cycles-pp.__libc_start_main
1.53 ± 19% -0.9 0.67 ± 5% perf-profile.children.cycles-pp.main
1.53 ± 19% -0.9 0.67 ± 5% perf-profile.children.cycles-pp.run_builtin
1.15 ± 10% -0.8 0.32 ± 16% perf-profile.children.cycles-pp.kthread
0.96 ± 14% -0.8 0.13 ± 19% perf-profile.children.cycles-pp.btrfs_lookup_match_dir
1.15 ± 10% -0.8 0.32 ± 16% perf-profile.children.cycles-pp.ret_from_fork
1.00 ± 7% -0.8 0.17 ± 15% perf-profile.children.cycles-pp.btrfs_update_root
0.98 ± 11% -0.8 0.18 ± 21% perf-profile.children.cycles-pp.worker_thread
0.94 ± 11% -0.8 0.18 ± 21% perf-profile.children.cycles-pp.process_one_work
0.85 ± 11% -0.7 0.10 ± 20% perf-profile.children.cycles-pp.find_extent_buffer_nolock
0.94 ± 8% -0.7 0.19 ± 8% perf-profile.children.cycles-pp.schedule_idle
0.83 ± 17% -0.7 0.09 ± 24% perf-profile.children.cycles-pp.btrfs_get_32
0.85 ± 11% -0.7 0.13 ± 22% perf-profile.children.cycles-pp.write_one_eb
1.19 ± 17% -0.7 0.47 ± 3% perf-profile.children.cycles-pp.process_simple
0.74 ± 13% -0.7 0.04 ± 71% perf-profile.children.cycles-pp.btrfs_end_bio
0.72 ± 12% -0.7 0.06 ± 50% perf-profile.children.cycles-pp.btrfs_work_helper
0.70 ± 13% -0.7 0.04 ± 72% perf-profile.children.cycles-pp.folio_end_writeback
0.77 ± 15% -0.7 0.10 ± 18% perf-profile.children.cycles-pp.btrfs_lookup_dir_item
0.72 ± 12% -0.7 0.06 ± 50% perf-profile.children.cycles-pp.btrfs_async_run_delayed_root
0.70 ± 12% -0.7 0.04 ± 72% perf-profile.children.cycles-pp.end_bio_extent_buffer_writepage
0.72 ± 11% -0.6 0.10 ± 20% perf-profile.children.cycles-pp.generic_bin_search
0.69 ± 9% -0.6 0.09 ± 30% perf-profile.children.cycles-pp.setup_items_for_insert
0.79 ± 9% -0.6 0.20 ± 10% perf-profile.children.cycles-pp.__orc_find
0.62 ± 16% -0.6 0.04 ± 72% perf-profile.children.cycles-pp.btrfs_lookup_file_extent
0.67 ± 14% -0.6 0.09 ± 16% perf-profile.children.cycles-pp.prepare_pages
0.75 ± 10% -0.6 0.18 ± 13% perf-profile.children.cycles-pp.write_all_supers
0.64 ± 10% -0.6 0.09 ± 12% perf-profile.children.cycles-pp.folio_mark_dirty
0.69 ± 12% -0.5 0.16 ± 21% perf-profile.children.cycles-pp.__btrfs_tree_read_lock
0.62 ± 10% -0.5 0.08 ± 13% perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
0.66 ± 12% -0.5 0.13 ± 21% perf-profile.children.cycles-pp.kmem_cache_alloc
0.63 ± 10% -0.5 0.10 ± 22% perf-profile.children.cycles-pp.__wake_up_common_lock
0.78 ± 20% -0.5 0.26 ± 9% perf-profile.children.cycles-pp.__ordered_events__flush
0.77 ± 20% -0.5 0.25 ± 9% perf-profile.children.cycles-pp.perf_session__process_user_event
0.58 ± 9% -0.5 0.07 ± 15% perf-profile.children.cycles-pp.folio_wake_bit
0.67 ± 10% -0.5 0.16 ± 9% perf-profile.children.cycles-pp.__unwind_start
0.60 ± 9% -0.5 0.08 ± 13% perf-profile.children.cycles-pp.filemap_dirty_folio
0.60 ± 10% -0.5 0.10 ± 24% perf-profile.children.cycles-pp.split_leaf
0.58 ± 10% -0.5 0.09 ± 23% perf-profile.children.cycles-pp.autoremove_wake_function
0.56 ± 9% -0.5 0.07 ± 14% perf-profile.children.cycles-pp.wake_page_function
0.62 ± 9% -0.5 0.12 ± 20% perf-profile.children.cycles-pp.perf_callchain_user
0.56 ± 11% -0.5 0.08 ± 21% perf-profile.children.cycles-pp.btrfs_comp_cpu_keys
0.76 ± 20% -0.5 0.28 ± 8% perf-profile.children.cycles-pp.perf_session__deliver_event
0.55 ± 8% -0.5 0.07 ± 14% perf-profile.children.cycles-pp.btrfs_release_path
0.53 ± 17% -0.5 0.05 ± 48% perf-profile.children.cycles-pp.btrfs_get_64
0.64 ± 12% -0.5 0.16 ± 7% perf-profile.children.cycles-pp.orc_find
0.82 ± 11% -0.5 0.34 ± 10% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.55 ± 10% -0.5 0.08 ± 17% perf-profile.children.cycles-pp.btrfs_mark_buffer_dirty
0.58 ± 9% -0.5 0.12 ± 17% perf-profile.children.cycles-pp.__get_user_nocheck_8
0.52 ± 28% -0.4 0.08 ± 22% perf-profile.children.cycles-pp.alloc_extent_buffer
0.51 ± 11% -0.4 0.07 ± 14% perf-profile.children.cycles-pp.crc32c_pcl_intel_update
0.50 ± 9% -0.4 0.07 ± 21% perf-profile.children.cycles-pp.set_extent_buffer_dirty
0.50 ± 9% -0.4 0.07 ± 14% perf-profile.children.cycles-pp.csum_tree_block
0.46 ± 11% -0.4 0.05 ± 46% perf-profile.children.cycles-pp.__radix_tree_lookup
0.57 ± 11% -0.4 0.16 ± 19% perf-profile.children.cycles-pp.btrfs_read_lock_root_node
0.48 ± 17% -0.4 0.07 ± 16% perf-profile.children.cycles-pp.btrfs_lookup
0.48 ± 17% -0.4 0.07 ± 16% perf-profile.children.cycles-pp.btrfs_lookup_dentry
0.55 ± 16% -0.4 0.15 ± 21% perf-profile.children.cycles-pp.copy_items
0.44 ± 15% -0.4 0.05 ± 46% perf-profile.children.cycles-pp.prepare_uptodate_page
0.43 ± 16% -0.4 0.05 ± 47% perf-profile.children.cycles-pp.btrfs_readpage
0.50 ± 12% -0.4 0.12 ± 27% perf-profile.children.cycles-pp.rwsem_down_read_slowpath
0.44 ± 33% -0.4 0.06 ± 51% perf-profile.children.cycles-pp.pagecache_get_page
0.40 ± 16% -0.4 0.03 ±100% perf-profile.children.cycles-pp.check_setget_bounds
0.43 ± 34% -0.4 0.06 ± 51% perf-profile.children.cycles-pp.__filemap_get_folio
0.41 ± 14% -0.4 0.04 ± 73% perf-profile.children.cycles-pp.btrfs_update_inode
0.41 ± 13% -0.4 0.05 ± 47% perf-profile.children.cycles-pp.btrfs_check_ref_name_override
0.55 ± 7% -0.3 0.20 ± 12% perf-profile.children.cycles-pp.asm_exc_page_fault
0.35 ± 13% -0.3 0.03 ±101% perf-profile.children.cycles-pp.btrfs_delayed_update_inode
0.38 ± 9% -0.3 0.06 ± 7% perf-profile.children.cycles-pp.perf_output_sample
0.37 ± 15% -0.3 0.05 ± 47% perf-profile.children.cycles-pp.btrfs_write_check
0.41 ± 12% -0.3 0.09 ± 22% perf-profile.children.cycles-pp.unwind_get_return_address
0.34 ± 10% -0.3 0.03 ±100% perf-profile.children.cycles-pp.btrfs_dirty_pages
0.36 ± 15% -0.3 0.05 ± 51% perf-profile.children.cycles-pp.btrfs_reserve_extent
0.34 ± 16% -0.3 0.04 ± 73% perf-profile.children.cycles-pp.file_remove_privs
0.35 ± 10% -0.3 0.06 ± 52% perf-profile.children.cycles-pp.btrfs_free_tree_block
0.33 ± 16% -0.3 0.04 ± 73% perf-profile.children.cycles-pp.dentry_needs_remove_privs
0.33 ± 11% -0.3 0.04 ± 71% perf-profile.children.cycles-pp.__folio_mark_dirty
0.38 ± 13% -0.3 0.08 ± 20% perf-profile.children.cycles-pp.__kernel_text_address
0.31 ± 15% -0.3 0.04 ± 73% perf-profile.children.cycles-pp.find_free_extent
0.33 ± 11% -0.3 0.07 ± 21% perf-profile.children.cycles-pp.kernel_text_address
0.31 ± 11% -0.2 0.07 ± 47% perf-profile.children.cycles-pp.rwsem_wake
0.29 ± 5% -0.2 0.05 ± 45% perf-profile.children.cycles-pp.mkdir
0.28 ± 17% -0.2 0.05 ± 74% perf-profile.children.cycles-pp.btrfs_map_bio
0.31 ± 6% -0.2 0.08 ± 24% perf-profile.children.cycles-pp.wake_up_q
0.26 ± 7% -0.2 0.04 ± 71% perf-profile.children.cycles-pp.__x64_sys_mkdir
0.24 ± 13% -0.2 0.02 ± 99% perf-profile.children.cycles-pp.perf_output_copy
0.28 ± 14% -0.2 0.06 ± 14% perf-profile.children.cycles-pp.btrfs_end_super_write
0.25 ± 13% -0.2 0.04 ± 71% perf-profile.children.cycles-pp.memcpy_erms
0.25 ± 14% -0.2 0.04 ± 72% perf-profile.children.cycles-pp.mutex_lock
0.26 ± 18% -0.2 0.06 ± 49% perf-profile.children.cycles-pp.submit_bio_noacct
0.23 ± 13% -0.2 0.03 ±100% perf-profile.children.cycles-pp.down_read
0.26 ± 16% -0.2 0.06 ± 47% perf-profile.children.cycles-pp.blk_mq_submit_bio
0.27 ± 8% -0.2 0.08 ± 20% perf-profile.children.cycles-pp.__close
0.22 ± 21% -0.2 0.03 ± 70% perf-profile.children.cycles-pp.__might_resched
0.24 ± 8% -0.2 0.05 ± 46% perf-profile.children.cycles-pp.pick_next_task_fair
0.21 ± 6% -0.2 0.02 ± 99% perf-profile.children.cycles-pp.do_mkdirat
0.27 ± 10% -0.2 0.08 ± 13% perf-profile.children.cycles-pp.__libc_write
0.26 ± 10% -0.2 0.08 ± 17% perf-profile.children.cycles-pp.generic_file_write_iter
0.26 ± 10% -0.2 0.08 ± 17% perf-profile.children.cycles-pp.__generic_file_write_iter
0.26 ± 10% -0.2 0.08 ± 17% perf-profile.children.cycles-pp.generic_perform_write
0.26 ± 8% -0.2 0.08 ± 20% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
0.21 ± 13% -0.2 0.04 ± 73% perf-profile.children.cycles-pp.enqueue_task_fair
0.21 ± 19% -0.2 0.04 ± 72% perf-profile.children.cycles-pp.write_dev_supers
0.26 ± 12% -0.2 0.08 ± 19% perf-profile.children.cycles-pp.unlock_up
0.24 ± 5% -0.2 0.07 ± 18% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.20 ± 3% -0.1 0.06 ± 46% perf-profile.children.cycles-pp.task_work_run
0.19 ± 12% -0.1 0.05 ± 71% perf-profile.children.cycles-pp.__etree_search
0.22 ± 70% -0.1 0.08 ± 24% perf-profile.children.cycles-pp._find_next_bit
0.22 ± 5% -0.1 0.08 ± 5% perf-profile.children.cycles-pp.link_path_walk
0.35 ± 9% -0.1 0.22 ± 7% perf-profile.children.cycles-pp.machines__deliver_event
0.16 ± 17% -0.1 0.03 ±100% perf-profile.children.cycles-pp.push_leaf_left
0.17 ± 4% -0.1 0.04 ± 71% perf-profile.children.cycles-pp.__fput
0.27 ± 18% -0.1 0.16 ± 13% perf-profile.children.cycles-pp.ordered_events__queue
0.15 ± 7% -0.1 0.05 ± 47% perf-profile.children.cycles-pp.update_load_avg
0.13 ± 22% -0.1 0.03 ±100% perf-profile.children.cycles-pp.do_sys_poll
0.13 ± 22% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__x64_sys_poll
0.13 ± 22% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__poll
0.24 ± 10% -0.1 0.13 ± 12% perf-profile.children.cycles-pp.exc_page_fault
0.25 ± 18% -0.1 0.15 ± 13% perf-profile.children.cycles-pp.queue_event
0.14 ± 33% -0.1 0.04 ± 73% perf-profile.children.cycles-pp.finish_task_switch
0.21 ± 7% -0.1 0.12 ± 8% perf-profile.children.cycles-pp.build_id__mark_dso_hit
0.14 ± 15% -0.1 0.07 ± 14% perf-profile.children.cycles-pp.newidle_balance
0.14 ± 6% -0.1 0.08 ± 10% perf-profile.children.cycles-pp.walk_component
0.11 ± 9% -0.0 0.07 ± 17% perf-profile.children.cycles-pp.idle_cpu
0.14 ± 8% -0.0 0.11 ± 5% perf-profile.children.cycles-pp.thread__find_map
0.07 ± 11% -0.0 0.04 ± 45% perf-profile.children.cycles-pp.user_path_at_empty
0.11 ± 9% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.handle_mm_fault
0.10 ± 11% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.__handle_mm_fault
0.17 ± 15% +0.2 0.33 ± 18% perf-profile.children.cycles-pp.task_tick_fair
1.13 ± 18% +1.1 2.20 ± 29% perf-profile.children.cycles-pp.btrfs_alloc_tree_block
0.75 ± 12% +1.4 2.13 ± 30% perf-profile.children.cycles-pp.set_extent_bit
0.18 ± 27% +1.7 1.90 ±102% perf-profile.children.cycles-pp.rwsem_spin_on_owner
5.79 ± 10% +2.7 8.47 ± 7% perf-profile.children.cycles-pp.btrfs_write_marked_extents
5.48 ± 9% +3.0 8.51 ± 6% perf-profile.children.cycles-pp.wait_log_commit
3.61 ± 11% +3.8 7.38 ± 5% perf-profile.children.cycles-pp.btrfs_cow_block
3.60 ± 11% +3.8 7.38 ± 5% perf-profile.children.cycles-pp.__btrfs_cow_block
3.61 ± 6% +4.4 8.01 ± 5% perf-profile.children.cycles-pp.mutex_spin_on_owner
5.14 ± 13% +4.5 9.62 ± 20% perf-profile.children.cycles-pp.btrfs_log_inode
0.26 ± 16% +4.6 4.88 ± 14% perf-profile.children.cycles-pp.__clear_extent_bit
0.07 ± 29% +4.8 4.85 ± 15% perf-profile.children.cycles-pp.clear_extent_bit
0.00 +4.9 4.91 ± 14% perf-profile.children.cycles-pp.delete_tree_block
1.83 ± 9% +5.5 7.34 ± 5% perf-profile.children.cycles-pp._raw_spin_lock
3.28 ± 13% +6.0 9.32 ± 20% perf-profile.children.cycles-pp.truncate_inode_items
3.28 ± 13% +6.0 9.32 ± 20% perf-profile.children.cycles-pp.btrfs_truncate_inode_items
0.34 ± 15% +6.6 6.92 ± 6% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
1.33 ± 17% +6.8 8.08 ± 7% perf-profile.children.cycles-pp.osq_lock
0.88 ± 6% +7.1 7.97 ± 6% perf-profile.children.cycles-pp.btrfs_wait_tree_log_extents
0.86 ± 6% +7.1 7.97 ± 6% perf-profile.children.cycles-pp.__btrfs_wait_marked_extents
14.57 ± 8% +10.9 25.48 ± 6% perf-profile.children.cycles-pp.btrfs_sync_log
4.93 ± 8% +11.2 16.09 ± 6% perf-profile.children.cycles-pp.__mutex_lock
5.85 ± 12% +11.5 17.36 ± 10% perf-profile.children.cycles-pp.btrfs_log_dentry_safe
5.84 ± 13% +11.5 17.36 ± 10% perf-profile.children.cycles-pp.btrfs_log_inode_parent
0.18 ± 31% +12.2 12.40 ± 6% perf-profile.children.cycles-pp.rb_next
31.52 ± 9% +13.5 45.01 ± 5% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
31.50 ± 9% +13.5 45.01 ± 5% perf-profile.children.cycles-pp.do_syscall_64
0.11 ± 34% +15.5 15.64 ± 6% perf-profile.children.cycles-pp.find_first_extent_bit
0.02 ±149% +15.6 15.64 ± 6% perf-profile.children.cycles-pp.find_first_extent_bit_state
23.60 ± 9% +19.6 43.17 ± 5% perf-profile.children.cycles-pp.fsync
23.46 ± 9% +19.7 43.14 ± 5% perf-profile.children.cycles-pp.__x64_sys_fsync
23.46 ± 9% +19.7 43.14 ± 5% perf-profile.children.cycles-pp.do_fsync
23.45 ± 9% +19.7 43.14 ± 5% perf-profile.children.cycles-pp.btrfs_sync_file
2.92 ± 48% -2.7 0.17 ± 32% perf-profile.self.cycles-pp.poll_idle
1.90 ± 8% -1.7 0.23 ± 10% perf-profile.self.cycles-pp.read_extent_buffer
1.38 ± 10% -1.2 0.18 ± 12% perf-profile.self.cycles-pp.copy_page
1.61 ± 9% -1.2 0.44 ± 10% perf-profile.self.cycles-pp._raw_spin_lock
0.79 ± 9% -0.6 0.20 ± 10% perf-profile.self.cycles-pp.__orc_find
0.65 ± 17% -0.6 0.07 ± 48% perf-profile.self.cycles-pp.btrfs_get_32
0.62 ± 12% -0.5 0.14 ± 15% perf-profile.self.cycles-pp.unwind_next_frame
0.52 ± 11% -0.5 0.06 ± 48% perf-profile.self.cycles-pp.btrfs_comp_cpu_keys
0.45 ± 14% -0.4 0.05 ± 46% perf-profile.self.cycles-pp.__radix_tree_lookup
0.42 ± 16% -0.4 0.04 ± 45% perf-profile.self.cycles-pp.find_extent_buffer_nolock
0.66 ± 9% -0.4 0.30 ± 10% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.33 ± 13% -0.3 0.02 ± 99% perf-profile.self.cycles-pp.check_setget_bounds
0.34 ± 9% -0.3 0.04 ± 73% perf-profile.self.cycles-pp.generic_bin_search
0.32 ± 18% -0.3 0.04 ± 71% perf-profile.self.cycles-pp.btrfs_search_slot
0.31 ± 8% -0.3 0.04 ± 71% perf-profile.self.cycles-pp.__get_user_nocheck_8
0.26 ± 13% -0.2 0.05 ± 45% perf-profile.self.cycles-pp.kmem_cache_alloc
0.24 ± 12% -0.2 0.04 ± 71% perf-profile.self.cycles-pp.memcpy_erms
0.20 ± 8% -0.2 0.03 ± 70% perf-profile.self.cycles-pp.__might_resched
0.22 ± 12% -0.2 0.06 ± 11% perf-profile.self.cycles-pp.orc_find
0.18 ± 9% -0.1 0.04 ± 71% perf-profile.self.cycles-pp.__etree_search
0.21 ± 69% -0.1 0.08 ± 24% perf-profile.self.cycles-pp._find_next_bit
0.24 ± 18% -0.1 0.15 ± 13% perf-profile.self.cycles-pp.queue_event
0.10 ± 10% -0.0 0.07 ± 16% perf-profile.self.cycles-pp.idle_cpu
0.16 ± 30% +1.7 1.88 ±102% perf-profile.self.cycles-pp.rwsem_spin_on_owner
0.00 +3.3 3.29 ± 10% perf-profile.self.cycles-pp.find_first_extent_bit_state
3.56 ± 7% +4.4 7.93 ± 5% perf-profile.self.cycles-pp.mutex_spin_on_owner
0.34 ± 15% +6.4 6.77 ± 6% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
1.31 ± 17% +6.7 7.98 ± 7% perf-profile.self.cycles-pp.osq_lock
0.16 ± 24% +11.9 12.04 ± 6% perf-profile.self.cycles-pp.rb_next
63652 ± 4% +342.1% 281400 ± 22% softirqs.CPU0.RCU
49340 ± 3% +323.7% 209037 ± 4% softirqs.CPU0.SCHED
77569 ± 22% +301.1% 311142 ± 16% softirqs.CPU1.RCU
51305 ± 5% +440.7% 277414 ± 12% softirqs.CPU1.SCHED
63598 ± 7% +393.4% 313821 ± 12% softirqs.CPU10.RCU
46668 ± 3% +442.9% 253366 ± 12% softirqs.CPU10.SCHED
56913 ± 8% +372.7% 269022 ± 24% softirqs.CPU100.RCU
44647 ± 4% +342.7% 197632 ± 4% softirqs.CPU100.SCHED
54306 ± 5% +428.0% 286713 ± 24% softirqs.CPU101.RCU
43536 ± 5% +352.3% 196901 ± 3% softirqs.CPU101.SCHED
57307 ± 5% +403.7% 288668 ± 24% softirqs.CPU102.RCU
44116 ± 5% +344.9% 196272 ± 3% softirqs.CPU102.SCHED
55926 ± 5% +396.2% 277483 ± 24% softirqs.CPU103.RCU
43612 ± 5% +344.3% 193773 ± 3% softirqs.CPU103.SCHED
52019 ± 12% +409.4% 264966 ± 25% softirqs.CPU104.RCU
37370 ± 24% +406.0% 189092 ± 4% softirqs.CPU104.SCHED
58110 ± 5% +399.9% 290468 ± 23% softirqs.CPU105.RCU
43964 ± 5% +350.1% 197899 ± 4% softirqs.CPU105.SCHED
57196 ± 4% +389.7% 280102 ± 24% softirqs.CPU106.RCU
43755 ± 5% +350.2% 196999 ± 3% softirqs.CPU106.SCHED
57359 ± 5% +401.5% 287675 ± 24% softirqs.CPU107.RCU
43586 ± 5% +348.2% 195346 ± 4% softirqs.CPU107.SCHED
58033 ± 5% +394.4% 286918 ± 23% softirqs.CPU108.RCU
43774 ± 4% +348.7% 196415 ± 3% softirqs.CPU108.SCHED
55569 ± 9% +396.6% 275947 ± 24% softirqs.CPU109.RCU
40526 ± 16% +379.0% 194101 ± 3% softirqs.CPU109.SCHED
63823 ± 12% +356.7% 291484 ± 21% softirqs.CPU11.RCU
46707 ± 7% +339.0% 205048 ± 4% softirqs.CPU11.SCHED
55191 ± 4% +376.4% 262942 ± 18% softirqs.CPU110.RCU
42677 ± 5% +346.8% 190674 ± 4% softirqs.CPU110.SCHED
57155 ± 6% +390.3% 280242 ± 21% softirqs.CPU111.RCU
43508 ± 5% +346.8% 194411 ± 3% softirqs.CPU111.SCHED
48597 ± 5% +408.8% 247256 ± 24% softirqs.CPU112.RCU
43644 ± 5% +306.3% 177304 ± 19% softirqs.CPU112.SCHED
57125 ± 24% +395.7% 283157 ± 16% softirqs.CPU113.RCU
46364 ± 8% +424.7% 243265 ± 13% softirqs.CPU113.SCHED
51740 ± 7% +404.6% 261059 ± 22% softirqs.CPU114.RCU
42019 ± 18% +374.5% 199368 ± 3% softirqs.CPU114.SCHED
58832 ± 23% +385.0% 285311 ± 13% softirqs.CPU115.RCU
46274 ± 9% +479.9% 268326 ± 11% softirqs.CPU115.SCHED
54480 ± 7% +377.9% 260376 ± 20% softirqs.CPU116.RCU
45349 ± 5% +350.6% 204338 ± 3% softirqs.CPU116.SCHED
53106 ± 10% +369.5% 249325 ± 20% softirqs.CPU117.RCU
44834 ± 2% +346.3% 200104 ± 3% softirqs.CPU117.SCHED
69617 ± 19% +310.4% 285713 ± 13% softirqs.CPU118.RCU
49272 ± 4% +427.5% 259921 ± 10% softirqs.CPU118.SCHED
56984 ± 4% +356.1% 259910 ± 20% softirqs.CPU119.RCU
44993 ± 5% +356.8% 205534 ± 3% softirqs.CPU119.SCHED
3971 ± 82% +570.9% 26643 ± 33% softirqs.CPU12.NET_RX
60932 ± 6% +379.2% 291960 ± 20% softirqs.CPU12.RCU
45366 ± 4% +350.9% 204570 ± 4% softirqs.CPU12.SCHED
52992 ± 10% +348.7% 237785 ± 16% softirqs.CPU120.RCU
42449 ± 18% +377.7% 202781 ± 4% softirqs.CPU120.SCHED
47849 ± 10% +365.3% 222632 ± 12% softirqs.CPU121.RCU
45212 ± 3% +338.1% 198056 ± 9% softirqs.CPU121.SCHED
49431 ± 10% +365.1% 229896 ± 12% softirqs.CPU122.RCU
45367 ± 4% +352.7% 205373 ± 2% softirqs.CPU122.SCHED
53860 ± 12% +336.8% 235268 ± 14% softirqs.CPU123.RCU
42520 ± 15% +385.5% 206453 ± 2% softirqs.CPU123.SCHED
53023 ± 12% +354.0% 240730 ± 13% softirqs.CPU124.RCU
45270 ± 3% +355.2% 206090 ± 2% softirqs.CPU124.SCHED
53843 ± 12% +323.7% 228115 ± 10% softirqs.CPU125.RCU
45383 ± 3% +354.5% 206269 ± 2% softirqs.CPU125.SCHED
50612 ± 10% +354.2% 229899 ± 14% softirqs.CPU126.RCU
43458 ± 11% +373.3% 205690 ± 2% softirqs.CPU126.SCHED
47811 ± 10% +354.5% 217312 ± 15% softirqs.CPU127.RCU
45393 ± 3% +350.9% 204676 ± 2% softirqs.CPU127.SCHED
60930 ± 11% +344.5% 270847 ± 15% softirqs.CPU128.RCU
44984 ± 4% +355.5% 204927 ± 2% softirqs.CPU128.SCHED
63281 ± 16% +319.1% 265212 ± 17% softirqs.CPU129.RCU
44936 ± 3% +357.9% 205778 ± 2% softirqs.CPU129.SCHED
2554 ±126% +781.9% 22525 ± 79% softirqs.CPU13.NET_RX
59587 ± 8% +411.2% 304622 ± 15% softirqs.CPU13.RCU
44708 ± 6% +430.8% 237330 ± 17% softirqs.CPU13.SCHED
61517 ± 11% +357.2% 281242 ± 11% softirqs.CPU130.RCU
44925 ± 3% +356.9% 205246 ± 2% softirqs.CPU130.SCHED
65236 ± 16% +349.5% 293206 ± 12% softirqs.CPU131.RCU
45403 ± 3% +352.8% 205592 ± 2% softirqs.CPU131.SCHED
62192 ± 14% +375.4% 295674 ± 13% softirqs.CPU132.RCU
42904 ± 14% +378.8% 205413 ± 2% softirqs.CPU132.SCHED
58253 ± 6% +364.4% 270520 ± 13% softirqs.CPU133.RCU
45293 ± 2% +351.7% 204596 ± 2% softirqs.CPU133.SCHED
61163 ± 10% +351.1% 275886 ± 8% softirqs.CPU134.RCU
45033 ± 3% +354.5% 204692 ± 2% softirqs.CPU134.SCHED
64743 ± 17% +338.5% 283887 ± 9% softirqs.CPU135.RCU
45320 ± 3% +354.4% 205955 ± 2% softirqs.CPU135.SCHED
59767 ± 10% +362.4% 276383 ± 11% softirqs.CPU136.RCU
45304 ± 3% +352.6% 205044 ± 2% softirqs.CPU136.SCHED
66245 ± 16% +347.1% 296169 ± 11% softirqs.CPU137.RCU
45400 ± 3% +346.8% 202857 ± 4% softirqs.CPU137.SCHED
12.67 ± 15% +28681.6% 3645 ±222% softirqs.CPU137.TIMER
63311 ± 19% +356.8% 289197 ± 14% softirqs.CPU138.RCU
45374 ± 3% +353.9% 205954 ± 2% softirqs.CPU138.SCHED
65646 ± 15% +327.8% 280826 ± 12% softirqs.CPU139.RCU
45240 ± 3% +340.2% 199168 ± 2% softirqs.CPU139.SCHED
16.00 ± 25% +56830.2% 9108 ±215% softirqs.CPU139.TIMER
60185 ± 6% +371.6% 283832 ± 24% softirqs.CPU14.RCU
41827 ± 17% +379.4% 200505 ± 2% softirqs.CPU14.SCHED
65300 ± 18% +342.3% 288816 ± 12% softirqs.CPU140.RCU
45340 ± 3% +353.8% 205747 ± 2% softirqs.CPU140.SCHED
62410 ± 13% +350.8% 281343 ± 10% softirqs.CPU141.RCU
45172 ± 4% +354.8% 205421 ± 2% softirqs.CPU141.SCHED
66114 ± 16% +345.3% 294423 ± 12% softirqs.CPU142.RCU
44910 ± 5% +357.8% 205590 ± 2% softirqs.CPU142.SCHED
59908 ± 26% +365.1% 278631 ± 16% softirqs.CPU143.RCU
45322 ± 3% +354.2% 205841 ± 2% softirqs.CPU143.SCHED
58563 ± 17% +355.5% 266765 ± 19% softirqs.CPU144.RCU
45398 ± 3% +269.3% 167665 ± 32% softirqs.CPU144.SCHED
57117 ± 14% +353.1% 258821 ± 16% softirqs.CPU145.RCU
44873 ± 3% +359.9% 206370 ± 2% softirqs.CPU145.SCHED
53695 ± 12% +379.9% 257672 ± 15% softirqs.CPU146.RCU
45108 ± 3% +356.0% 205710 ± 2% softirqs.CPU146.SCHED
60494 ± 19% +362.9% 280037 ± 11% softirqs.CPU147.RCU
45342 ± 2% +355.8% 206659 softirqs.CPU147.SCHED
61708 ± 17% +355.0% 280785 ± 12% softirqs.CPU148.RCU
44963 ± 2% +325.1% 191135 ± 17% softirqs.CPU148.SCHED
62685 ± 19% +354.7% 285033 ± 12% softirqs.CPU149.RCU
44887 ± 2% +359.8% 206389 softirqs.CPU149.SCHED
60025 ± 9% +374.5% 284843 ± 22% softirqs.CPU15.RCU
46873 ± 12% +305.0% 189826 ± 15% softirqs.CPU15.SCHED
63745 ± 17% +341.1% 281196 ± 13% softirqs.CPU150.RCU
45400 ± 3% +354.2% 206227 ± 2% softirqs.CPU150.SCHED
59142 ± 17% +391.8% 290854 ± 13% softirqs.CPU151.RCU
45063 ± 3% +356.8% 205846 ± 2% softirqs.CPU151.SCHED
62173 ± 19% +368.5% 291301 ± 12% softirqs.CPU152.RCU
44941 ± 3% +359.9% 206698 softirqs.CPU152.SCHED
60823 ± 14% +362.7% 281461 ± 14% softirqs.CPU153.RCU
45298 ± 3% +354.9% 206063 ± 2% softirqs.CPU153.SCHED
63059 ± 18% +374.1% 298987 ± 12% softirqs.CPU154.RCU
44578 ± 2% +362.7% 206273 ± 2% softirqs.CPU154.SCHED
63445 ± 19% +372.1% 299518 ± 11% softirqs.CPU155.RCU
45381 ± 3% +355.2% 206577 softirqs.CPU155.SCHED
56287 ± 13% +384.0% 272439 ± 15% softirqs.CPU156.RCU
44609 ± 3% +360.3% 205323 ± 2% softirqs.CPU156.SCHED
58413 ± 13% +368.8% 273828 ± 14% softirqs.CPU157.RCU
44570 ± 3% +360.9% 205442 ± 2% softirqs.CPU157.SCHED
62362 ± 18% +356.1% 284451 ± 12% softirqs.CPU158.RCU
44831 ± 2% +360.7% 206536 softirqs.CPU158.SCHED
58942 ± 12% +362.7% 272740 ± 18% softirqs.CPU159.RCU
44870 ± 2% +358.8% 205858 ± 2% softirqs.CPU159.SCHED
52648 ± 7% +370.0% 247431 ± 19% softirqs.CPU16.RCU
45545 ± 4% +303.5% 183786 ± 18% softirqs.CPU16.SCHED
54794 ± 18% +404.5% 276449 ± 9% softirqs.CPU160.RCU
45248 ± 3% +356.2% 206408 softirqs.CPU160.SCHED
56431 ± 17% +402.2% 283391 ± 9% softirqs.CPU161.RCU
45258 ± 3% +356.5% 206609 softirqs.CPU161.SCHED
50149 ± 16% +394.1% 247814 ± 18% softirqs.CPU162.RCU
44263 ± 3% +363.7% 205261 ± 2% softirqs.CPU162.SCHED
56212 ± 17% +385.9% 273156 ± 9% softirqs.CPU163.RCU
44865 ± 3% +359.1% 205966 ± 2% softirqs.CPU163.SCHED
56988 ± 22% +399.2% 284493 ± 9% softirqs.CPU164.RCU
45379 ± 2% +355.2% 206584 softirqs.CPU164.SCHED
54719 ± 15% +390.0% 268124 ± 13% softirqs.CPU165.RCU
44588 ± 3% +361.1% 205613 ± 2% softirqs.CPU165.SCHED
58206 ± 18% +373.3% 275474 ± 18% softirqs.CPU166.RCU
44633 ± 3% +362.5% 206428 softirqs.CPU166.SCHED
57704 ± 17% +395.9% 286158 ± 10% softirqs.CPU167.RCU
45202 ± 2% +356.6% 206389 ± 2% softirqs.CPU167.SCHED
55062 ± 14% +354.5% 250266 ± 17% softirqs.CPU168.RCU
42774 ± 17% +348.3% 191774 ± 18% softirqs.CPU168.SCHED
51581 ± 16% +352.2% 233273 ± 12% softirqs.CPU169.RCU
45634 ± 3% +357.5% 208756 softirqs.CPU169.SCHED
109.33 ±150% +2088.3% 2392 ±157% softirqs.CPU169.TIMER
51076 ± 8% +400.3% 255559 ± 22% softirqs.CPU17.RCU
43946 ± 8% +355.4% 200130 ± 3% softirqs.CPU17.SCHED
49451 ± 11% +385.0% 239833 ± 13% softirqs.CPU170.RCU
45525 ± 3% +357.1% 208092 softirqs.CPU170.SCHED
57199 ± 17% +349.3% 257006 ± 9% softirqs.CPU171.RCU
45644 ± 3% +355.7% 208002 softirqs.CPU171.SCHED
17.67 ± 42% +36935.8% 6543 ±219% softirqs.CPU171.TIMER
55843 ± 18% +347.9% 250126 ± 8% softirqs.CPU172.RCU
45312 ± 4% +358.8% 207902 softirqs.CPU172.SCHED
56791 ± 17% +357.4% 259792 ± 8% softirqs.CPU173.RCU
45497 ± 3% +356.9% 207893 softirqs.CPU173.SCHED
56186 ± 17% +357.9% 257270 ± 9% softirqs.CPU174.RCU
45426 ± 3% +357.6% 207862 softirqs.CPU174.SCHED
54313 ± 14% +354.2% 246718 ± 8% softirqs.CPU175.RCU
45485 ± 3% +356.4% 207576 softirqs.CPU175.SCHED
57429 ± 18% +392.5% 282841 ± 17% softirqs.CPU176.RCU
45934 ± 3% +352.6% 207919 softirqs.CPU176.SCHED
57061 ± 13% +377.7% 272553 ± 14% softirqs.CPU177.RCU
45238 ± 4% +359.9% 208050 softirqs.CPU177.SCHED
59204 ± 16% +390.7% 290508 ± 11% softirqs.CPU178.RCU
44756 ± 4% +364.7% 207983 softirqs.CPU178.SCHED
61089 ± 16% +381.9% 294400 ± 12% softirqs.CPU179.RCU
45622 ± 3% +356.1% 208097 softirqs.CPU179.SCHED
53248 ± 7% +389.6% 260710 ± 20% softirqs.CPU18.RCU
42303 ± 15% +380.1% 203100 ± 3% softirqs.CPU18.SCHED
56495 ± 11% +381.1% 271819 ± 12% softirqs.CPU180.RCU
45165 ± 4% +324.4% 191661 ± 18% softirqs.CPU180.SCHED
56109 ± 12% +374.0% 265983 ± 12% softirqs.CPU181.RCU
45113 ± 3% +360.7% 207829 softirqs.CPU181.SCHED
61889 ± 16% +361.8% 285815 ± 9% softirqs.CPU182.RCU
45606 ± 3% +356.1% 208024 softirqs.CPU182.SCHED
57114 ± 11% +389.6% 279620 ± 16% softirqs.CPU183.RCU
45233 ± 4% +344.6% 201088 ± 7% softirqs.CPU183.SCHED
61548 ± 15% +375.1% 292441 ± 12% softirqs.CPU184.RCU
45836 ± 2% +360.2% 210937 ± 3% softirqs.CPU184.SCHED
63265 ± 17% +376.7% 301557 ± 13% softirqs.CPU185.RCU
45427 ± 3% +387.2% 221324 ± 14% softirqs.CPU185.SCHED
55427 ± 8% +393.6% 273596 ± 19% softirqs.CPU186.RCU
45019 ± 5% +371.4% 212211 ± 4% softirqs.CPU186.SCHED
61836 ± 16% +375.6% 294062 ± 18% softirqs.CPU187.RCU
45495 ± 4% +389.6% 222739 ± 14% softirqs.CPU187.SCHED
63091 ± 18% +363.7% 292538 ± 17% softirqs.CPU188.RCU
45246 ± 3% +369.7% 212530 ± 4% softirqs.CPU188.SCHED
60039 ± 14% +365.2% 279312 ± 15% softirqs.CPU189.RCU
45293 ± 3% +372.8% 214132 ± 6% softirqs.CPU189.SCHED
49889 ± 7% +395.7% 247286 ± 23% softirqs.CPU19.RCU
44310 ± 4% +356.3% 202195 softirqs.CPU19.SCHED
61474 ± 17% +369.3% 288500 ± 23% softirqs.CPU190.RCU
45783 ± 3% +395.9% 227022 ± 18% softirqs.CPU190.SCHED
56580 ± 15% +392.8% 278821 ± 13% softirqs.CPU191.RCU
38811 ± 25% +284.3% 149137 ± 26% softirqs.CPU191.SCHED
68047 ± 9% +304.3% 275101 ± 22% softirqs.CPU2.RCU
45157 ± 18% +355.3% 205616 ± 4% softirqs.CPU2.SCHED
51325 ± 2% +392.8% 252926 ± 22% softirqs.CPU20.RCU
44653 ± 4% +347.1% 199634 ± 3% softirqs.CPU20.SCHED
50340 ± 7% +386.5% 244919 ± 20% softirqs.CPU21.RCU
41791 ± 16% +371.4% 197016 ± 3% softirqs.CPU21.SCHED
51067 ± 8% +390.5% 250469 ± 22% softirqs.CPU22.RCU
42769 ± 14% +366.6% 199543 ± 3% softirqs.CPU22.SCHED
51188 ± 6% +387.8% 249670 ± 24% softirqs.CPU23.RCU
44890 ± 3% +345.1% 199786 ± 3% softirqs.CPU23.SCHED
52297 ± 10% +357.2% 239089 ± 16% softirqs.CPU24.RCU
46179 ± 2% +348.4% 207072 ± 3% softirqs.CPU24.SCHED
47969 ± 10% +360.0% 220664 ± 14% softirqs.CPU25.RCU
45420 ± 3% +351.8% 205216 ± 2% softirqs.CPU25.SCHED
82.33 ±127% +6649.8% 5557 ±137% softirqs.CPU25.TIMER
49379 ± 10% +358.5% 226384 ± 14% softirqs.CPU26.RCU
45515 ± 3% +357.8% 208350 ± 4% softirqs.CPU26.SCHED
20.50 ± 97% +33919.5% 6974 ±139% softirqs.CPU26.TIMER
55152 ± 11% +329.1% 236637 ± 14% softirqs.CPU27.RCU
45778 ± 3% +349.3% 205684 ± 2% softirqs.CPU27.SCHED
54946 ± 12% +337.3% 240300 ± 13% softirqs.CPU28.RCU
42795 ± 11% +383.6% 206975 ± 2% softirqs.CPU28.SCHED
55072 ± 13% +317.2% 229748 ± 10% softirqs.CPU29.RCU
46681 ± 5% +341.5% 206110 softirqs.CPU29.SCHED
64262 ± 6% +353.4% 291339 ± 21% softirqs.CPU3.RCU
45244 ± 3% +352.0% 204498 ± 4% softirqs.CPU3.SCHED
52963 ± 10% +330.5% 228029 ± 14% softirqs.CPU30.RCU
44973 ± 3% +364.7% 209004 ± 5% softirqs.CPU30.SCHED
47012 ± 15% +360.5% 216483 ± 15% softirqs.CPU31.RCU
48839 ± 12% +320.1% 205164 ± 3% softirqs.CPU31.SCHED
62062 ± 9% +344.0% 275539 ± 14% softirqs.CPU32.RCU
44656 ± 3% +359.3% 205125 ± 2% softirqs.CPU32.SCHED
64600 ± 14% +318.1% 270075 ± 17% softirqs.CPU33.RCU
44995 ± 3% +356.5% 205428 ± 2% softirqs.CPU33.SCHED
62063 ± 11% +358.6% 284614 ± 11% softirqs.CPU34.RCU
46874 ± 6% +336.9% 204784 ± 2% softirqs.CPU34.SCHED
64581 ± 13% +353.8% 293098 ± 11% softirqs.CPU35.RCU
46826 ± 7% +342.6% 207236 ± 3% softirqs.CPU35.SCHED
62382 ± 14% +378.1% 298226 ± 11% softirqs.CPU36.RCU
49083 ± 16% +319.3% 205786 ± 2% softirqs.CPU36.SCHED
58767 ± 6% +359.5% 270030 ± 12% softirqs.CPU37.RCU
45319 ± 3% +350.7% 204245 ± 2% softirqs.CPU37.SCHED
61252 ± 9% +353.6% 277816 ± 10% softirqs.CPU38.RCU
45140 ± 3% +352.4% 204200 ± 2% softirqs.CPU38.SCHED
64814 ± 14% +345.4% 288672 ± 8% softirqs.CPU39.RCU
45445 ± 3% +352.5% 205627 ± 2% softirqs.CPU39.SCHED
72447 ± 15% +322.2% 305901 ± 18% softirqs.CPU4.RCU
48515 ± 3% +438.5% 261238 ± 11% softirqs.CPU4.SCHED
60628 ± 8% +360.2% 278994 ± 10% softirqs.CPU40.RCU
44990 ± 3% +358.8% 206425 ± 3% softirqs.CPU40.SCHED
66477 ± 14% +356.4% 303430 ± 11% softirqs.CPU41.RCU
45648 ± 3% +354.4% 207413 ± 3% softirqs.CPU41.SCHED
67773 ± 17% +326.5% 289049 ± 19% softirqs.CPU42.RCU
42284 ± 15% +386.9% 205884 softirqs.CPU42.SCHED
66206 ± 14% +336.1% 288703 ± 13% softirqs.CPU43.RCU
45434 ± 3% +351.9% 205307 ± 2% softirqs.CPU43.SCHED
11.67 ± 25% +46575.7% 5445 ±194% softirqs.CPU43.TIMER
66411 ± 16% +344.1% 294945 ± 11% softirqs.CPU44.RCU
45627 ± 2% +351.2% 205878 softirqs.CPU44.SCHED
63997 ± 12% +352.1% 289319 ± 10% softirqs.CPU45.RCU
45702 ± 3% +349.2% 205309 ± 2% softirqs.CPU45.SCHED
66475 ± 16% +354.3% 302004 ± 11% softirqs.CPU46.RCU
45399 ± 4% +353.2% 205728 ± 2% softirqs.CPU46.SCHED
64940 ± 13% +338.2% 284588 ± 15% softirqs.CPU47.RCU
45948 ± 3% +347.1% 205433 ± 2% softirqs.CPU47.SCHED
60645 ± 17% +359.7% 278803 ± 20% softirqs.CPU48.RCU
45368 ± 2% +353.2% 205613 ± 2% softirqs.CPU48.SCHED
59256 ± 12% +360.7% 272994 ± 16% softirqs.CPU49.RCU
45210 ± 3% +354.9% 205646 ± 2% softirqs.CPU49.SCHED
68114 ± 14% +327.1% 290884 ± 20% softirqs.CPU5.RCU
56403 ± 51% +245.9% 195106 ± 17% softirqs.CPU5.SCHED
57773 ± 9% +361.9% 266846 ± 16% softirqs.CPU50.RCU
42648 ± 16% +381.4% 205329 ± 2% softirqs.CPU50.SCHED
63894 ± 16% +354.5% 290411 ± 12% softirqs.CPU51.RCU
45821 ± 4% +345.1% 203948 ± 3% softirqs.CPU51.SCHED
62871 ± 17% +357.0% 287303 ± 12% softirqs.CPU52.RCU
45508 ± 2% +352.9% 206120 softirqs.CPU52.SCHED
67967 ± 15% +324.9% 288781 ± 12% softirqs.CPU53.RCU
47032 ± 10% +303.8% 189894 ± 19% softirqs.CPU53.SCHED
65244 ± 15% +333.5% 282855 ± 12% softirqs.CPU54.RCU
45663 ± 3% +347.0% 204113 ± 3% softirqs.CPU54.SCHED
59563 ± 16% +390.3% 292045 ± 13% softirqs.CPU55.RCU
45424 ± 3% +352.5% 205550 ± 2% softirqs.CPU55.SCHED
68697 ± 16% +336.1% 299594 ± 11% softirqs.CPU56.RCU
47117 ± 11% +337.2% 206013 softirqs.CPU56.SCHED
62397 ± 12% +363.5% 289229 ± 14% softirqs.CPU57.RCU
42533 ± 12% +344.9% 189219 ± 18% softirqs.CPU57.SCHED
64451 ± 16% +376.4% 307026 ± 11% softirqs.CPU58.RCU
45128 ± 4% +354.9% 205272 softirqs.CPU58.SCHED
67900 ± 14% +353.2% 307718 ± 10% softirqs.CPU59.RCU
46343 ± 8% +345.0% 206239 softirqs.CPU59.SCHED
63234 ± 6% +356.1% 288392 ± 22% softirqs.CPU6.RCU
44442 ± 7% +359.3% 204137 ± 4% softirqs.CPU6.SCHED
59115 ± 9% +378.5% 282874 ± 16% softirqs.CPU60.RCU
45396 ± 3% +352.0% 205203 ± 2% softirqs.CPU60.SCHED
59494 ± 9% +368.0% 278421 ± 14% softirqs.CPU61.RCU
45655 ± 3% +349.7% 205298 ± 2% softirqs.CPU61.SCHED
65960 ± 14% +341.6% 291281 ± 11% softirqs.CPU62.RCU
46434 ± 6% +344.1% 206206 softirqs.CPU62.SCHED
61572 ± 10% +339.5% 270610 ± 20% softirqs.CPU63.RCU
40841 ± 19% +403.7% 205723 ± 2% softirqs.CPU63.SCHED
64.83 ±124% +8867.4% 5813 ±162% softirqs.CPU63.TIMER
55899 ± 17% +402.1% 280642 ± 10% softirqs.CPU64.RCU
45271 ± 3% +354.9% 205920 ± 2% softirqs.CPU64.SCHED
56599 ± 19% +404.9% 285780 ± 9% softirqs.CPU65.RCU
45115 ± 3% +357.2% 206261 softirqs.CPU65.SCHED
50803 ± 16% +402.1% 255070 ± 20% softirqs.CPU66.RCU
45109 ± 2% +355.2% 205323 ± 2% softirqs.CPU66.SCHED
57587 ± 17% +387.2% 280551 ± 11% softirqs.CPU67.RCU
44830 ± 2% +359.2% 205864 ± 2% softirqs.CPU67.SCHED
58698 ± 20% +392.8% 289238 ± 9% softirqs.CPU68.RCU
45091 ± 3% +357.3% 206205 softirqs.CPU68.SCHED
55763 ± 16% +391.3% 273967 ± 13% softirqs.CPU69.RCU
45122 ± 2% +356.5% 205996 ± 2% softirqs.CPU69.SCHED
67476 ± 16% +369.9% 317099 ± 15% softirqs.CPU7.RCU
46833 ± 5% +389.0% 229008 ± 27% softirqs.CPU7.SCHED
58868 ± 17% +376.5% 280531 ± 17% softirqs.CPU70.RCU
45317 ± 2% +354.2% 205815 softirqs.CPU70.SCHED
58439 ± 18% +395.2% 289404 ± 10% softirqs.CPU71.RCU
44994 ± 3% +358.1% 206131 ± 2% softirqs.CPU71.SCHED
56194 ± 14% +369.1% 263625 ± 15% softirqs.CPU72.RCU
45606 ± 2% +365.5% 212316 ± 4% softirqs.CPU72.SCHED
53492 ± 15% +384.8% 259308 ± 18% softirqs.CPU73.RCU
42384 ± 18% +431.9% 225421 ± 17% softirqs.CPU73.SCHED
50421 ± 11% +406.3% 255290 ± 15% softirqs.CPU74.RCU
45056 ± 3% +365.8% 209866 ± 3% softirqs.CPU74.SCHED
58777 ± 18% +365.5% 273592 ± 8% softirqs.CPU75.RCU
41914 ± 18% +399.4% 209311 ± 2% softirqs.CPU75.SCHED
57403 ± 17% +370.0% 269822 ± 10% softirqs.CPU76.RCU
45059 ± 3% +385.7% 218874 ± 13% softirqs.CPU76.SCHED
58353 ± 16% +361.4% 269221 ± 8% softirqs.CPU77.RCU
45602 ± 2% +355.4% 207662 ± 2% softirqs.CPU77.SCHED
57557 ± 17% +361.9% 265888 ± 8% softirqs.CPU78.RCU
45130 ± 3% +360.3% 207718 softirqs.CPU78.SCHED
55270 ± 15% +382.6% 266740 ± 13% softirqs.CPU79.RCU
45451 ± 3% +375.0% 215880 ± 9% softirqs.CPU79.SCHED
63442 ± 14% +344.3% 281856 ± 23% softirqs.CPU8.RCU
45979 ± 9% +338.6% 201664 ± 7% softirqs.CPU8.SCHED
60531 ± 15% +351.2% 273091 ± 13% softirqs.CPU80.RCU
45469 ± 2% +356.2% 207450 softirqs.CPU80.SCHED
57455 ± 14% +380.5% 276047 ± 14% softirqs.CPU81.RCU
45116 ± 2% +359.3% 207237 softirqs.CPU81.SCHED
61087 ± 16% +395.8% 302853 ± 14% softirqs.CPU82.RCU
45382 ± 2% +369.5% 213085 ± 5% softirqs.CPU82.SCHED
62548 ± 16% +387.7% 305020 ± 13% softirqs.CPU83.RCU
45310 ± 2% +356.8% 206982 softirqs.CPU83.SCHED
57140 ± 11% +384.5% 276871 ± 12% softirqs.CPU84.RCU
45086 ± 3% +360.7% 207726 softirqs.CPU84.SCHED
57323 ± 12% +380.8% 275640 ± 13% softirqs.CPU85.RCU
44947 ± 3% +367.6% 210170 ± 3% softirqs.CPU85.SCHED
61528 ± 23% +379.2% 294822 ± 9% softirqs.CPU86.RCU
44995 ± 3% +359.1% 206572 softirqs.CPU86.SCHED
57346 ± 11% +389.3% 280586 ± 16% softirqs.CPU87.RCU
45045 ± 3% +365.4% 209654 ± 3% softirqs.CPU87.SCHED
62158 ± 16% +363.4% 288048 ± 10% softirqs.CPU88.RCU
45696 ± 3% +353.3% 207149 softirqs.CPU88.SCHED
63807 ± 17% +362.8% 295316 ± 10% softirqs.CPU89.RCU
44745 ± 3% +362.3% 206843 softirqs.CPU89.SCHED
60946 ± 9% +379.3% 292107 ± 21% softirqs.CPU9.RCU
45163 ± 6% +319.5% 189443 ± 16% softirqs.CPU9.SCHED
56147 ± 9% +389.5% 274854 ± 18% softirqs.CPU90.RCU
45042 ± 3% +358.9% 206712 softirqs.CPU90.SCHED
63372 ± 16% +352.6% 286837 ± 12% softirqs.CPU91.RCU
44906 ± 3% +361.6% 207303 softirqs.CPU91.SCHED
63607 ± 17% +366.1% 296504 ± 15% softirqs.CPU92.RCU
45203 ± 3% +358.6% 207307 softirqs.CPU92.SCHED
60249 ± 14% +363.4% 279200 ± 14% softirqs.CPU93.RCU
45105 ± 4% +359.6% 207292 softirqs.CPU93.SCHED
63877 ± 16% +341.6% 282102 ± 18% softirqs.CPU94.RCU
45311 ± 3% +320.0% 190313 ± 18% softirqs.CPU94.SCHED
59543 ± 15% +376.4% 283663 ± 14% softirqs.CPU95.RCU
23940 ± 15% +553.1% 156351 ± 36% softirqs.CPU95.SCHED
58260 ± 8% +356.8% 266158 ± 27% softirqs.CPU96.RCU
41169 ± 11% +363.7% 190900 ± 5% softirqs.CPU96.SCHED
54490 ± 11% +388.3% 266082 ± 24% softirqs.CPU97.RCU
44509 ± 5% +344.1% 197655 ± 3% softirqs.CPU97.SCHED
58098 ± 10% +367.1% 271353 ± 24% softirqs.CPU98.RCU
43164 ± 6% +315.5% 179359 ± 16% softirqs.CPU98.SCHED
58008 ± 9% +391.1% 284903 ± 24% softirqs.CPU99.RCU
44783 ± 5% +332.6% 193736 ± 3% softirqs.CPU99.SCHED
20297 ± 52% +243.9% 69801 ± 33% softirqs.NET_RX
11324902 ± 10% +366.3% 52803478 ± 11% softirqs.RCU
8624664 ± 3% +357.9% 39489702 softirqs.SCHED
64250 ± 2% +284.5% 247050 ± 5% softirqs.TIMER
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang
6 months, 3 weeks
- 2
- 1
[xfs] 3cc155274e: xfstests.generic.475.fail
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 3cc155274e492ae196ec71f3ae4a38396d26871c ("xfs: support logging EFIs for realtime extents")
linux-devel revert-9baef98cfac687e8a26c8f6cb4dcd60d90c7f1ec-d06a7bfab06f093c7bffcc472bf0d1ba170bb765
in testcase: xfstests
version: xfstests-x86_64-972d710-1_20220114
with following parameters:
disk: 4HDD
fs: xfs
test: generic-group-23
ucode: 0xe2
test-description: xfstests is a regression test suite for xfs and other files ystems.
test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git
on test machine: 4 threads Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz with 32G memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
generic/475 [failed, exit status 1]- output mismatch (see /lkp/benchmarks/xfstests/results//generic/475.out.bad)
--- tests/generic/475.out 2022-01-14 05:25:22.000000000 +0000
+++ /lkp/benchmarks/xfstests/results//generic/475.out.bad 2022-01-15 01:19:40.358924696 +0000
@@ -1,2 +1,6 @@
QA output created by 475
Silence is golden.
+mount: /fs/scratch: mount(2) system call failed: Structure needs cleaning.
+mount failed
+(see /lkp/benchmarks/xfstests/results//generic/475.full for details)
+umount: /fs/scratch: not mounted.
...
(Run 'diff -u /lkp/benchmarks/xfstests/tests/generic/475.out /lkp/benchmarks/xfstests/results//generic/475.out.bad' to see the entire diff)
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
sudo bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
sudo bin/lkp run generated-yaml-file
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang
6 months, 3 weeks
- 1
- 0
[perf] f7cf7134e4: WARNING:at_kernel/events/core.c:#__pmu_ctx_sched_out
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: f7cf7134e405062bf0f22c3ba5637241c4c4d06a ("[RFC v2] perf: Rewrite core context handling")
url: https://github.com/0day-ci/linux/commits/Ravi-Bangoria/perf-Rewrite-core-...
base: https://git.kernel.org/cgit/linux/kernel/git/tip/tip.git a9f4a6e92b3b319296fb078da2615f618f6cd80c
patch link: https://lore.kernel.org/lkml/[email protected]
in testcase: trinity
version: trinity-x86_64-608712d8-1_20220112
with following parameters:
runtime: 300s
group: group-03
test-description: Trinity is a linux system call fuzz tester.
test-url: http://codemonkey.org.uk/projects/trinity/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 16G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+------------------------------------------------------+------------+------------+
| | a9f4a6e92b | f7cf7134e4 |
+------------------------------------------------------+------------+------------+
| WARNING:at_kernel/events/core.c:#__pmu_ctx_sched_out | 0 | 12 |
| RIP:__pmu_ctx_sched_out | 0 | 12 |
+------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
[ 61.980728][ T8152] WARNING: CPU: 0 PID: 8152 at kernel/events/core.c:3234 __pmu_ctx_sched_out (kernel/events/core.c:3234 (discriminator 1))
[ 61.983310][ T8152] Modules linked in: can_bcm can_raw can cn scsi_transport_iscsi ipmi_msghandler sr_mod cdrom sg ata_generic
[ 61.986280][ T8152] CPU: 0 PID: 8152 Comm: trinity-c7 Not tainted 5.16.0-rc1-00018-gf7cf7134e405 #1
[ 61.988767][ T8152] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014
[ 61.991025][ T8152] RIP: 0010:__pmu_ctx_sched_out (kernel/events/core.c:3234 (discriminator 1))
[ 61.992479][ T8152] Code: 89 fb 4c 8b 2f 49 83 bc 24 88 00 00 00 00 74 24 41 83 7c 24 70 00 75 1c 49 8b 45 48 65 48 03 05 79 a0 e9 7e 48 39 78 60 74 02 <0f> 0b 48 c7 40 60 00 00 00 00 4c 89 ef e8 50 fd ff ff 41 f6 c6 02
All code
========
0: 89 fb mov %edi,%ebx
2: 4c 8b 2f mov (%rdi),%r13
5: 49 83 bc 24 88 00 00 cmpq $0x0,0x88(%r12)
c: 00 00
e: 74 24 je 0x34
10: 41 83 7c 24 70 00 cmpl $0x0,0x70(%r12)
16: 75 1c jne 0x34
18: 49 8b 45 48 mov 0x48(%r13),%rax
1c: 65 48 03 05 79 a0 e9 add %gs:0x7ee9a079(%rip),%rax # 0x7ee9a09d
23: 7e
24: 48 39 78 60 cmp %rdi,0x60(%rax)
28: 74 02 je 0x2c
2a:* 0f 0b ud2 <-- trapping instruction
2c: 48 c7 40 60 00 00 00 movq $0x0,0x60(%rax)
33: 00
34: 4c 89 ef mov %r13,%rdi
37: e8 50 fd ff ff callq 0xfffffffffffffd8c
3c: 41 f6 c6 02 test $0x2,%r14b
Code starting with the faulting instruction
===========================================
0: 0f 0b ud2
2: 48 c7 40 60 00 00 00 movq $0x0,0x60(%rax)
9: 00
a: 4c 89 ef mov %r13,%rdi
d: e8 50 fd ff ff callq 0xfffffffffffffd62
12: 41 f6 c6 02 test $0x2,%r14b
[ 61.997335][ T8152] RSP: 0018:ffffc9000218fc78 EFLAGS: 00010007
[ 61.998976][ T8152] RAX: ffff88842fc2f658 RBX: ffff88812b633000 RCX: 0000000000000001
[ 62.000996][ T8152] RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff88812b633000
[ 62.003040][ T8152] RBP: ffff88812b633000 R08: ffff888175700b38 R09: ffff88816c54dc50
[ 62.005690][ T8152] R10: ffff8881767fdf00 R11: ffff88810cc004c0 R12: ffff888175700b00
[ 62.007781][ T8152] R13: ffffffff829f5580 R14: 0000000000000003 R15: ffff88812b37c600
[ 62.009979][ T8152] FS: 00007f72f7208740(0000) GS:ffff88842fc00000(0000) knlGS:0000000000000000
[ 62.012266][ T8152] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 62.014072][ T8152] CR2: 00007f72f6ec5efc CR3: 00000001755b6000 CR4: 00000000000006f0
[ 62.016206][ T8152] Call Trace:
[ 62.017163][ T8152] <TASK>
[ 62.018032][ T8152] ctx_sched_out (kernel/events/core.c:3314 (discriminator 3))
[ 62.019167][ T8152] ctx_resched (kernel/events/core.c:2734)
[ 62.020303][ T8152] __perf_install_in_context (kernel/events/core.c:2809)
[ 62.021707][ T8152] ? sw_perf_event_destroy (kernel/events/core.c:72)
[ 62.023104][ T8152] remote_function (kernel/events/core.c:91 kernel/events/core.c:71)
[ 62.024448][ T8152] generic_exec_single (arch/x86/include/asm/irqflags.h:127 kernel/smp.c:520 kernel/smp.c:504)
[ 62.025714][ T8152] ? __alloc_file (fs/file_table.c:117)
[ 62.027233][ T8152] smp_call_function_single (kernel/smp.c:757)
[ 62.028756][ T8152] ? sw_perf_event_destroy (kernel/events/core.c:72)
[ 62.030203][ T8152] ? alloc_file (fs/file_table.c:200)
[ 62.031351][ T8152] task_function_call (kernel/events/core.c:121)
[ 62.032654][ T8152] ? ctx_resched (kernel/events/core.c:2762)
[ 62.033860][ T8152] perf_install_in_context (kernel/events/core.c:2910)
[ 62.035324][ T8152] __do_sys_perf_event_open (kernel/events/core.c:12491)
[ 62.036830][ T8152] do_syscall_64 (arch/x86/entry/common.c:50 arch/x86/entry/common.c:80)
[ 62.038078][ T8152] entry_SYSCALL_64_after_hwframe (arch/x86/entry/entry_64.S:113)
[ 62.039568][ T8152] RIP: 0033:0x7f72f731ff59
[ 62.040675][ T8152] Code: 00 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 07 6f 0c 00 f7 d8 64 89 01 48
All code
========
0: 00 c3 add %al,%bl
2: 66 2e 0f 1f 84 00 00 nopw %cs:0x0(%rax,%rax,1)
9: 00 00 00
c: 0f 1f 44 00 00 nopl 0x0(%rax,%rax,1)
11: 48 89 f8 mov %rdi,%rax
14: 48 89 f7 mov %rsi,%rdi
17: 48 89 d6 mov %rdx,%rsi
1a: 48 89 ca mov %rcx,%rdx
1d: 4d 89 c2 mov %r8,%r10
20: 4d 89 c8 mov %r9,%r8
23: 4c 8b 4c 24 08 mov 0x8(%rsp),%r9
28: 0f 05 syscall
2a:* 48 3d 01 f0 ff ff cmp $0xfffffffffffff001,%rax <-- trapping instruction
30: 73 01 jae 0x33
32: c3 retq
33: 48 8b 0d 07 6f 0c 00 mov 0xc6f07(%rip),%rcx # 0xc6f41
3a: f7 d8 neg %eax
3c: 64 89 01 mov %eax,%fs:(%rcx)
3f: 48 rex.W
Code starting with the faulting instruction
===========================================
0: 48 3d 01 f0 ff ff cmp $0xfffffffffffff001,%rax
6: 73 01 jae 0x9
8: c3 retq
9: 48 8b 0d 07 6f 0c 00 mov 0xc6f07(%rip),%rcx # 0xc6f17
10: f7 d8 neg %eax
12: 64 89 01 mov %eax,%fs:(%rcx)
15: 48 rex.W
[ 62.045496][ T8152] RSP: 002b:00007ffddf82c708 EFLAGS: 00000246 ORIG_RAX: 000000000000012a
[ 62.047784][ T8152] RAX: ffffffffffffffda RBX: 000000000000012a RCX: 00007f72f731ff59
[ 62.049967][ T8152] RDX: ffffffffffffffff RSI: 0000000000001fd8 RDI: 000055dad0ac6c00
[ 62.051954][ T8152] RBP: 000000000000012a R08: 0000000000000000 R09: 0000000037ecd53b
[ 62.053953][ T8152] R10: ffffffffffffffff R11: 0000000000000246 R12: 0000000000000002
[ 62.055966][ T8152] R13: 00007f72f5c7b058 R14: 00007f72f72086c0 R15: 00007f72f5c7b000
[ 62.057961][ T8152] </TASK>
[ 62.058735][ T8152] ---[ end trace d948954eb385fb99 ]---
[ 64.410009][ T2470] result_service: raw_upload, RESULT_MNT: /internal-lkp-server/result, RESULT_ROOT: /internal-lkp-server/result/trinity/group-03-300s/vm-snb/debian-10.4-x86_64-20200603.cgz/x86_64-kexec/gcc-9/f7cf7134e405062bf0f22c3ba5637241c4c4d06a/3, TMP_RESULT_ROOT: /tmp/lkp/result
[ 64.410031][ T2470]
[ 64.429418][ T2470] run-job /lkp/jobs/scheduled/vm-snb-123/trinity-group-03-300s-debian-10.4-x86_64-20200603.cgz-f7cf7134e405062bf0f22c3ba5637241c4c4d06a-20220115-27780-1ajh2ux-5.yaml
[ 64.429432][ T2470]
[ 66.886071][ T2470] /usr/bin/wget -q --timeout=1800 --tries=1 --local-encoding=UTF-8 http://internal-lkp-server:80/~lkp/cgi-bin/lkp-jobfile-append-var?job_fil... -O /dev/null
[ 66.886087][ T2470]
[ 66.900236][ T2470] target ucode:
[ 66.900245][ T2470]
[ 66.907783][ T2470] Seeding trinity by 3185738815 based on vm-snb/debian-10.4-x86_64-20200603.cgz/x86_64-kexec
[ 66.907811][ T2470]
[ 75.752629][ T2470] 2022-01-15 08:08:38 chroot --userspec nobody:nogroup / trinity -q -q -l off -s 3185738815 -N 999999999 -c add_key -c bpf -c clock_adjtime -c clone3 -c copy_file_range -c creat -c epoll_create1 -c fadvise64_64 -c fchdir -c fdatasync -c geteuid16 -c getgroups -c gettimeofday -c inotify_init -c io_uring_register -c io_uring_setup -c ioctl -c kcmp -c keyctl -c lsetxattr -c lstat -c mkdirat -c mknod -c mknodat -c mmap2 -c mq_getsetattr -c munlockall -c olduname -c openat -c perf_event_open -c personality -c pidfd_open -c poll -c prctl -c preadv -c process_madvise -c process_mrelease -c ptrace -c quotactl -c readlinkat -c rt_sigtimedwait -c sched_getattr -c sched_rr_get_interval -c setgid -c setgroups -c setrlimit -c setsid -c signalfd4 -c statfs -c stime -c syncfs -c timer_create -c timer_delete -c timer_gettime -c timerfd_create -c uname -c utimensat -c vm86old -c vmsplice
[ 75.752696][ T2470]
[ 80.049523][ T2470] Trinity 2021.10 Dave Jones <davej(a)codemonkey.org.uk>
[ 80.049600][ T2470]
[ 80.056064][ T2470] shm:0x7f72f73f9000-0x7f7303ff5d00 (4 pages)
[ 80.056078][ T2470]
[ 81.317675][ T2470] [main] Marking syscall add_key (64bit:248 32bit:286) as to be enabled.
[ 81.317695][ T2470]
[ 81.326020][ T2470] [main] Marking syscall bpf (64bit:321 32bit:357) as to be enabled.
[ 81.326033][ T2470]
[ 81.762673][ T2470] [main] Marking syscall clock_adjtime (64bit:305 32bit:343) as to be enabled.
[ 81.762703][ T2470]
[ 81.769765][ T2470] [main] clone3 is marked as AVOID. Skipping
[ 81.769779][ T2470]
[ 81.775664][ T2470] [main] clone3 is marked as AVOID. Skipping
[ 81.775679][ T2470]
[ 81.783066][ T2470] [main] Marking syscall clone3 (64bit:435 32bit:428) as to be enabled.
[ 81.783089][ T2470]
[ 81.932838][ T2470] [main] Marking syscall copy_file_range (64bit:326 32bit:377) as to be enabled.
[ 81.932853][ T2470]
[ 81.941437][ T2470] [main] Marking syscall creat (64bit:85 32bit:8) as to be enabled.
[ 81.941458][ T2470]
[ 81.950070][ T2470] [main] Marking syscall epoll_create1 (64bit:291 32bit:329) as to be enabled.
[ 81.950086][ T2470]
[ 81.958583][ T2470] [main] Marking 32-bit syscall fadvise64_64 (272) as to be enabled.
[ 81.958597][ T2470]
[ 81.969906][ T2470] [main] Marking syscall fchdir (64bit:81 32bit:133) as to be enabled.
[ 81.969924][ T2470]
[ 81.978369][ T2470] [main] Marking syscall fdatasync (64bit:75 32bit:148) as to be enabled.
[ 81.978384][ T2470]
[ 81.986696][ T2470] [main] Marking 32-bit syscall geteuid16 (49) as to be enabled.
[ 81.986711][ T2470]
[ 81.995106][ T2470] [main] Marking syscall getgroups (64bit:115 32bit:205) as to be enabled.
[ 81.995123][ T2470]
[ 82.004068][ T2470] [main] Marking syscall gettimeofday (64bit:96 32bit:78) as to be enabled.
[ 82.004084][ T2470]
[ 82.013067][ T2470] [main] Marking syscall inotify_init (64bit:253 32bit:291) as to be enabled.
[ 82.013081][ T2470]
To reproduce:
# build kernel
cd linux
cp config-5.16.0-rc1-00018-gf7cf7134e405 .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang
6 months, 3 weeks
- 1
- 0
[f2fs] ae7d29380b: aim7.jobs-per-min -29.5% regression
by kernel test robot
Greeting,
FYI, we noticed a -29.5% regression of aim7.jobs-per-min due to commit:
commit: ae7d29380b52b71ae325f191f5a23e3c55d8d97a ("f2fs: move f2fs to use reader-unfair rwsems")
linux-devel devel-catchup-20220112-115339
in testcase: aim7
on test machine: 88 threads 2 sockets Intel(R) Xeon(R) Gold 6238M CPU @ 2.10GHz with 128G memory
with following parameters:
disk: 4BRD_12G
md: RAID0
fs: f2fs
test: sync_disk_rw
load: 100
cpufreq_governor: performance
ucode: 0x5003006
test-description: AIM7 is a traditional UNIX system level benchmark suite which is used to test and measure the performance of multiuser system.
test-url: https://sourceforge.net/projects/aimbench/files/aim-suite7/
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
sudo bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
sudo bin/lkp run generated-yaml-file
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/load/md/rootfs/tbox_group/test/testcase/ucode:
gcc-9/performance/4BRD_12G/f2fs/x86_64-rhel-8.3/100/RAID0/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp9/sync_disk_rw/aim7/0x5003006
commit:
5fed0be858 ("f2fs: do not allow partial truncation on pinned file")
ae7d29380b ("f2fs: move f2fs to use reader-unfair rwsems")
5fed0be8583f08c1 ae7d29380b52b71ae325f191f5a
---------------- ---------------------------
%stddev %change %stddev
\ | \
9986 -29.5% 7037 ± 2% aim7.jobs-per-min
60.10 +42.0% 85.34 ± 2% aim7.time.elapsed_time
60.10 +42.0% 85.34 ± 2% aim7.time.elapsed_time.max
86439428 -3.9% 83091932 aim7.time.file_system_outputs
1281359 -39.3% 777623 ± 2% aim7.time.involuntary_context_switches
9828 +58.4% 15569 ± 2% aim7.time.minor_page_faults
615.64 +736.1% 5147 ± 3% aim7.time.system_time
31442517 +16.5% 36642201 aim7.time.voluntary_context_switches
4.559e+09 -53.8% 2.106e+09 ± 2% cpuidle..time
37900818 -25.2% 28336793 cpuidle..usage
87.17 -66.1% 29.53 iostat.cpu.idle
12.56 +458.8% 70.21 iostat.cpu.system
97.84 +25.6% 122.93 ± 2% uptime.boot
7391 -33.3% 4927 ± 2% uptime.idle
86.87 -58.9 27.97 mpstat.cpu.all.idle%
0.08 ± 4% +0.0 0.10 ± 3% mpstat.cpu.all.soft%
11.77 ± 2% +58.9 70.66 mpstat.cpu.all.sys%
4283600 ± 2% -18.4% 3494620 numa-numastat.node0.local_node
4315959 ± 2% -17.8% 3548872 numa-numastat.node0.numa_hit
32393 ± 72% +67.5% 54268 ± 47% numa-numastat.node0.other_node
4410143 ± 2% -13.5% 3814709 numa-numastat.node1.local_node
4458005 ± 2% -13.9% 3840509 numa-numastat.node1.numa_hit
86.67 -66.7% 28.83 vmstat.cpu.id
12.00 +479.2% 69.50 vmstat.cpu.sy
681522 -31.3% 467982 ± 2% vmstat.io.bo
9.50 ± 14% +559.6% 62.67 ± 3% vmstat.procs.r
1130721 -26.4% 832054 vmstat.system.cs
241362 +28.1% 309224 ± 2% vmstat.system.in
4741 ± 16% +38.9% 6586 ± 4% numa-meminfo.node0.Active
3366 ± 22% +55.6% 5238 ± 2% numa-meminfo.node0.Active(file)
62647 ± 37% +46.7% 91892 ± 5% numa-meminfo.node0.AnonHugePages
42198 -10.7% 37704 numa-meminfo.node0.Inactive(file)
20873 ± 7% +263.7% 75922 ± 3% numa-meminfo.node1.Active
18875 ± 5% +284.6% 72600 ± 3% numa-meminfo.node1.Active(anon)
8222009 ± 11% -14.1% 7060246 numa-meminfo.node1.MemUsed
21222 ± 15% +279.1% 80445 ± 4% numa-meminfo.node1.Shmem
25611 ± 4% +222.1% 82495 ± 2% meminfo.Active
20249 ± 5% +265.2% 73947 ± 3% meminfo.Active(anon)
5361 +59.4% 8547 ± 2% meminfo.Active(file)
79548 ± 2% +25.0% 99404 meminfo.AnonHugePages
471804 +13.2% 533993 meminfo.Committed_AS
83994 -10.1% 75494 meminfo.Inactive(file)
33692 +18.6% 39975 meminfo.Mapped
18331540 -9.6% 16570933 meminfo.Memused
30210 ± 3% +196.4% 89534 ± 2% meminfo.Shmem
421.67 ± 16% +261.4% 1524 ± 25% meminfo.Writeback
18333046 -9.6% 16571871 meminfo.max_used_kB
843.50 ± 22% +54.3% 1301 ± 2% numa-vmstat.node0.nr_active_file
5859 ± 5% -19.9% 4694 ± 6% numa-vmstat.node0.nr_dirty
10613 -10.8% 9469 numa-vmstat.node0.nr_inactive_file
87.83 ± 14% +123.7% 196.50 ± 14% numa-vmstat.node0.nr_writeback
843.50 ± 22% +54.3% 1301 ± 2% numa-vmstat.node0.nr_zone_active_file
10612 -10.8% 9468 numa-vmstat.node0.nr_zone_inactive_file
4715 ± 6% -16.6% 3932 ± 2% numa-vmstat.node0.nr_zone_write_pending
4719 ± 5% +283.2% 18083 ± 3% numa-vmstat.node1.nr_active_anon
5794 ± 6% -16.7% 4825 ± 3% numa-vmstat.node1.nr_dirty
5305 ± 15% +278.0% 20055 ± 4% numa-vmstat.node1.nr_shmem
90.50 ± 26% +175.5% 249.33 ± 23% numa-vmstat.node1.nr_writeback
4719 ± 5% +283.2% 18083 ± 3% numa-vmstat.node1.nr_zone_active_anon
470.00 +332.3% 2031 turbostat.Avg_MHz
17.09 +55.9 72.99 turbostat.Busy%
2756 +1.2% 2790 turbostat.Bzy_MHz
4832185 ± 29% +189.7% 13997496 turbostat.C1
4.71 ± 21% +2.5 7.22 ± 2% turbostat.C1%
32770400 ± 3% -58.9% 13472485 ± 5% turbostat.C1E
77.56 ± 2% -62.5 15.07 ± 24% turbostat.C1E%
82.74 -68.0% 26.45 ± 2% turbostat.CPU%c1
15217938 +79.6% 27338167 ± 3% turbostat.IRQ
54.83 ± 2% +9.1% 59.83 turbostat.PkgTmp
160.79 +28.0% 205.81 turbostat.PkgWatt
59.09 -1.7% 58.08 turbostat.RAMWatt
5062 ± 5% +264.5% 18454 ± 3% proc-vmstat.nr_active_anon
1343 +58.6% 2131 ± 2% proc-vmstat.nr_active_file
10793103 -4.0% 10363097 proc-vmstat.nr_dirtied
11341 ± 8% -16.2% 9501 ± 5% proc-vmstat.nr_dirty
2815716 +1.6% 2860587 proc-vmstat.nr_dirty_background_threshold
5638317 +1.6% 5728170 proc-vmstat.nr_dirty_threshold
672198 +2.0% 685521 proc-vmstat.nr_file_pages
28330298 +1.6% 28780970 proc-vmstat.nr_free_pages
67873 +1.9% 69136 proc-vmstat.nr_inactive_anon
21033 -9.9% 18942 proc-vmstat.nr_inactive_file
8675 +18.2% 10252 proc-vmstat.nr_mapped
7552 ± 3% +196.0% 22356 ± 2% proc-vmstat.nr_shmem
34114 -2.3% 33345 proc-vmstat.nr_slab_reclaimable
108.17 ± 20% +213.4% 339.00 ± 24% proc-vmstat.nr_writeback
10750072 -4.0% 10322312 proc-vmstat.nr_written
5062 ± 5% +264.5% 18454 ± 3% proc-vmstat.nr_zone_active_anon
1343 +58.6% 2131 ± 2% proc-vmstat.nr_zone_active_file
67873 +1.9% 69136 proc-vmstat.nr_zone_inactive_anon
21033 -9.9% 18942 proc-vmstat.nr_zone_inactive_file
3378 ± 56% +146.0% 8311 ± 4% proc-vmstat.numa_hint_faults
1457 ± 8% +294.8% 5755 ± 6% proc-vmstat.numa_hint_faults_local
8776462 -15.9% 7383648 proc-vmstat.numa_hit
8696206 -16.0% 7303617 proc-vmstat.numa_local
15818 ± 3% +100.9% 31783 ± 2% proc-vmstat.pgactivate
8782994 -15.8% 7390981 proc-vmstat.pgalloc_normal
9872 -33.0% 6619 ± 5% proc-vmstat.pgdeactivate
336621 +26.8% 426692 proc-vmstat.pgfault
1729958 +3.2% 1785095 proc-vmstat.pgfree
43029672 -4.0% 41320056 proc-vmstat.pgpgout
19184 +33.1% 25526 ± 2% proc-vmstat.pgreuse
19740 -33.8% 13069 ± 5% proc-vmstat.pgrotated
20.10 -36.3% 12.81 ± 16% perf-stat.i.MPKI
3.247e+09 +72.3% 5.595e+09 perf-stat.i.branch-instructions
49471611 +14.9% 56863231 perf-stat.i.branch-misses
74274177 -9.7% 67105184 perf-stat.i.cache-misses
3.805e+08 -17.0% 3.159e+08 perf-stat.i.cache-references
1172746 -27.3% 852035 perf-stat.i.context-switches
2.52 +162.9% 6.62 perf-stat.i.cpi
4.155e+10 +334.2% 1.804e+11 perf-stat.i.cpu-cycles
27547 +277.9% 104108 perf-stat.i.cpu-migrations
1358 ± 18% +108.2% 2827 ± 8% perf-stat.i.cycles-between-cache-misses
4.93e+09 +43.7% 7.085e+09 perf-stat.i.dTLB-loads
247528 ± 14% -26.4% 182234 ± 12% perf-stat.i.dTLB-store-misses
2.138e+09 -20.9% 1.691e+09 perf-stat.i.dTLB-stores
34.57 +1.5 36.07 perf-stat.i.iTLB-load-miss-rate%
8159970 -30.4% 5679094 perf-stat.i.iTLB-load-misses
15727527 ± 2% -35.2% 10189152 ± 2% perf-stat.i.iTLB-loads
1.674e+10 +53.8% 2.575e+10 perf-stat.i.instructions
2237 ± 2% +98.8% 4449 perf-stat.i.instructions-per-iTLB-miss
0.42 -56.9% 0.18 ± 3% perf-stat.i.ipc
2.04 ± 14% -32.3% 1.38 ± 4% perf-stat.i.major-faults
0.47 +334.1% 2.05 perf-stat.i.metric.GHz
779.41 -13.6% 673.23 ± 4% perf-stat.i.metric.K/sec
121.52 +37.3% 166.82 perf-stat.i.metric.M/sec
33046641 -10.2% 29663692 perf-stat.i.node-load-misses
2971803 -17.1% 2463013 perf-stat.i.node-loads
12732074 -3.7% 12258498 perf-stat.i.node-store-misses
1090369 -12.3% 955946 perf-stat.i.node-stores
22.73 -46.0% 12.27 perf-stat.overall.MPKI
1.52 -0.5 1.02 perf-stat.overall.branch-miss-rate%
19.52 +1.7 21.25 perf-stat.overall.cache-miss-rate%
2.48 +182.3% 7.01 perf-stat.overall.cpi
559.56 +380.7% 2689 ± 2% perf-stat.overall.cycles-between-cache-misses
0.07 ± 13% -0.0 0.05 ± 11% perf-stat.overall.dTLB-load-miss-rate%
34.17 ± 2% +1.6 35.79 perf-stat.overall.iTLB-load-miss-rate%
2051 +121.0% 4535 perf-stat.overall.instructions-per-iTLB-miss
0.40 -64.6% 0.14 perf-stat.overall.ipc
3.193e+09 +73.2% 5.531e+09 perf-stat.ps.branch-instructions
48643841 +15.5% 56199324 perf-stat.ps.branch-misses
73025585 -9.2% 66338505 perf-stat.ps.cache-misses
3.741e+08 -16.5% 3.122e+08 perf-stat.ps.cache-references
1153030 -26.9% 842339 perf-stat.ps.context-switches
4.086e+10 +336.6% 1.784e+11 perf-stat.ps.cpu-cycles
27084 +280.0% 102925 perf-stat.ps.cpu-migrations
4.847e+09 +44.5% 7.004e+09 perf-stat.ps.dTLB-loads
243374 ± 14% -26.0% 180166 ± 12% perf-stat.ps.dTLB-store-misses
2.102e+09 -20.5% 1.672e+09 perf-stat.ps.dTLB-stores
8023041 -30.0% 5614109 perf-stat.ps.iTLB-load-misses
15463612 ± 2% -34.9% 10072675 ± 2% perf-stat.ps.iTLB-loads
1.646e+10 +54.6% 2.546e+10 perf-stat.ps.instructions
2.00 ± 14% -32.1% 1.36 ± 4% perf-stat.ps.major-faults
32491089 -9.7% 29325249 perf-stat.ps.node-load-misses
2921840 -16.6% 2435439 perf-stat.ps.node-loads
12518012 -3.2% 12117861 perf-stat.ps.node-store-misses
1072024 -11.9% 944630 perf-stat.ps.node-stores
1.005e+12 +118.6% 2.197e+12 ± 2% perf-stat.total.instructions
15594 ± 16% +45.4% 22671 ± 10% softirqs.CPU0.RCU
14850 ± 7% +133.8% 34724 ± 5% softirqs.CPU0.SCHED
14323 ± 11% +53.3% 21957 ± 13% softirqs.CPU1.RCU
11722 ± 10% +172.4% 31935 ± 4% softirqs.CPU1.SCHED
13111 ± 15% +59.0% 20845 ± 10% softirqs.CPU10.RCU
10036 ± 4% +202.4% 30354 ± 5% softirqs.CPU10.SCHED
13361 ± 15% +55.0% 20716 ± 9% softirqs.CPU11.RCU
10236 ± 5% +197.3% 30430 ± 7% softirqs.CPU11.SCHED
13179 ± 14% +61.1% 21232 ± 13% softirqs.CPU12.RCU
9915 ± 4% +206.5% 30392 ± 5% softirqs.CPU12.SCHED
13082 ± 15% +55.5% 20343 ± 10% softirqs.CPU13.RCU
9949 ± 3% +204.7% 30321 ± 4% softirqs.CPU13.SCHED
13260 ± 14% +56.2% 20717 ± 9% softirqs.CPU14.RCU
9969 ± 3% +201.4% 30043 ± 4% softirqs.CPU14.SCHED
13768 ± 13% +47.7% 20341 ± 11% softirqs.CPU15.RCU
10144 ± 3% +193.1% 29737 ± 5% softirqs.CPU15.SCHED
13700 ± 13% +48.5% 20346 ± 10% softirqs.CPU16.RCU
9920 ± 3% +202.8% 30042 ± 5% softirqs.CPU16.SCHED
13804 ± 14% +47.8% 20404 ± 10% softirqs.CPU17.RCU
10030 ± 3% +199.4% 30033 ± 5% softirqs.CPU17.SCHED
13889 ± 14% +47.2% 20444 ± 10% softirqs.CPU18.RCU
10285 ± 8% +192.9% 30126 ± 5% softirqs.CPU18.SCHED
13482 ± 14% +49.2% 20117 ± 9% softirqs.CPU19.RCU
10030 ± 3% +199.9% 30086 ± 3% softirqs.CPU19.SCHED
15054 ± 19% +42.0% 21373 ± 11% softirqs.CPU2.RCU
11006 ± 4% +182.8% 31123 ± 4% softirqs.CPU2.SCHED
13569 ± 12% +49.6% 20304 ± 10% softirqs.CPU20.RCU
9844 ± 4% +207.8% 30299 ± 4% softirqs.CPU20.SCHED
13941 ± 16% +50.8% 21020 ± 11% softirqs.CPU21.RCU
9811 ± 3% +206.5% 30066 ± 5% softirqs.CPU21.SCHED
12972 ± 14% +54.6% 20059 ± 10% softirqs.CPU22.RCU
9679 ± 3% +212.7% 30265 ± 5% softirqs.CPU22.SCHED
13435 ± 17% +53.7% 20644 ± 13% softirqs.CPU23.RCU
9796 ± 6% +214.1% 30770 ± 8% softirqs.CPU23.SCHED
13576 ± 16% +47.7% 20056 ± 10% softirqs.CPU24.RCU
10581 ± 8% +182.6% 29905 ± 5% softirqs.CPU24.SCHED
13236 ± 16% +51.6% 20063 ± 10% softirqs.CPU25.RCU
9885 ± 6% +206.1% 30263 ± 4% softirqs.CPU25.SCHED
13172 ± 11% +50.2% 19788 ± 10% softirqs.CPU26.RCU
10010 ± 8% +198.4% 29874 ± 4% softirqs.CPU26.SCHED
13037 ± 14% +52.5% 19881 ± 10% softirqs.CPU27.RCU
9716 ± 4% +209.3% 30053 ± 4% softirqs.CPU27.SCHED
12829 ± 14% +54.1% 19765 ± 10% softirqs.CPU28.RCU
9672 ± 4% +210.6% 30042 ± 4% softirqs.CPU28.SCHED
12939 ± 15% +53.0% 19796 ± 10% softirqs.CPU29.RCU
9973 ± 7% +202.2% 30142 ± 5% softirqs.CPU29.SCHED
13793 ± 14% +54.8% 21348 ± 7% softirqs.CPU3.RCU
10817 ± 13% +185.0% 30825 ± 5% softirqs.CPU3.SCHED
12821 ± 13% +56.0% 19998 ± 10% softirqs.CPU30.RCU
9676 ± 5% +211.8% 30168 ± 5% softirqs.CPU30.SCHED
12772 ± 14% +56.7% 20015 ± 10% softirqs.CPU31.RCU
9650 ± 4% +210.7% 29983 ± 4% softirqs.CPU31.SCHED
13231 ± 14% +50.4% 19895 ± 10% softirqs.CPU32.RCU
9782 ± 5% +205.7% 29907 ± 4% softirqs.CPU32.SCHED
12832 ± 13% +55.8% 19995 ± 11% softirqs.CPU33.RCU
9703 ± 4% +211.1% 30192 ± 5% softirqs.CPU33.SCHED
12857 ± 14% +54.8% 19902 ± 10% softirqs.CPU34.RCU
9668 ± 5% +209.8% 29956 ± 4% softirqs.CPU34.SCHED
13075 ± 14% +54.7% 20226 ± 8% softirqs.CPU35.RCU
9883 ± 5% +207.8% 30422 ± 4% softirqs.CPU35.SCHED
13074 ± 14% +51.6% 19820 ± 10% softirqs.CPU36.RCU
9789 ± 5% +204.2% 29781 ± 4% softirqs.CPU36.SCHED
13072 ± 13% +53.9% 20124 ± 9% softirqs.CPU37.RCU
9722 ± 4% +210.8% 30214 ± 3% softirqs.CPU37.SCHED
13161 ± 13% +51.2% 19903 ± 10% softirqs.CPU38.RCU
9829 ± 5% +204.9% 29973 ± 4% softirqs.CPU38.SCHED
12956 ± 13% +52.8% 19796 ± 10% softirqs.CPU39.RCU
9824 ± 7% +202.8% 29748 ± 4% softirqs.CPU39.SCHED
13886 ± 16% +47.6% 20498 ± 9% softirqs.CPU4.RCU
10478 ± 3% +190.6% 30447 ± 5% softirqs.CPU4.SCHED
12870 ± 14% +54.8% 19926 ± 9% softirqs.CPU40.RCU
9700 ± 5% +210.9% 30155 ± 4% softirqs.CPU40.SCHED
12899 ± 14% +54.5% 19929 ± 9% softirqs.CPU41.RCU
9823 ± 7% +206.9% 30144 ± 4% softirqs.CPU41.SCHED
13555 ± 16% +46.3% 19831 ± 10% softirqs.CPU42.RCU
10274 ± 17% +192.5% 30049 ± 4% softirqs.CPU42.SCHED
13219 ± 14% +53.7% 20315 ± 10% softirqs.CPU43.RCU
9797 ± 4% +207.6% 30141 ± 6% softirqs.CPU43.SCHED
11284 ± 15% +72.5% 19468 ± 10% softirqs.CPU44.RCU
9812 ± 3% +205.7% 29997 ± 4% softirqs.CPU44.SCHED
12889 ± 14% +56.4% 20156 ± 11% softirqs.CPU45.RCU
10013 ± 6% +200.2% 30059 ± 4% softirqs.CPU45.SCHED
13762 ± 11% +50.4% 20702 ± 10% softirqs.CPU46.RCU
9641 ± 3% +212.0% 30078 ± 4% softirqs.CPU46.SCHED
13505 ± 18% +51.5% 20467 ± 9% softirqs.CPU47.RCU
10177 ± 3% +198.2% 30347 ± 3% softirqs.CPU47.SCHED
13222 ± 13% +54.9% 20475 ± 11% softirqs.CPU48.RCU
9955 ± 5% +204.0% 30268 ± 4% softirqs.CPU48.SCHED
14539 ± 22% +44.4% 20997 ± 14% softirqs.CPU49.RCU
10461 ± 10% +190.1% 30343 ± 4% softirqs.CPU49.SCHED
14184 ± 21% +48.2% 21026 ± 8% softirqs.CPU5.RCU
10800 ± 17% +178.0% 30023 ± 3% softirqs.CPU5.SCHED
13246 ± 17% +54.2% 20424 ± 11% softirqs.CPU50.RCU
10021 ± 6% +200.5% 30112 ± 4% softirqs.CPU50.SCHED
13218 ± 14% +54.2% 20382 ± 12% softirqs.CPU51.RCU
9961 ± 6% +202.9% 30175 ± 4% softirqs.CPU51.SCHED
13569 ± 17% +49.4% 20275 ± 11% softirqs.CPU52.RCU
10494 ± 10% +187.6% 30178 ± 4% softirqs.CPU52.SCHED
13725 ± 11% +48.2% 20343 ± 11% softirqs.CPU53.RCU
9881 ± 3% +209.5% 30587 ± 5% softirqs.CPU53.SCHED
13114 ± 14% +54.1% 20214 ± 9% softirqs.CPU54.RCU
9924 ± 4% +203.4% 30112 ± 4% softirqs.CPU54.SCHED
13281 ± 11% +58.1% 20996 ± 10% softirqs.CPU55.RCU
9876 +209.5% 30563 ± 5% softirqs.CPU55.SCHED
13648 ± 13% +52.1% 20763 ± 11% softirqs.CPU56.RCU
10167 ± 10% +199.7% 30468 ± 4% softirqs.CPU56.SCHED
13037 ± 15% +59.0% 20724 ± 13% softirqs.CPU57.RCU
10429 ± 10% +197.1% 30985 ± 6% softirqs.CPU57.SCHED
13128 ± 14% +56.0% 20484 ± 10% softirqs.CPU58.RCU
9877 ± 5% +207.5% 30367 ± 4% softirqs.CPU58.SCHED
13374 ± 14% +54.9% 20714 ± 9% softirqs.CPU59.RCU
9875 ± 6% +206.2% 30240 ± 4% softirqs.CPU59.SCHED
13177 ± 16% +56.1% 20574 ± 10% softirqs.CPU6.RCU
10180 ± 2% +198.0% 30336 ± 4% softirqs.CPU6.SCHED
13724 ± 15% +48.1% 20323 ± 10% softirqs.CPU60.RCU
10147 ± 3% +195.6% 29996 ± 4% softirqs.CPU60.SCHED
13835 ± 15% +48.4% 20532 ± 9% softirqs.CPU61.RCU
10008 ± 3% +201.0% 30127 ± 5% softirqs.CPU61.SCHED
13615 ± 14% +51.4% 20618 ± 9% softirqs.CPU62.RCU
10126 ± 2% +202.1% 30595 ± 4% softirqs.CPU62.SCHED
13477 ± 12% +51.9% 20475 ± 10% softirqs.CPU63.RCU
10159 ± 3% +199.5% 30424 ± 4% softirqs.CPU63.SCHED
14068 ± 15% +47.5% 20747 ± 9% softirqs.CPU64.RCU
10076 ± 3% +200.4% 30265 ± 4% softirqs.CPU64.SCHED
14295 ± 21% +46.5% 20945 ± 11% softirqs.CPU65.RCU
10347 ± 6% +193.0% 30318 ± 5% softirqs.CPU65.SCHED
13170 ± 12% +52.8% 20122 ± 10% softirqs.CPU66.RCU
10071 ± 6% +201.5% 30364 ± 5% softirqs.CPU66.SCHED
13583 ± 17% +44.9% 19682 ± 9% softirqs.CPU67.RCU
9814 ± 4% +208.5% 30277 ± 4% softirqs.CPU67.SCHED
13084 ± 13% +51.3% 19795 ± 9% softirqs.CPU68.RCU
9851 ± 5% +203.0% 29851 ± 4% softirqs.CPU68.SCHED
12836 ± 13% +54.7% 19863 ± 9% softirqs.CPU69.RCU
9892 ± 4% +204.7% 30140 ± 4% softirqs.CPU69.SCHED
13105 ± 16% +57.4% 20624 ± 10% softirqs.CPU7.RCU
9601 ± 3% +216.1% 30345 ± 4% softirqs.CPU7.SCHED
13140 ± 14% +52.3% 20016 ± 10% softirqs.CPU70.RCU
9847 ± 7% +206.7% 30201 ± 4% softirqs.CPU70.SCHED
13201 ± 13% +51.4% 19988 ± 9% softirqs.CPU71.RCU
10234 ± 7% +197.4% 30435 ± 4% softirqs.CPU71.SCHED
13005 ± 15% +53.4% 19956 ± 9% softirqs.CPU72.RCU
9740 ± 5% +209.6% 30158 ± 4% softirqs.CPU72.SCHED
13317 ± 15% +49.6% 19923 ± 9% softirqs.CPU73.RCU
9925 ± 5% +204.4% 30215 ± 4% softirqs.CPU73.SCHED
13027 ± 13% +53.1% 19951 ± 9% softirqs.CPU74.RCU
10179 ± 8% +199.8% 30513 ± 5% softirqs.CPU74.SCHED
12208 ± 13% +61.2% 19677 ± 9% softirqs.CPU75.RCU
9781 ± 5% +211.6% 30476 ± 3% softirqs.CPU75.SCHED
12309 ± 15% +59.6% 19644 ± 10% softirqs.CPU76.RCU
10143 ± 8% +196.7% 30094 ± 4% softirqs.CPU76.SCHED
12527 ± 13% +56.5% 19611 ± 10% softirqs.CPU77.RCU
9933 ± 5% +202.9% 30091 ± 4% softirqs.CPU77.SCHED
12776 ± 16% +53.5% 19605 ± 10% softirqs.CPU78.RCU
10332 ± 11% +192.4% 30211 ± 4% softirqs.CPU78.SCHED
12602 ± 15% +57.7% 19875 ± 11% softirqs.CPU79.RCU
9976 ± 5% +203.4% 30270 ± 4% softirqs.CPU79.SCHED
13183 ± 16% +54.7% 20397 ± 11% softirqs.CPU8.RCU
9907 ± 5% +204.9% 30207 ± 5% softirqs.CPU8.SCHED
12382 ± 12% +58.3% 19599 ± 10% softirqs.CPU80.RCU
9825 ± 4% +207.8% 30240 ± 4% softirqs.CPU80.SCHED
12419 ± 13% +60.6% 19947 ± 9% softirqs.CPU81.RCU
10059 ± 6% +202.4% 30419 ± 4% softirqs.CPU81.SCHED
12328 ± 14% +59.5% 19665 ± 9% softirqs.CPU82.RCU
9790 ± 5% +209.7% 30317 ± 4% softirqs.CPU82.SCHED
12715 ± 9% +54.9% 19691 ± 9% softirqs.CPU83.RCU
10211 ± 5% +195.8% 30209 ± 4% softirqs.CPU83.SCHED
12738 ± 15% +53.3% 19524 ± 10% softirqs.CPU84.RCU
9884 ± 5% +205.2% 30163 ± 4% softirqs.CPU84.SCHED
12513 ± 13% +57.3% 19679 ± 10% softirqs.CPU85.RCU
10231 ± 9% +193.4% 30019 ± 4% softirqs.CPU85.SCHED
12497 ± 13% +58.1% 19757 ± 9% softirqs.CPU86.RCU
9836 ± 5% +207.4% 30233 ± 4% softirqs.CPU86.SCHED
12923 ± 13% +53.9% 19883 ± 10% softirqs.CPU87.RCU
9450 ± 8% +211.2% 29407 ± 5% softirqs.CPU87.SCHED
14176 ± 15% +49.2% 21145 ± 12% softirqs.CPU9.RCU
10875 ± 10% +176.8% 30098 ± 4% softirqs.CPU9.SCHED
1167122 ± 14% +52.9% 1784906 ± 10% softirqs.RCU
887322 ± 3% +200.4% 2665099 ± 4% softirqs.SCHED
50.70 -38.6 12.12 perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
50.10 -38.1 12.00 perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
50.09 -38.1 12.00 perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
50.06 -38.1 12.00 perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
45.87 -35.0 10.91 perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
45.78 -34.9 10.90 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
44.12 -33.9 10.22 perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
5.93 ± 2% -5.1 0.80 ± 7% perf-profile.calltrace.cycles-pp.find_busiest_group.load_balance.newidle_balance.pick_next_task_fair.__schedule
5.85 ± 2% -5.1 0.78 ± 7% perf-profile.calltrace.cycles-pp.update_sd_lb_stats.find_busiest_group.load_balance.newidle_balance.pick_next_task_fair
6.35 -4.6 1.73 ± 26% perf-profile.calltrace.cycles-pp.load_balance.newidle_balance.pick_next_task_fair.__schedule.schedule
4.18 ± 2% -3.8 0.36 ± 71% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.set_node_addr.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
4.47 ± 2% -3.8 0.68 ± 5% perf-profile.calltrace.cycles-pp.set_node_addr.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
4.44 ± 6% -3.2 1.21 ± 8% perf-profile.calltrace.cycles-pp.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page
4.12 ± 6% -3.0 1.08 ± 9% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page
3.39 ± 7% -2.5 0.86 ± 11% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_outplace_write_data
6.67 ± 4% -2.2 4.42 ± 5% perf-profile.calltrace.cycles-pp.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages
6.27 ± 5% -2.0 4.30 ± 6% perf-profile.calltrace.cycles-pp.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
2.60 ± 2% -1.8 0.84 ± 3% perf-profile.calltrace.cycles-pp.f2fs_issue_flush.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
2.22 -1.6 0.59 ± 4% perf-profile.calltrace.cycles-pp.pagevec_lookup_range_tag.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
2.21 -1.6 0.58 ± 5% perf-profile.calltrace.cycles-pp.find_get_pages_range_tag.pagevec_lookup_range_tag.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
2.19 ± 2% -1.5 0.74 ± 4% perf-profile.calltrace.cycles-pp.wait_for_completion.f2fs_issue_flush.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
2.15 ± 2% -1.4 0.72 ± 4% perf-profile.calltrace.cycles-pp.schedule_timeout.wait_for_completion.f2fs_issue_flush.f2fs_do_sync_file.f2fs_file_write_iter
2.11 ± 2% -1.4 0.70 ± 4% perf-profile.calltrace.cycles-pp.__schedule.schedule.schedule_timeout.wait_for_completion.f2fs_issue_flush
2.11 ± 2% -1.4 0.71 ± 3% perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.wait_for_completion.f2fs_issue_flush.f2fs_do_sync_file
1.82 ± 2% -1.2 0.58 ± 4% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.schedule_timeout.wait_for_completion
1.82 ± 2% -1.2 0.58 ± 4% perf-profile.calltrace.cycles-pp.newidle_balance.pick_next_task_fair.__schedule.schedule.schedule_timeout
2.88 ± 3% -1.0 1.88 ± 10% perf-profile.calltrace.cycles-pp.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages
2.12 ± 47% -1.0 1.12 ± 22% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle
2.68 ± 3% -0.9 1.80 ± 8% perf-profile.calltrace.cycles-pp.f2fs_submit_page_write.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages
2.38 ± 4% -0.8 1.63 ± 8% perf-profile.calltrace.cycles-pp.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_do_write_node_page.__write_node_page
2.01 ± 4% -0.4 1.61 ± 12% perf-profile.calltrace.cycles-pp.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_do_write_node_page.__write_node_page
1.62 ± 5% -0.3 1.36 ± 8% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_down_write_slowpath.f2fs_submit_page_write.do_write_page.f2fs_do_write_node_page
1.63 ± 6% +0.2 1.86 ± 5% perf-profile.calltrace.cycles-pp.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page
0.00 +0.7 0.68 ± 9% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
0.86 ± 13% +0.7 1.55 ± 6% perf-profile.calltrace.cycles-pp.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page
0.00 +0.7 0.72 ± 7% perf-profile.calltrace.cycles-pp.__schedule.schedule.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages
0.00 +0.7 0.73 ± 7% perf-profile.calltrace.cycles-pp.schedule.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
0.41 ± 73% +0.9 1.36 ± 7% perf-profile.calltrace.cycles-pp.osq_lock.__mutex_lock.f2fs_allocate_data_block.do_write_page.f2fs_outplace_write_data
0.00 +1.0 1.01 ± 7% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.__submit_merged_write_cond.f2fs_fsync_node_pages
0.00 +1.1 1.10 ± 8% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.do_write_page.f2fs_outplace_write_data
0.00 +1.1 1.11 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page
0.00 +1.1 1.11 ± 8% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.__submit_merged_write_cond.f2fs_write_cache_pages
0.00 +1.1 1.12 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages
0.00 +1.1 1.12 ± 8% perf-profile.calltrace.cycles-pp.finish_wait.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
0.00 +1.2 1.22 ± 8% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.do_write_page.f2fs_outplace_write_data.f2fs_do_write_data_page.f2fs_write_single_data_page
0.00 +1.3 1.28 ± 9% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.__write_node_page
0.00 +1.3 1.28 ± 7% perf-profile.calltrace.cycles-pp.__schedule.schedule.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file
0.00 +1.3 1.28 ± 9% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages
0.00 +1.3 1.28 ± 9% perf-profile.calltrace.cycles-pp.finish_wait.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
0.00 +1.3 1.28 ± 7% perf-profile.calltrace.cycles-pp.schedule.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
0.00 +1.3 1.34 ± 7% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file
0.00 +1.3 1.34 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter
0.00 +1.3 1.35 ± 7% perf-profile.calltrace.cycles-pp.finish_wait.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
0.00 +1.5 1.49 ± 17% perf-profile.calltrace.cycles-pp.newidle_balance.pick_next_task_fair.__schedule.schedule.__submit_merged_write_cond
0.00 +1.7 1.68 ± 8% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages
0.00 +1.7 1.68 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file
0.00 +1.7 1.68 ± 8% perf-profile.calltrace.cycles-pp.finish_wait.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
0.00 +1.7 1.74 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page
0.00 +1.7 1.74 ± 8% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page
0.00 +1.7 1.74 ± 8% perf-profile.calltrace.cycles-pp.finish_wait.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
0.00 +2.0 2.01 ± 8% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file
0.00 +2.0 2.01 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter
0.00 +2.0 2.02 ± 7% perf-profile.calltrace.cycles-pp.finish_wait.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
0.00 +2.6 2.56 ± 9% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.finish_wait.__submit_merged_write_cond.f2fs_fsync_node_pages
0.00 +2.6 2.57 ± 9% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.finish_wait.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file
0.00 +2.6 2.57 ± 9% perf-profile.calltrace.cycles-pp.finish_wait.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
14.92 +3.0 17.94 ± 2% perf-profile.calltrace.cycles-pp.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
0.00 +3.0 3.02 ± 10% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.do_write_page.f2fs_do_write_node_page
0.00 +3.0 3.03 ± 10% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.do_write_page.f2fs_do_write_node_page.__write_node_page
9.30 ± 3% +3.1 12.38 ± 4% perf-profile.calltrace.cycles-pp.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc
9.10 ± 3% +3.2 12.33 ± 4% perf-profile.calltrace.cycles-pp.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
0.00 +3.3 3.26 ± 9% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.do_write_page.f2fs_do_write_node_page.__write_node_page.f2fs_fsync_node_pages
2.61 ± 2% +3.3 5.89 ± 7% perf-profile.calltrace.cycles-pp.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
2.02 ± 3% +3.7 5.75 ± 8% perf-profile.calltrace.cycles-pp.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
0.00 +3.9 3.89 ± 7% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages
0.00 +3.9 3.90 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
0.00 +4.0 4.05 ± 8% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.__write_node_page
0.00 +4.1 4.06 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages
0.00 +4.1 4.11 ± 8% perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_get_node_info.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file
0.00 +4.2 4.19 ± 7% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file
0.00 +4.2 4.20 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter
0.00 +4.2 4.24 ± 7% perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_need_inode_block_update.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
0.00 +4.3 4.33 ± 7% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.__write_node_page.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
0.00 +5.2 5.20 ± 8% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages
0.00 +5.2 5.22 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file
2.10 ± 2% +5.3 7.37 ± 8% perf-profile.calltrace.cycles-pp.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
0.00 +5.3 5.27 ± 8% perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_need_dentry_mark.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
0.00 +5.5 5.54 ± 9% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page
0.00 +5.6 5.56 ± 9% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page
0.00 +5.6 5.61 ± 9% perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages
1.76 +6.0 7.71 ± 9% perf-profile.calltrace.cycles-pp.f2fs_get_node_info.f2fs_do_write_data_page.f2fs_write_single_data_page.f2fs_write_cache_pages.f2fs_write_data_pages
0.00 +6.1 6.07 ± 8% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_write_cache_pages
2.92 +6.1 9.02 ± 8% perf-profile.calltrace.cycles-pp.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc
0.00 +6.1 6.11 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages
0.00 +6.2 6.20 ± 8% perf-profile.calltrace.cycles-pp.prepare_to_wait_event.__submit_merged_write_cond.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages
0.00 +6.4 6.38 ± 8% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file
0.00 +6.4 6.39 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter
2.49 +6.4 8.92 ± 8% perf-profile.calltrace.cycles-pp.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
0.00 +6.5 6.46 ± 8% perf-profile.calltrace.cycles-pp.prepare_to_wait_event.f2fs_is_checkpointed_node.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
12.99 ± 2% +8.6 21.62 ± 3% perf-profile.calltrace.cycles-pp.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
12.94 ± 2% +8.7 21.60 ± 3% perf-profile.calltrace.cycles-pp.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
12.92 ± 2% +8.7 21.59 ± 3% perf-profile.calltrace.cycles-pp.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file.f2fs_file_write_iter
12.91 ± 2% +8.7 21.59 ± 3% perf-profile.calltrace.cycles-pp.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range.f2fs_do_sync_file
12.76 ± 2% +8.8 21.55 ± 3% perf-profile.calltrace.cycles-pp.f2fs_write_cache_pages.f2fs_write_data_pages.do_writepages.filemap_fdatawrite_wbc.file_write_and_wait_range
0.00 +16.7 16.72 ± 9% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_fsync_node_pages
0.00 +16.8 16.76 ± 9% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.prepare_to_wait_event.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file
0.00 +16.9 16.94 ± 9% perf-profile.calltrace.cycles-pp.prepare_to_wait_event.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter
2.11 +19.9 22.02 ± 9% perf-profile.calltrace.cycles-pp.__submit_merged_write_cond.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write
22.57 +25.6 48.22 ± 2% perf-profile.calltrace.cycles-pp.f2fs_fsync_node_pages.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write
47.24 +40.1 87.29 perf-profile.calltrace.cycles-pp.write
46.97 +40.2 87.20 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.write
46.96 +40.2 87.19 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
46.88 +40.3 87.17 perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
46.87 +40.3 87.16 perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.write
46.76 +40.4 87.14 perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
46.74 +40.4 87.13 perf-profile.calltrace.cycles-pp.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
45.18 +41.5 86.71 perf-profile.calltrace.cycles-pp.f2fs_do_sync_file.f2fs_file_write_iter.new_sync_write.vfs_write.ksys_write
50.70 -38.6 12.12 perf-profile.children.cycles-pp.secondary_startup_64_no_verify
50.70 -38.6 12.12 perf-profile.children.cycles-pp.cpu_startup_entry
50.68 -38.6 12.12 perf-profile.children.cycles-pp.do_idle
50.10 -38.1 12.00 perf-profile.children.cycles-pp.start_secondary
46.42 -35.4 11.02 perf-profile.children.cycles-pp.cpuidle_enter
46.41 -35.4 11.02 perf-profile.children.cycles-pp.cpuidle_enter_state
45.06 -34.2 10.90 perf-profile.children.cycles-pp.intel_idle
10.73 -10.7 0.00 perf-profile.children.cycles-pp.rwsem_down_read_slowpath
12.40 ± 2% -8.5 3.88 ± 5% perf-profile.children.cycles-pp.rwsem_down_write_slowpath
11.66 -6.5 5.13 ± 2% perf-profile.children.cycles-pp.__schedule
10.20 -5.5 4.66 ± 3% perf-profile.children.cycles-pp.schedule
8.46 -4.7 3.80 ± 3% perf-profile.children.cycles-pp.pick_next_task_fair
4.54 ± 3% -4.4 0.11 ± 4% perf-profile.children.cycles-pp._raw_spin_lock_irq
7.97 -4.3 3.66 ± 3% perf-profile.children.cycles-pp.newidle_balance
7.12 ± 3% -4.1 3.02 ± 8% perf-profile.children.cycles-pp.f2fs_submit_page_write
6.94 -4.0 2.91 ± 4% perf-profile.children.cycles-pp.find_busiest_group
6.87 -4.0 2.88 ± 4% perf-profile.children.cycles-pp.update_sd_lb_stats
7.35 -4.0 3.38 ± 4% perf-profile.children.cycles-pp.load_balance
9.31 ± 3% -3.8 5.50 ± 7% perf-profile.children.cycles-pp.osq_lock
4.48 ± 2% -3.8 0.68 ± 5% perf-profile.children.cycles-pp.set_node_addr
2.72 -2.5 0.20 ± 2% perf-profile.children.cycles-pp.rwsem_wake
6.67 ± 4% -2.2 4.43 ± 5% perf-profile.children.cycles-pp.f2fs_outplace_write_data
2.19 -2.0 0.15 ± 5% perf-profile.children.cycles-pp.wake_up_q
2.44 -1.9 0.56 perf-profile.children.cycles-pp.__submit_bio
2.44 -1.9 0.56 ± 2% perf-profile.children.cycles-pp.submit_bio_noacct
2.60 ± 2% -1.8 0.84 ± 3% perf-profile.children.cycles-pp.f2fs_issue_flush
2.27 -1.7 0.60 ± 5% perf-profile.children.cycles-pp.pagevec_lookup_range_tag
2.27 -1.7 0.60 ± 5% perf-profile.children.cycles-pp.find_get_pages_range_tag
2.19 ± 2% -1.5 0.74 ± 4% perf-profile.children.cycles-pp.wait_for_completion
2.16 ± 2% -1.4 0.73 ± 4% perf-profile.children.cycles-pp.schedule_timeout
2.46 ± 14% -1.4 1.10 ± 3% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
1.79 -1.3 0.44 ± 2% perf-profile.children.cycles-pp.__submit_merged_bio
2.56 -1.3 1.21 perf-profile.children.cycles-pp.try_to_wake_up
1.75 ± 2% -1.2 0.51 ± 2% perf-profile.children.cycles-pp.rwsem_spin_on_owner
1.38 -1.0 0.35 ± 3% perf-profile.children.cycles-pp.ret_from_fork
1.38 -1.0 0.35 ± 3% perf-profile.children.cycles-pp.kthread
1.45 ± 3% -1.0 0.46 perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
1.30 -1.0 0.32 ± 3% perf-profile.children.cycles-pp.f2fs_buffered_write_iter
1.26 ± 2% -1.0 0.30 ± 2% perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
1.28 ± 2% -1.0 0.32 ± 3% perf-profile.children.cycles-pp.generic_perform_write
1.43 -0.9 0.49 perf-profile.children.cycles-pp.schedule_idle
1.49 -0.9 0.58 ± 2% perf-profile.children.cycles-pp._raw_spin_lock
1.32 -0.9 0.42 perf-profile.children.cycles-pp.ttwu_do_activate
1.12 -0.8 0.27 ± 2% perf-profile.children.cycles-pp.brd_submit_bio
1.27 -0.8 0.43 perf-profile.children.cycles-pp.enqueue_task_fair
1.11 -0.8 0.27 ± 3% perf-profile.children.cycles-pp.brd_do_bvec
4.52 ± 2% -0.8 3.73 ± 7% perf-profile.children.cycles-pp.f2fs_allocate_data_block
0.95 ± 5% -0.8 0.18 ± 2% perf-profile.children.cycles-pp.menu_select
1.01 ± 4% -0.7 0.32 ± 2% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
1.00 ± 4% -0.7 0.32 perf-profile.children.cycles-pp.hrtimer_interrupt
1.00 -0.7 0.34 ± 2% perf-profile.children.cycles-pp.sched_ttwu_pending
0.96 ± 2% -0.6 0.32 ± 2% perf-profile.children.cycles-pp.enqueue_entity
1.18 ± 2% -0.6 0.55 ± 2% perf-profile.children.cycles-pp.dequeue_task_fair
0.84 -0.6 0.26 ± 3% perf-profile.children.cycles-pp.issue_flush_thread
1.05 ± 2% -0.6 0.47 ± 4% perf-profile.children.cycles-pp.idle_cpu
1.03 ± 2% -0.6 0.47 ± 3% perf-profile.children.cycles-pp.dequeue_entity
0.71 ± 3% -0.5 0.17 ± 4% perf-profile.children.cycles-pp.f2fs_write_begin
0.71 ± 3% -0.5 0.19 ± 3% perf-profile.children.cycles-pp.folio_mark_dirty
0.73 ± 2% -0.5 0.21 ± 9% perf-profile.children.cycles-pp.__pagevec_release
0.68 -0.5 0.17 ± 4% perf-profile.children.cycles-pp.f2fs_write_end_io
0.72 ± 2% -0.5 0.21 ± 8% perf-profile.children.cycles-pp.release_pages
0.61 ± 19% -0.5 0.12 ± 27% perf-profile.children.cycles-pp.start_kernel
0.91 -0.5 0.43 perf-profile.children.cycles-pp.update_load_avg
0.58 -0.4 0.14 ± 3% perf-profile.children.cycles-pp.brd_insert_page
0.52 ± 2% -0.4 0.09 ± 5% perf-profile.children.cycles-pp.worker_thread
0.47 ± 5% -0.4 0.04 ± 45% perf-profile.children.cycles-pp.ktime_get
0.63 ± 2% -0.4 0.25 ± 4% perf-profile.children.cycles-pp.cpumask_next_and
0.44 ± 2% -0.4 0.08 ± 6% perf-profile.children.cycles-pp.md_submit_bio
0.43 -0.4 0.06 ± 7% perf-profile.children.cycles-pp.__submit_flush_wait
0.49 -0.4 0.13 ± 6% perf-profile.children.cycles-pp.xas_find_marked
0.42 ± 2% -0.4 0.06 ± 7% perf-profile.children.cycles-pp.blkdev_issue_flush
0.51 ± 3% -0.4 0.16 ± 5% perf-profile.children.cycles-pp.ttwu_queue_wakelist
0.41 ± 2% -0.3 0.06 ± 7% perf-profile.children.cycles-pp.submit_bio_wait
0.48 ± 5% -0.3 0.14 ± 3% perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
0.48 ± 4% -0.3 0.14 ± 3% perf-profile.children.cycles-pp.filemap_dirty_folio
0.41 ± 2% -0.3 0.07 ± 8% perf-profile.children.cycles-pp.__lookup_nat_cache
0.47 ± 2% -0.3 0.13 ± 3% perf-profile.children.cycles-pp.__get_node_page
0.66 ± 3% -0.3 0.33 ± 5% perf-profile.children.cycles-pp.mutex_spin_on_owner
0.35 ± 7% -0.3 0.03 ± 70% perf-profile.children.cycles-pp.clockevents_program_event
0.43 ± 6% -0.3 0.12 ± 4% perf-profile.children.cycles-pp.f2fs_set_node_page_dirty
0.37 ± 2% -0.3 0.06 perf-profile.children.cycles-pp.md_handle_request
0.40 ± 2% -0.3 0.10 ± 5% perf-profile.children.cycles-pp.folio_end_writeback
0.54 ± 4% -0.3 0.23 ± 2% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.53 ± 3% -0.3 0.22 ± 4% perf-profile.children.cycles-pp._find_next_bit
0.40 ± 3% -0.3 0.10 ± 3% perf-profile.children.cycles-pp.pagecache_get_page
0.46 ± 2% -0.3 0.17 ± 2% perf-profile.children.cycles-pp.update_rq_clock
0.39 ± 2% -0.3 0.10 ± 3% perf-profile.children.cycles-pp.__filemap_get_folio
0.38 -0.3 0.09 ± 6% perf-profile.children.cycles-pp.f2fs_write_end
0.43 ± 4% -0.3 0.15 ± 6% perf-profile.children.cycles-pp.__folio_start_writeback
0.34 ± 13% -0.3 0.06 perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.36 ± 3% -0.3 0.09 ± 6% perf-profile.children.cycles-pp.__folio_end_writeback
0.33 ± 2% -0.3 0.06 ± 9% perf-profile.children.cycles-pp.raid0_make_request
0.37 ± 2% -0.3 0.10 ± 3% perf-profile.children.cycles-pp.f2fs_submit_merged_ipu_write
0.38 ± 5% -0.3 0.11 ± 10% perf-profile.children.cycles-pp.up_read
0.36 -0.3 0.09 ± 5% perf-profile.children.cycles-pp.f2fs_is_valid_blkaddr
0.37 ± 6% -0.3 0.11 ± 5% perf-profile.children.cycles-pp.f2fs_set_data_blkaddr
0.37 ± 6% -0.3 0.11 ± 5% perf-profile.children.cycles-pp.f2fs_update_data_blkaddr
0.32 ± 3% -0.3 0.06 ± 6% perf-profile.children.cycles-pp.process_one_work
0.52 ± 3% -0.3 0.26 ± 3% perf-profile.children.cycles-pp.update_curr
0.30 ± 4% -0.2 0.06 ± 13% perf-profile.children.cycles-pp.__radix_tree_lookup
0.32 ± 2% -0.2 0.09 ± 5% perf-profile.children.cycles-pp.down_write
0.32 ± 3% -0.2 0.09 perf-profile.children.cycles-pp.set_next_entity
0.29 ± 3% -0.2 0.07 ± 8% perf-profile.children.cycles-pp.f2fs_update_inode_page
0.30 ± 3% -0.2 0.08 ± 4% perf-profile.children.cycles-pp.f2fs_write_inode
0.36 ± 3% -0.2 0.14 ± 3% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.48 ± 4% -0.2 0.27 ± 2% perf-profile.children.cycles-pp.finish_task_switch
0.28 -0.2 0.07 ± 10% perf-profile.children.cycles-pp.f2fs_set_data_page_dirty
0.39 ± 6% -0.2 0.18 ± 2% perf-profile.children.cycles-pp.tick_sched_timer
0.29 ± 5% -0.2 0.09 ± 5% perf-profile.children.cycles-pp.__folio_mark_dirty
0.32 -0.2 0.12 perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
0.27 -0.2 0.08 ± 10% perf-profile.children.cycles-pp.update_sit_entry
0.28 ± 4% -0.2 0.09 ± 4% perf-profile.children.cycles-pp.flush_smp_call_function_queue
0.36 ± 6% -0.2 0.17 ± 2% perf-profile.children.cycles-pp.tick_sched_handle
0.35 ± 6% -0.2 0.17 ± 2% perf-profile.children.cycles-pp.update_process_times
0.30 ± 5% -0.2 0.13 ± 4% perf-profile.children.cycles-pp.irq_exit_rcu
0.33 ± 3% -0.2 0.15 ± 3% perf-profile.children.cycles-pp.__list_del_entry_valid
0.24 ± 3% -0.2 0.07 perf-profile.children.cycles-pp.__switch_to
0.26 ± 4% -0.2 0.09 ± 4% perf-profile.children.cycles-pp.sched_clock_cpu
0.24 ± 5% -0.2 0.08 ± 6% perf-profile.children.cycles-pp.native_sched_clock
0.22 ± 4% -0.2 0.06 ± 6% perf-profile.children.cycles-pp.llist_add_batch
0.21 ± 5% -0.2 0.05 ± 7% perf-profile.children.cycles-pp.mutex_lock
0.22 ± 3% -0.2 0.06 perf-profile.children.cycles-pp.__smp_call_single_queue
0.24 ± 4% -0.2 0.09 ± 4% perf-profile.children.cycles-pp.__switch_to_asm
0.22 ± 8% -0.1 0.08 ± 6% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
0.19 ± 7% -0.1 0.04 ± 44% perf-profile.children.cycles-pp.llist_reverse_order
0.25 ± 5% -0.1 0.10 ± 4% perf-profile.children.cycles-pp.__softirqentry_text_start
0.22 ± 4% -0.1 0.08 ± 4% perf-profile.children.cycles-pp.__alloc_pages
0.19 ± 3% -0.1 0.05 ± 7% perf-profile.children.cycles-pp.xas_load
0.21 ± 8% -0.1 0.08 ± 6% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.17 ± 4% -0.1 0.03 ± 70% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.27 ± 4% -0.1 0.14 ± 3% perf-profile.children.cycles-pp.update_blocked_averages
0.22 -0.1 0.10 ± 4% perf-profile.children.cycles-pp.__update_load_avg_se
0.20 ± 2% -0.1 0.08 ± 6% perf-profile.children.cycles-pp.get_page_from_freelist
0.30 ± 2% -0.1 0.18 ± 2% perf-profile.children.cycles-pp.complete
0.18 ± 4% -0.1 0.06 ± 7% perf-profile.children.cycles-pp.up_write
0.17 ± 4% -0.1 0.06 perf-profile.children.cycles-pp.cpuacct_charge
0.15 ± 6% -0.1 0.04 ± 45% perf-profile.children.cycles-pp.__close
0.15 ± 6% -0.1 0.04 ± 45% perf-profile.children.cycles-pp.dput
0.14 ± 5% -0.1 0.04 ± 45% perf-profile.children.cycles-pp.__fput
0.14 ± 5% -0.1 0.04 ± 45% perf-profile.children.cycles-pp.__dentry_kill
0.14 ± 5% -0.1 0.05 ± 45% perf-profile.children.cycles-pp.task_work_run
0.14 ± 7% -0.1 0.04 ± 45% perf-profile.children.cycles-pp.evict
0.14 ± 5% -0.1 0.04 ± 45% perf-profile.children.cycles-pp.f2fs_evict_inode
0.19 ± 6% -0.1 0.10 ± 4% perf-profile.children.cycles-pp.update_cfs_group
0.10 ± 7% -0.1 0.02 ± 99% perf-profile.children.cycles-pp.rebalance_domains
0.25 ± 3% -0.1 0.17 ± 2% perf-profile.children.cycles-pp.swake_up_locked
0.20 ± 2% -0.1 0.12 ± 4% perf-profile.children.cycles-pp.scheduler_tick
0.12 ± 5% -0.1 0.05 perf-profile.children.cycles-pp.prep_new_page
0.11 ± 4% -0.1 0.05 perf-profile.children.cycles-pp.kernel_init_free_pages
0.11 ± 4% -0.1 0.05 perf-profile.children.cycles-pp.clear_page_erms
0.30 ± 5% -0.0 0.25 ± 2% perf-profile.children.cycles-pp.asm_sysvec_call_function_single
0.22 ± 8% -0.0 0.17 ± 4% perf-profile.children.cycles-pp.raw_spin_rq_lock_nested
0.09 ± 7% -0.0 0.05 perf-profile.children.cycles-pp.perf_tp_event
0.24 ± 5% -0.0 0.20 ± 2% perf-profile.children.cycles-pp.sysvec_call_function_single
0.10 ± 8% +0.1 0.15 ± 2% perf-profile.children.cycles-pp.available_idle_cpu
0.00 +0.1 0.05 ± 7% perf-profile.children.cycles-pp.set_task_cpu
0.25 ± 2% +0.1 0.32 ± 2% perf-profile.children.cycles-pp.select_task_rq_fair
0.00 +0.1 0.07 ± 18% perf-profile.children.cycles-pp.f2fs_wait_on_page_writeback
0.01 ±223% +0.1 0.09 ± 5% perf-profile.children.cycles-pp.task_tick_fair
0.00 +0.2 0.18 ± 2% perf-profile.children.cycles-pp.select_idle_cpu
0.00 +0.2 0.22 ± 4% perf-profile.children.cycles-pp.select_idle_sibling
0.00 +0.3 0.34 ± 2% perf-profile.children.cycles-pp.down_read_trylock
0.06 ± 7% +0.4 0.42 ± 3% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.07 ± 12% +0.9 0.95 perf-profile.children.cycles-pp.autoremove_wake_function
0.09 ± 8% +0.9 0.98 perf-profile.children.cycles-pp.__wake_up_common
14.92 +3.0 17.94 ± 2% perf-profile.children.cycles-pp.__write_node_page
9.30 ± 3% +3.1 12.38 ± 4% perf-profile.children.cycles-pp.f2fs_write_single_data_page
9.10 ± 3% +3.2 12.33 ± 4% perf-profile.children.cycles-pp.f2fs_do_write_data_page
2.61 ± 2% +3.3 5.89 ± 7% perf-profile.children.cycles-pp.f2fs_need_inode_block_update
2.10 ± 2% +5.3 7.37 ± 8% perf-profile.children.cycles-pp.f2fs_need_dentry_mark
2.50 +6.4 8.92 ± 8% perf-profile.children.cycles-pp.f2fs_is_checkpointed_node
12.99 ± 2% +8.6 21.62 ± 3% perf-profile.children.cycles-pp.file_write_and_wait_range
12.94 ± 2% +8.7 21.60 ± 3% perf-profile.children.cycles-pp.filemap_fdatawrite_wbc
12.92 ± 2% +8.7 21.59 ± 3% perf-profile.children.cycles-pp.do_writepages
12.91 ± 2% +8.7 21.59 ± 3% perf-profile.children.cycles-pp.f2fs_write_data_pages
12.77 ± 2% +8.8 21.55 ± 3% perf-profile.children.cycles-pp.f2fs_write_cache_pages
3.78 ± 2% +9.7 13.47 ± 9% perf-profile.children.cycles-pp.f2fs_get_node_info
0.12 ± 7% +9.8 9.89 perf-profile.children.cycles-pp.__wake_up_common_lock
0.00 +11.8 11.79 ± 3% perf-profile.children.cycles-pp.finish_wait
22.58 +25.6 48.22 ± 2% perf-profile.children.cycles-pp.f2fs_fsync_node_pages
5.04 +26.1 31.10 ± 7% perf-profile.children.cycles-pp.__submit_merged_write_cond
47.26 +40.0 87.30 perf-profile.children.cycles-pp.write
47.28 +40.0 87.31 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
47.26 +40.1 87.31 perf-profile.children.cycles-pp.do_syscall_64
46.88 +40.3 87.18 perf-profile.children.cycles-pp.ksys_write
46.87 +40.3 87.17 perf-profile.children.cycles-pp.vfs_write
46.76 +40.4 87.14 perf-profile.children.cycles-pp.new_sync_write
46.74 +40.4 87.13 perf-profile.children.cycles-pp.f2fs_file_write_iter
45.18 +41.5 86.72 perf-profile.children.cycles-pp.f2fs_do_sync_file
0.00 +48.9 48.90 perf-profile.children.cycles-pp.prepare_to_wait_event
5.34 ± 2% +64.5 69.87 perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
1.86 ± 6% +68.4 70.24 perf-profile.children.cycles-pp._raw_spin_lock_irqsave
44.69 -33.9 10.83 perf-profile.self.cycles-pp.intel_idle
9.24 ± 3% -3.8 5.46 ± 7% perf-profile.self.cycles-pp.osq_lock
5.27 -3.1 2.19 ± 4% perf-profile.self.cycles-pp.update_sd_lb_stats
1.79 -1.3 0.48 ± 5% perf-profile.self.cycles-pp.find_get_pages_range_tag
1.71 ± 2% -1.2 0.50 perf-profile.self.cycles-pp.rwsem_spin_on_owner
1.34 -0.9 0.44 ± 2% perf-profile.self.cycles-pp._raw_spin_lock
0.72 -0.6 0.14 ± 3% perf-profile.self.cycles-pp.rwsem_down_write_slowpath
1.03 -0.6 0.47 ± 4% perf-profile.self.cycles-pp.idle_cpu
0.68 ± 2% -0.5 0.20 ± 8% perf-profile.self.cycles-pp.release_pages
0.70 ± 2% -0.5 0.22 ± 2% perf-profile.self.cycles-pp.__schedule
0.55 ± 2% -0.4 0.10 ± 3% perf-profile.self.cycles-pp.menu_select
0.48 -0.4 0.13 ± 5% perf-profile.self.cycles-pp.xas_find_marked
0.66 ± 2% -0.3 0.33 ± 5% perf-profile.self.cycles-pp.mutex_spin_on_owner
0.40 ± 5% -0.3 0.08 ± 7% perf-profile.self.cycles-pp.f2fs_fsync_node_pages
0.38 ± 4% -0.3 0.09 ± 5% perf-profile.self.cycles-pp.brd_do_bvec
0.40 ± 20% -0.3 0.11 ± 18% perf-profile.self.cycles-pp.__percpu_counter_sum
0.48 ± 2% -0.3 0.20 ± 5% perf-profile.self.cycles-pp._find_next_bit
0.37 ± 5% -0.3 0.11 ± 8% perf-profile.self.cycles-pp.up_read
0.35 -0.3 0.09 ± 5% perf-profile.self.cycles-pp.f2fs_is_valid_blkaddr
0.29 ± 4% -0.2 0.06 ± 13% perf-profile.self.cycles-pp.__radix_tree_lookup
0.31 ± 3% -0.2 0.10 ± 5% perf-profile.self.cycles-pp.enqueue_task_fair
0.33 ± 3% -0.2 0.12 perf-profile.self.cycles-pp.update_rq_clock
0.35 ± 3% -0.2 0.14 ± 2% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.28 ± 5% -0.2 0.07 ± 6% perf-profile.self.cycles-pp.enqueue_entity
0.78 ± 2% -0.2 0.57 perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.28 ± 2% -0.2 0.08 ± 6% perf-profile.self.cycles-pp.down_write
0.27 -0.2 0.07 ± 10% perf-profile.self.cycles-pp.update_sit_entry
0.32 ± 3% -0.2 0.15 ± 2% perf-profile.self.cycles-pp.__list_del_entry_valid
0.28 -0.2 0.11 ± 3% perf-profile.self.cycles-pp.newidle_balance
0.24 ± 5% -0.2 0.07 ± 7% perf-profile.self.cycles-pp.__switch_to
0.22 ± 4% -0.2 0.06 ± 6% perf-profile.self.cycles-pp.llist_add_batch
0.23 ± 5% -0.2 0.07 ± 6% perf-profile.self.cycles-pp.native_sched_clock
0.34 ± 4% -0.2 0.19 ± 3% perf-profile.self.cycles-pp.update_load_avg
0.19 ± 7% -0.2 0.03 ± 70% perf-profile.self.cycles-pp.llist_reverse_order
0.24 ± 4% -0.2 0.09 ± 5% perf-profile.self.cycles-pp.__switch_to_asm
0.19 ± 5% -0.2 0.04 ± 44% perf-profile.self.cycles-pp.mutex_lock
0.20 ± 6% -0.1 0.05 perf-profile.self.cycles-pp.__filemap_get_folio
0.21 ± 5% -0.1 0.06 perf-profile.self.cycles-pp.ttwu_queue_wakelist
0.21 ± 5% -0.1 0.06 ± 6% perf-profile.self.cycles-pp.f2fs_do_sync_file
0.21 ± 3% -0.1 0.06 ± 7% perf-profile.self.cycles-pp.f2fs_allocate_data_block
0.20 ± 5% -0.1 0.06 ± 7% perf-profile.self.cycles-pp.perf_trace_sched_wakeup_template
0.20 ± 6% -0.1 0.07 ± 8% perf-profile.self.cycles-pp.cpumask_next_and
0.18 ± 2% -0.1 0.06 ± 7% perf-profile.self.cycles-pp.up_write
0.21 ± 2% -0.1 0.09 ± 4% perf-profile.self.cycles-pp.__update_load_avg_se
0.17 ± 4% -0.1 0.06 perf-profile.self.cycles-pp.cpuacct_charge
0.14 ± 5% -0.1 0.02 ± 99% perf-profile.self.cycles-pp.f2fs_submit_page_write
0.18 ± 4% -0.1 0.07 perf-profile.self.cycles-pp.finish_task_switch
0.15 ± 4% -0.1 0.07 ± 7% perf-profile.self.cycles-pp.try_to_wake_up
0.14 ± 5% -0.1 0.05 ± 8% perf-profile.self.cycles-pp.dequeue_task_fair
0.18 ± 5% -0.1 0.10 ± 8% perf-profile.self.cycles-pp.update_cfs_group
0.13 ± 10% -0.1 0.05 ± 7% perf-profile.self.cycles-pp.flush_smp_call_function_queue
0.27 ± 2% -0.1 0.20 ± 5% perf-profile.self.cycles-pp.load_balance
0.20 ± 5% -0.1 0.13 ± 5% perf-profile.self.cycles-pp.update_curr
0.11 ± 4% -0.1 0.05 perf-profile.self.cycles-pp.clear_page_erms
0.00 +0.1 0.05 perf-profile.self.cycles-pp.select_idle_cpu
0.10 ± 9% +0.1 0.15 ± 3% perf-profile.self.cycles-pp.available_idle_cpu
0.00 +0.1 0.06 ± 6% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.00 +0.2 0.25 ± 3% perf-profile.self.cycles-pp.prepare_to_wait_event
0.00 +0.3 0.34 ± 2% perf-profile.self.cycles-pp.down_read_trylock
5.34 ± 3% +64.5 69.86 perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang
6 months, 3 weeks
- 1
- 0
[ucounts] 0315b634f9: WARNING:at_kernel/ucount.c:#dec_ucount
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 0315b634f933b0f12cfa82660322f6186c1aa0f4 ("ucounts: Split rlimit and ucount values and max values")
linux-devel devel-catchup-20220109-083424
in testcase: trinity
version: trinity-static-i386-x86_64-f93256fb_2019-08-28
with following parameters:
runtime: 300s
group: group-02
test-description: Trinity is a linux system call fuzz tester.
test-url: http://codemonkey.org.uk/projects/trinity/
on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 4G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
[ 323.497387][ T3821] WARNING: CPU: 0 PID: 3821 at kernel/ucount.c:255 dec_ucount (kernel/ucount.c:255 (discriminator 1))
[ 323.501839][ T3821] Modules linked in: vsock_loopback(E) vmw_vsock_virtio_transport_common(E) vmw_vsock_vmci_transport(E) vsock(E) vmw_vmci(E) af_key(E) mpls_router(E) nfc(E) af_alg(E) fcrypt(E) pcbc(E) rxrpc(E) can_bcm(E) can_raw(E) can(E) crypto_user(E) nfnetlink(E) scsi_transport_iscsi(E) xfrm_user(E) xfrm_algo(E) llc2(E) dccp_ipv6(E) sctp(E) crc32c_generic(E) crc32c_intel(E) libcrc32c(E) dccp_ipv4(E) dccp(E) ppdev(E) bochs(E) drm_vram_helper(E) drm_ttm_helper(E) ttm(E) parport_pc(E) floppy(E) parport(E) psmouse(E) drm_kms_helper(E) ata_generic(E) ata_piix(E) syscopyarea(E) sysfillrect(E) sysimgblt(E) serio_raw(E) button(E) libata(E) evdev(E) qemu_fw_cfg(E) i2c_piix4(E) fb_sys_fops(E)
[ 323.526469][ T3821] CPU: 0 PID: 3821 Comm: kworker/u4:4 Tainted: G E 5.16.0-rc2-00002-g0315b634f933 #1
[ 323.531257][ T3821] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014
[ 323.537762][ T3821] Workqueue: netns cleanup_net
[ 323.541735][ T3821] EIP: dec_ucount (kernel/ucount.c:255 (discriminator 1))
[ 323.545249][ T3821] Code: 01 78 27 f0 0f b1 31 75 f3 8b 43 08 8b 98 a0 01 00 00 85 db 75 dc 8b 45 f0 e8 b4 fb ff ff 83 c4 08 5b 5e 5f 5d c3 8d 74 26 00 <0f> 0b eb db b8 e4 3e 58 cd 89 55 ec e8 57 e1 50 00 8b 55 ec eb b7
All code
========
0: 01 78 27 add %edi,0x27(%rax)
3: f0 0f b1 31 lock cmpxchg %esi,(%rcx)
7: 75 f3 jne 0xfffffffffffffffc
9: 8b 43 08 mov 0x8(%rbx),%eax
c: 8b 98 a0 01 00 00 mov 0x1a0(%rax),%ebx
12: 85 db test %ebx,%ebx
14: 75 dc jne 0xfffffffffffffff2
16: 8b 45 f0 mov -0x10(%rbp),%eax
19: e8 b4 fb ff ff callq 0xfffffffffffffbd2
1e: 83 c4 08 add $0x8,%esp
21: 5b pop %rbx
22: 5e pop %rsi
23: 5f pop %rdi
24: 5d pop %rbp
25: c3 retq
26: 8d 74 26 00 lea 0x0(%rsi,%riz,1),%esi
2a:* 0f 0b ud2 <-- trapping instruction
2c: eb db jmp 0x9
2e: b8 e4 3e 58 cd mov $0xcd583ee4,%eax
33: 89 55 ec mov %edx,-0x14(%rbp)
36: e8 57 e1 50 00 callq 0x50e192
3b: 8b 55 ec mov -0x14(%rbp),%edx
3e: eb b7 jmp 0xfffffffffffffff7
Code starting with the faulting instruction
===========================================
0: 0f 0b ud2
2: eb db jmp 0xffffffffffffffdf
4: b8 e4 3e 58 cd mov $0xcd583ee4,%eax
9: 89 55 ec mov %edx,-0x14(%rbp)
c: e8 57 e1 50 00 callq 0x50e168
11: 8b 55 ec mov -0x14(%rbp),%edx
14: eb b7 jmp 0xffffffffffffffcd
[ 323.553725][ T3821] EAX: 00000000 EBX: f5c792a0 ECX: f5c792c4 EDX: 00000004
[ 323.561255][ T3821] ESI: ffffffff EDI: 00000024 EBP: f59a7ef8 ESP: f59a7ee4
[ 323.565719][ T3821] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 EFLAGS: 00010297
[ 323.570663][ T3821] CR0: 80050033 CR2: 09a8bcb8 CR3: 35d00000 CR4: 000406f0
[ 323.574953][ T3821] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
[ 323.579209][ T3821] DR6: fffe0ff0 DR7: 00000400
[ 323.582975][ T3821] Call Trace:
[ 323.586717][ T3821] cleanup_net (net/core/net_namespace.c:611)
[ 323.591019][ T3821] process_one_work (arch/x86/include/asm/jump_label.h:41 include/linux/jump_label.h:212 include/trace/events/workqueue.h:108 kernel/workqueue.c:2303)
[ 323.594803][ T3821] worker_thread (include/linux/list.h:284 kernel/workqueue.c:2446)
[ 323.598452][ T3821] kthread (kernel/kthread.c:327)
[ 323.601940][ T3821] ? process_one_work (kernel/workqueue.c:2388)
[ 323.605844][ T3821] ? set_kthread_struct (kernel/kthread.c:272)
[ 323.609565][ T3821] ret_from_fork (arch/x86/entry/entry_32.S:775)
[ 323.613159][ T3821] irq event stamp: 647965
[ 323.616583][ T3821] hardirqs last enabled at (647975): finish_task_switch (arch/x86/include/asm/irqflags.h:45 arch/x86/include/asm/irqflags.h:80 kernel/sched/sched.h:1328 kernel/sched/core.c:4732 kernel/sched/core.c:4850)
[ 323.621077][ T3821] hardirqs last disabled at (647986): __schedule (kernel/sched/core.c:6149 (discriminator 1))
[ 323.625515][ T3821] softirqs last enabled at (647960): __do_softirq (arch/x86/include/asm/preempt.h:27 kernel/softirq.c:402 kernel/softirq.c:587)
[ 323.633863][ T3821] softirqs last disabled at (647955): call_on_stack (arch/x86/kernel/irq_32.c:60)
[ 323.638492][ T3821] ---[ end trace c46959b68e3a5753 ]---
To reproduce:
# build kernel
cd linux
cp config-5.16.0-rc2-00002-g0315b634f933 .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang
6 months, 3 weeks
- 1
- 0
[drm] 6e22dc3583: BUG:kernel_NULL_pointer_dereference,address
by kernel test robot
(please be noted this was reported as
https://lists.01.org/hyperkitty/list/[email protected]/thread/ZPSFPRCI2J6F...
at first, and we noticed there are some discussion about the fix,
but we cannot search out the fix commit and still reproduce the issue
on HEAD, if we missed something, please kindly let us know, Thanks!)
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 6e22dc35837790a84fc040f08e5094b2d5d91477 ("drm: get rid of DRM_DEBUG_* log calls in drm core, files drm_a*.c")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: boot
on test machine: qemu-system-x86_64 -enable-kvm -cpu Icelake-Server -smp 4 -m 16G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+---------------------------------------------+------------+------------+
| | 11632d4aa2 | 6e22dc3583 |
+---------------------------------------------+------------+------------+
| boot_successes | 14 | 0 |
| boot_failures | 0 | 12 |
| BUG:kernel_NULL_pointer_dereference,address | 0 | 12 |
| Oops:#[##] | 0 | 12 |
| RIP:drm_atomic_helper_check_plane_state | 0 | 12 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 12 |
+---------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
[ 243.435094][ T1] BUG: kernel NULL pointer dereference, address: 0000000000000010
[ 243.436828][ T1] #PF: supervisor read access in kernel mode
[ 243.437976][ T1] #PF: error_code(0x0000) - not-present page
[ 243.438416][ T1] PGD 0 P4D 0
[ 243.438416][ T1] Oops: 0000 [#1] SMP
[ 243.438416][ T1] CPU: 2 PID: 1 Comm: swapper/0 Not tainted 5.16.0-rc1-00265-g6e22dc358377 #1
[ 243.438416][ T1] RIP: 0010:drm_atomic_helper_check_plane_state (drivers/gpu/drm/drm_atomic_helper.c:867)
[ 243.438416][ T1] Code: 78 75 1e e8 33 01 6d ff 8b 45 cc 39 43 74 75 11 e8 26 01 6d ff 8b 45 d4 39 43 7c 0f 84 17 ff ff ff e8 15 01 6d ff 48 8b 43 08 <4c> 8b 20 4d 85 e4 74 0a e8 04 01 6d ff 4d 8b 64 24 08 e8 fa 00 6d
All code
========
0: 78 75 js 0x77
2: 1e (bad)
3: e8 33 01 6d ff callq 0xffffffffff6d013b
8: 8b 45 cc mov -0x34(%rbp),%eax
b: 39 43 74 cmp %eax,0x74(%rbx)
e: 75 11 jne 0x21
10: e8 26 01 6d ff callq 0xffffffffff6d013b
15: 8b 45 d4 mov -0x2c(%rbp),%eax
18: 39 43 7c cmp %eax,0x7c(%rbx)
1b: 0f 84 17 ff ff ff je 0xffffffffffffff38
21: e8 15 01 6d ff callq 0xffffffffff6d013b
26: 48 8b 43 08 mov 0x8(%rbx),%rax
2a:* 4c 8b 20 mov (%rax),%r12 <-- trapping instruction
2d: 4d 85 e4 test %r12,%r12
30: 74 0a je 0x3c
32: e8 04 01 6d ff callq 0xffffffffff6d013b
37: 4d 8b 64 24 08 mov 0x8(%r12),%r12
3c: e8 .byte 0xe8
3d: fa cli
3e: 00 .byte 0x0
3f: 6d insl (%dx),%es:(%rdi)
Code starting with the faulting instruction
===========================================
0: 4c 8b 20 mov (%rax),%r12
3: 4d 85 e4 test %r12,%r12
6: 74 0a je 0x12
8: e8 04 01 6d ff callq 0xffffffffff6d0111
d: 4d 8b 64 24 08 mov 0x8(%r12),%r12
12: e8 .byte 0xe8
13: fa cli
14: 00 .byte 0x0
15: 6d insl (%dx),%es:(%rdi)
[ 243.438416][ T1] RSP: 0000:ffff888100d6fb38 EFLAGS: 00010293
[ 243.438416][ T1] RAX: 0000000000000010 RBX: ffff888100d6fb98 RCX: 0000000000000000
[ 243.438416][ T1] RDX: ffff888100d68040 RSI: ffffffff81b32ca2 RDI: ffff888100d6fbf8
[ 243.438416][ T1] RBP: ffff888100d6fb88 R08: 0000000000010000 R09: 0000000000000000
[ 243.438416][ T1] R10: ffffffff844c6758 R11: 0000000000000001 R12: ffff888100d6fcf8
[ 243.438416][ T1] R13: ffff888100d6fbf8 R14: ffff888100d6fc30 R15: ffff888100d6fc08
[ 243.438416][ T1] FS: 0000000000000000(0000) GS:ffff88842fa00000(0000) knlGS:0000000000000000
[ 243.438416][ T1] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 243.438416][ T1] CR2: 0000000000000010 CR3: 0000000004012001 CR4: 00000000001706e0
[ 243.438416][ T1] Call Trace:
[ 243.438416][ T1] <TASK>
[ 243.438416][ T1] igt_check_plane_state (drivers/gpu/drm/selftests/test-drm_plane_helper.c:131 (discriminator 2))
[ 243.438416][ T1] test_drm_modeset_init (drivers/gpu/drm/selftests/drm_selftest.c:76 drivers/gpu/drm/selftests/test-drm_modeset_common.c:19)
[ 243.438416][ T1] ? test_drm_mm_init (drivers/gpu/drm/selftests/test-drm_modeset_common.c:16)
[ 243.438416][ T1] do_one_initcall (init/main.c:1297)
[ 243.438416][ T1] ? rcu_read_lock_sched_held (include/linux/lockdep.h:283 kernel/rcu/update.c:125)
[ 243.438416][ T1] kernel_init_freeable (init/main.c:1369 init/main.c:1386 init/main.c:1405 init/main.c:1610)
[ 243.438416][ T1] ? rest_init (init/main.c:1491)
[ 243.438416][ T1] kernel_init (init/main.c:1501)
[ 243.438416][ T1] ret_from_fork (arch/x86/entry/entry_64.S:301)
[ 243.438416][ T1] </TASK>
[ 243.438416][ T1] Modules linked in:
[ 243.438416][ T1] CR2: 0000000000000010
[ 243.438416][ T1] ---[ end trace 511c29efb061b69f ]---
[ 243.438416][ T1] RIP: 0010:drm_atomic_helper_check_plane_state (drivers/gpu/drm/drm_atomic_helper.c:867)
[ 243.438416][ T1] Code: 78 75 1e e8 33 01 6d ff 8b 45 cc 39 43 74 75 11 e8 26 01 6d ff 8b 45 d4 39 43 7c 0f 84 17 ff ff ff e8 15 01 6d ff 48 8b 43 08 <4c> 8b 20 4d 85 e4 74 0a e8 04 01 6d ff 4d 8b 64 24 08 e8 fa 00 6d
All code
========
0: 78 75 js 0x77
2: 1e (bad)
3: e8 33 01 6d ff callq 0xffffffffff6d013b
8: 8b 45 cc mov -0x34(%rbp),%eax
b: 39 43 74 cmp %eax,0x74(%rbx)
e: 75 11 jne 0x21
10: e8 26 01 6d ff callq 0xffffffffff6d013b
15: 8b 45 d4 mov -0x2c(%rbp),%eax
18: 39 43 7c cmp %eax,0x7c(%rbx)
1b: 0f 84 17 ff ff ff je 0xffffffffffffff38
21: e8 15 01 6d ff callq 0xffffffffff6d013b
26: 48 8b 43 08 mov 0x8(%rbx),%rax
2a:* 4c 8b 20 mov (%rax),%r12 <-- trapping instruction
2d: 4d 85 e4 test %r12,%r12
30: 74 0a je 0x3c
32: e8 04 01 6d ff callq 0xffffffffff6d013b
37: 4d 8b 64 24 08 mov 0x8(%r12),%r12
3c: e8 .byte 0xe8
3d: fa cli
3e: 00 .byte 0x0
3f: 6d insl (%dx),%es:(%rdi)
Code starting with the faulting instruction
===========================================
0: 4c 8b 20 mov (%rax),%r12
3: 4d 85 e4 test %r12,%r12
6: 74 0a je 0x12
8: e8 04 01 6d ff callq 0xffffffffff6d0111
d: 4d 8b 64 24 08 mov 0x8(%r12),%r12
12: e8 .byte 0xe8
13: fa cli
14: 00 .byte 0x0
15: 6d insl (%dx),%es:(%rdi)
To reproduce:
# build kernel
cd linux
cp config-5.16.0-rc1-00265-g6e22dc358377 .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang
6 months, 3 weeks
- 2
- 1
[x86/entry_32] aa93e2ad74: BUG:soft_lockup-CPU##stuck_for#s![systemd-logind:#]
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with clang-14):
commit: aa93e2ad7464ffb90155a5ffdde963816f86d5dc ("x86/entry_32: Remove .fixup usage")
https://git.kernel.org/cgit/linux/kernel/git/tip/tip.git x86/core
in testcase: kernel-selftests
version:
with following parameters:
group: x86
test-description: The kernel contains a set of "self tests" under the tools/testing/selftests/ directory. These are intended to be small unit tests to exercise individual code paths in the kernel.
test-url: https://www.kernel.org/doc/Documentation/kselftest.txt
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 16G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-----------------------------------------------------+------------+------------+
| | 16e617d05e | aa93e2ad74 |
+-----------------------------------------------------+------------+------------+
| boot_successes | 52 | 5 |
| boot_failures | 0 | 47 |
| BUG:kernel_hang_in_test_stage | 0 | 40 |
| BUG:soft_lockup-CPU##stuck_for#s![systemd-logind:#] | 0 | 7 |
| EIP:smp_call_function_many_cond | 0 | 7 |
| Kernel_panic-not_syncing:softlockup:hung_tasks | 0 | 7 |
+-----------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
[ 1153.108528][ C1] watchdog: BUG: soft lockup - CPU#1 stuck for 536s! [systemd-logind:1589]
[ 1153.113402][ C1] Modules linked in: bochs drm_vram_helper drm_ttm_helper ttm drm_kms_helper drm serio_raw drm_panel_orientation_quirks i2c_piix4 evbug intel_agp evdev rtc_cmos mac_hid intel_gtt agpgart stm_p_basic
[ 1153.123007][ C1] irq event stamp: 270688
[ 1153.126371][ C1] hardirqs last enabled at (270687): irqentry_exit (kernel/entry/common.c:?)
[ 1153.130734][ C1] hardirqs last disabled at (270688): sysvec_apic_timer_interrupt (arch/x86/kernel/apic/apic.c:1097)
[ 1153.135693][ C1] softirqs last enabled at (203498): do_softirq_own_stack (arch/x86/kernel/irq_32.c:60 arch/x86/kernel/irq_32.c:150)
[ 1153.140292][ C1] softirqs last disabled at (203423): do_softirq_own_stack (arch/x86/kernel/irq_32.c:60 arch/x86/kernel/irq_32.c:150)
[ 1153.144942][ C1] CPU: 1 PID: 1589 Comm: systemd-logind Not tainted 5.16.0-rc4-00015-gaa93e2ad7464 #1 724caf37a2ed720c19b702e6f6c942970fe22427
[ 1153.153337][ C1] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014
[ 1153.158184][ C1] EIP: smp_call_function_many_cond (kernel/smp.c:440 kernel/smp.c:969)
[ 1153.162660][ C1] Code: 00 89 c7 3b 05 2c d7 97 c2 73 3a 8b 45 f0 8b 18 83 ff 20 73 20 8b 04 bd 84 94 4b c2 f7 44 18 04 01 00 00 00 74 d2 90 90 f3 90 <8b> 4c 03 04 f6 c1 01 75 f5 eb c3 57 68 80 7f 87 c2 e8 68 43 4d 00
All code
========
0: 00 89 c7 3b 05 2c add %cl,0x2c053bc7(%rcx)
6: d7 xlat %ds:(%rbx)
7: 97 xchg %eax,%edi
8: c2 73 3a retq $0x3a73
b: 8b 45 f0 mov -0x10(%rbp),%eax
e: 8b 18 mov (%rax),%ebx
10: 83 ff 20 cmp $0x20,%edi
13: 73 20 jae 0x35
15: 8b 04 bd 84 94 4b c2 mov -0x3db46b7c(,%rdi,4),%eax
1c: f7 44 18 04 01 00 00 testl $0x1,0x4(%rax,%rbx,1)
23: 00
24: 74 d2 je 0xfffffffffffffff8
26: 90 nop
27: 90 nop
28: f3 90 pause
2a:* 8b 4c 03 04 mov 0x4(%rbx,%rax,1),%ecx <-- trapping instruction
2e: f6 c1 01 test $0x1,%cl
31: 75 f5 jne 0x28
33: eb c3 jmp 0xfffffffffffffff8
35: 57 push %rdi
36: 68 80 7f 87 c2 pushq $0xffffffffc2877f80
3b: e8 68 43 4d 00 callq 0x4d43a8
Code starting with the faulting instruction
===========================================
0: 8b 4c 03 04 mov 0x4(%rbx,%rax,1),%ecx
4: f6 c1 01 test $0x1,%cl
7: 75 f5 jne 0xfffffffffffffffe
9: eb c3 jmp 0xffffffffffffffce
b: 57 push %rdi
c: 68 80 7f 87 c2 pushq $0xffffffffc2877f80
11: e8 68 43 4d 00 callq 0x4d437e
[ 1153.173395][ C1] EAX: 17173000 EBX: c2a89df0 ECX: 00000011 EDX: 00000001
[ 1153.178489][ C1] ESI: d9c17244 EDI: 00000000 EBP: c70bbcc8 ESP: c70bbc90
[ 1153.183282][ C1] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 EFLAGS: 00000202
[ 1153.188245][ C1] CR0: 80050033 CR2: 005fd180 CR3: 060b3000 CR4: 00040690
[ 1153.193152][ C1] Call Trace:
[ 1153.197354][ C1] ? flush_tlb_all (arch/x86/mm/tlb.c:1027)
[ 1153.201557][ C1] on_each_cpu_cond_mask (kernel/smp.c:1135)
[ 1153.205806][ C1] flush_tlb_kernel_range (include/linux/smp.h:71 arch/x86/mm/tlb.c:1053)
[ 1153.209947][ C1] __kmap_flush_unused (include/linux/spinlock.h:389 mm/highmem.c:201)
[ 1153.213857][ C1] change_page_attr_set_clr (arch/x86/mm/pat/set_memory.c:1743)
[ 1153.217987][ C1] ? rcu_read_lock_sched_held (kernel/rcu/update.c:125)
[ 1153.222472][ C1] set_memory_ro (arch/x86/mm/pat/set_memory.c:1946)
[ 1153.226468][ C1] bpf_prog_select_runtime (include/linux/filter.h:?)
[ 1153.230241][ C1] bpf_prepare_filter (net/core/filter.c:? net/core/filter.c:1343)
[ 1153.234171][ C1] __get_filter (net/core/filter.c:1512)
[ 1153.238208][ C1] sk_attach_filter (net/core/filter.c:1527)
[ 1153.242013][ C1] sock_setsockopt (net/core/sock.c:?)
[ 1153.245655][ C1] __sys_setsockopt (net/socket.c:?)
[ 1153.249508][ C1] __ia32_sys_socketcall (net/socket.c:? net/socket.c:2901 net/socket.c:2901)
[ 1153.253576][ C1] ? kmem_cache_free (mm/slub.c:3501 mm/slub.c:3514 mm/slub.c:3530)
[ 1153.257465][ C1] ? put_cred_rcu (kernel/cred.c:127)
[ 1153.261292][ C1] ? put_cred_rcu (kernel/cred.c:127)
[ 1153.264756][ C1] ? rcu_lock_release (include/linux/rcupdate.h:274)
[ 1153.268279][ C1] ? put_cred_rcu (kernel/cred.c:127)
[ 1153.271688][ C1] ? syscall_enter_from_user_mode (arch/x86/include/asm/irqflags.h:45 arch/x86/include/asm/irqflags.h:80 kernel/entry/common.c:107)
[ 1153.275128][ C1] ? do_int80_syscall_32 (arch/x86/entry/common.c:110 arch/x86/entry/common.c:132)
[ 1153.278608][ C1] ? trace_hardirqs_on (kernel/trace/trace_preemptirq.c:51)
[ 1153.282036][ C1] ? syscall_enter_from_user_mode (arch/x86/include/asm/irqflags.h:45 arch/x86/include/asm/irqflags.h:80 kernel/entry/common.c:107)
[ 1153.285382][ C1] do_int80_syscall_32 (arch/x86/entry/common.c:112 arch/x86/entry/common.c:132)
[ 1153.289305][ C1] ? irqentry_exit_to_user_mode (kernel/entry/common.c:316)
[ 1153.293109][ C1] ? irqentry_exit (kernel/entry/common.c:441)
[ 1153.296533][ C1] ? exc_page_fault (arch/x86/mm/fault.c:1545)
[ 1153.300022][ C1] entry_INT80_32 (init_task.c:?)
[ 1153.303502][ C1] EIP: 0xb7f10092
[ 1153.306552][ C1] Code: 00 00 00 e9 90 ff ff ff ff a3 24 00 00 00 68 30 00 00 00 e9 80 ff ff ff ff a3 e0 ff ff ff 66 90 00 00 00 00 00 00 00 00 cd 80 <c3> 8d b4 26 00 00 00 00 8d b6 00 00 00 00 8b 1c 24 c3 8d b4 26 00
All code
========
0: 00 00 add %al,(%rax)
2: 00 e9 add %ch,%cl
4: 90 nop
5: ff (bad)
6: ff (bad)
7: ff (bad)
8: ff a3 24 00 00 00 jmpq *0x24(%rbx)
e: 68 30 00 00 00 pushq $0x30
13: e9 80 ff ff ff jmpq 0xffffffffffffff98
18: ff a3 e0 ff ff ff jmpq *-0x20(%rbx)
1e: 66 90 xchg %ax,%ax
...
28: cd 80 int $0x80
2a:* c3 retq <-- trapping instruction
2b: 8d b4 26 00 00 00 00 lea 0x0(%rsi,%riz,1),%esi
32: 8d b6 00 00 00 00 lea 0x0(%rsi),%esi
38: 8b 1c 24 mov (%rsp),%ebx
3b: c3 retq
3c: 8d .byte 0x8d
3d: b4 26 mov $0x26,%ah
...
Code starting with the faulting instruction
===========================================
0: c3 retq
1: 8d b4 26 00 00 00 00 lea 0x0(%rsi,%riz,1),%esi
8: 8d b6 00 00 00 00 lea 0x0(%rsi),%esi
e: 8b 1c 24 mov (%rsp),%ebx
11: c3 retq
12: 8d .byte 0x8d
13: b4 26 mov $0x26,%ah
To reproduce:
# build kernel
cd linux
cp config-5.16.0-rc4-00015-gaa93e2ad7464 .config
make HOSTCC=clang-14 CC=clang-14 ARCH=i386 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=clang-14 CC=clang-14 ARCH=i386 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang
6 months, 3 weeks
- 5
- 11
[ucounts] 59ec71575a: will-it-scale.per_process_ops -10.3% regression
by kernel test robot
Greeting,
FYI, we noticed a -10.3% regression of will-it-scale.per_process_ops due to commit:
commit: 59ec71575ab440cd5ca0aa53b2a2985b3639fad4 ("ucounts: Fix rlimit max values check")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: will-it-scale
on test machine: 144 threads 4 sockets Intel(R) Xeon(R) Gold 5318H CPU @ 2.50GHz with 128G memory
with following parameters:
nr_task: 100%
mode: process
test: signal1
cpufreq_governor: performance
ucode: 0x7002302
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
sudo bin/lkp install job.yaml # job file is attached in this email
bin/lkp split-job --compatible job.yaml # generate the yaml file for lkp run
sudo bin/lkp run generated-yaml-file
# if come across any failure that blocks the test,
# please remove ~/.lkp and /lkp dir to run from a clean state.
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-9/performance/x86_64-rhel-8.3/process/100%/debian-10.4-x86_64-20200603.cgz/lkp-cpl-4sp1/signal1/will-it-scale/0x7002302
commit:
v5.16-rc2
59ec71575a ("ucounts: Fix rlimit max values check")
v5.16-rc2 59ec71575ab440cd5ca0aa53b2a
---------------- ---------------------------
%stddev %change %stddev
\ | \
11375458 -10.3% 10205843 will-it-scale.144.processes
78995 -10.3% 70873 will-it-scale.per_process_ops
11375458 -10.3% 10205843 will-it-scale.workload
35.26 +4.6% 36.90 turbostat.RAMWatt
1.177e+10 -10.1% 1.058e+10 perf-stat.i.branch-instructions
87846548 -6.7% 81932988 perf-stat.i.branch-misses
43.42 +2.7 46.09 perf-stat.i.cache-miss-rate%
91079467 ± 2% +27.6% 1.162e+08 perf-stat.i.cache-misses
2.086e+08 +20.7% 2.517e+08 perf-stat.i.cache-references
7.77 +11.8% 8.68 perf-stat.i.cpi
5126 -21.1% 4044 perf-stat.i.cycles-between-cache-misses
1.814e+10 -10.6% 1.621e+10 ± 2% perf-stat.i.dTLB-loads
1.17e+10 -11.1% 1.04e+10 ± 2% perf-stat.i.dTLB-stores
53823400 -22.3% 41823499 ± 16% perf-stat.i.iTLB-load-misses
6e+10 -9.9% 5.405e+10 perf-stat.i.instructions
0.13 -10.5% 0.12 perf-stat.i.ipc
290.39 -10.4% 260.05 ± 2% perf-stat.i.metric.M/sec
5934502 ± 3% +38.4% 8213006 perf-stat.i.node-load-misses
504440 ± 3% +34.1% 676425 ± 2% perf-stat.i.node-loads
3.48 +34.0% 4.66 perf-stat.overall.MPKI
0.75 +0.0 0.77 ± 2% perf-stat.overall.branch-miss-rate%
43.63 +2.5 46.13 perf-stat.overall.cache-miss-rate%
7.78 +11.8% 8.70 perf-stat.overall.cpi
5128 -21.1% 4045 perf-stat.overall.cycles-between-cache-misses
0.13 -10.5% 0.11 perf-stat.overall.ipc
1.174e+10 -10.1% 1.055e+10 perf-stat.ps.branch-instructions
87583795 -6.8% 81664372 perf-stat.ps.branch-misses
90844134 ± 2% +27.5% 1.158e+08 perf-stat.ps.cache-misses
2.082e+08 +20.6% 2.511e+08 perf-stat.ps.cache-references
1.809e+10 -10.7% 1.616e+10 ± 2% perf-stat.ps.dTLB-loads
1.167e+10 -11.1% 1.037e+10 ± 2% perf-stat.ps.dTLB-stores
53794169 -22.4% 41750328 ± 16% perf-stat.ps.iTLB-load-misses
5.984e+10 -10.0% 5.388e+10 perf-stat.ps.instructions
5915765 ± 3% +38.4% 8188054 perf-stat.ps.node-load-misses
542552 ± 4% +30.8% 709510 ± 3% perf-stat.ps.node-loads
1.826e+13 -10.5% 1.634e+13 perf-stat.total.instructions
48.83 -8.5 40.29 perf-profile.calltrace.cycles-pp.security_task_kill.do_send_specific.do_tkill.__x64_sys_tgkill.do_syscall_64
48.72 -8.5 40.21 perf-profile.calltrace.cycles-pp.apparmor_task_kill.security_task_kill.do_send_specific.do_tkill.__x64_sys_tgkill
66.93 -4.7 62.21 perf-profile.calltrace.cycles-pp.__x64_sys_tgkill.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
66.86 -4.7 62.16 perf-profile.calltrace.cycles-pp.do_tkill.__x64_sys_tgkill.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
66.62 -4.7 61.93 perf-profile.calltrace.cycles-pp.do_send_specific.do_tkill.__x64_sys_tgkill.do_syscall_64.entry_SYSCALL_64_after_hwframe
21.22 -4.1 17.12 perf-profile.calltrace.cycles-pp.aa_get_task_label.apparmor_task_kill.security_task_kill.do_send_specific.do_tkill
95.18 -1.5 93.70 perf-profile.calltrace.cycles-pp.raise
2.11 -1.1 0.96 ±100% perf-profile.calltrace.cycles-pp.__setup_rt_frame.arch_do_signal_or_restart.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
1.70 -0.9 0.78 ±100% perf-profile.calltrace.cycles-pp.copy_fpstate_to_sigframe.__setup_rt_frame.arch_do_signal_or_restart.exit_to_user_mode_prepare.syscall_exit_to_user_mode
1.48 -0.8 0.70 ±100% perf-profile.calltrace.cycles-pp.__fpu_restore_sig.fpu__restore_sig.restore_sigcontext.__x64_sys_rt_sigreturn.do_syscall_64
92.89 -0.8 92.13 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.raise
92.54 -0.7 91.80 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
1.04 -0.5 0.50 ±100% perf-profile.calltrace.cycles-pp.restore_fpregs_from_user.__fpu_restore_sig.fpu__restore_sig.restore_sigcontext.__x64_sys_rt_sigreturn
2.38 ± 5% -0.4 1.96 ± 4% perf-profile.calltrace.cycles-pp.aa_may_signal.apparmor_task_kill.security_task_kill.do_send_specific.do_tkill
1.50 -0.4 1.11 ± 23% perf-profile.calltrace.cycles-pp.__entry_text_start.raise
1.56 -0.2 1.40 ± 5% perf-profile.calltrace.cycles-pp.restore_sigcontext.__x64_sys_rt_sigreturn.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
1.52 -0.2 1.36 ± 5% perf-profile.calltrace.cycles-pp.fpu__restore_sig.restore_sigcontext.__x64_sys_rt_sigreturn.do_syscall_64.entry_SYSCALL_64_after_hwframe
2.20 +0.3 2.54 ± 8% perf-profile.calltrace.cycles-pp.__x64_sys_rt_sigreturn.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
0.62 ± 3% +0.5 1.12 ± 26% perf-profile.calltrace.cycles-pp.restore_altstack.__x64_sys_rt_sigreturn.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
1.69 ± 2% +0.6 2.25 ± 9% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.handler
1.70 ± 2% +0.6 2.26 ± 9% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.handler
1.68 ± 2% +0.6 2.24 ± 9% perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.handler
1.68 ± 2% +0.6 2.25 ± 9% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.handler
0.00 +0.6 0.64 ± 15% perf-profile.calltrace.cycles-pp.__set_current_blocked.__x64_sys_rt_sigreturn.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +0.8 0.84 ± 36% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.do_sigaltstack.restore_altstack.__x64_sys_rt_sigreturn.do_syscall_64
0.00 +0.9 0.89 ± 34% perf-profile.calltrace.cycles-pp.do_sigaltstack.restore_altstack.__x64_sys_rt_sigreturn.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.08 ± 4% +1.0 2.11 ± 4% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.__set_current_blocked.sigprocmask.__x64_sys_rt_sigprocmask.do_syscall_64
2.65 +1.3 3.90 ± 3% perf-profile.calltrace.cycles-pp.__x64_sys_rt_sigprocmask.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
4.24 +1.3 5.56 ± 4% perf-profile.calltrace.cycles-pp.handler
1.76 ± 2% +1.3 3.11 ± 4% perf-profile.calltrace.cycles-pp.sigprocmask.__x64_sys_rt_sigprocmask.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
1.70 ± 2% +1.4 3.06 ± 4% perf-profile.calltrace.cycles-pp.__set_current_blocked.sigprocmask.__x64_sys_rt_sigprocmask.do_syscall_64.entry_SYSCALL_64_after_hwframe
20.17 ± 2% +2.5 22.62 perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
19.97 ± 2% +2.5 22.47 perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.raise
16.45 ± 2% +3.8 20.23 perf-profile.calltrace.cycles-pp.__send_signal.do_send_sig_info.do_send_specific.do_tkill.__x64_sys_tgkill
16.19 ± 2% +3.8 20.00 perf-profile.calltrace.cycles-pp.__sigqueue_alloc.__send_signal.do_send_sig_info.do_send_specific.do_tkill
15.60 ± 2% +3.8 19.44 perf-profile.calltrace.cycles-pp.inc_rlimit_get_ucounts.__sigqueue_alloc.__send_signal.do_send_sig_info.do_send_specific
17.39 ± 2% +3.9 21.29 perf-profile.calltrace.cycles-pp.do_send_sig_info.do_send_specific.do_tkill.__x64_sys_tgkill.do_syscall_64
48.84 -8.5 40.29 perf-profile.children.cycles-pp.security_task_kill
48.81 -8.5 40.27 perf-profile.children.cycles-pp.apparmor_task_kill
66.95 -4.7 62.22 perf-profile.children.cycles-pp.__x64_sys_tgkill
66.87 -4.7 62.16 perf-profile.children.cycles-pp.do_tkill
66.62 -4.7 61.93 perf-profile.children.cycles-pp.do_send_specific
21.31 ± 2% -4.1 17.17 perf-profile.children.cycles-pp.aa_get_task_label
95.20 -1.0 94.16 perf-profile.children.cycles-pp.raise
1.49 -0.6 0.91 ± 55% perf-profile.children.cycles-pp.__fpu_restore_sig
2.38 ± 5% -0.4 1.96 ± 4% perf-profile.children.cycles-pp.aa_may_signal
1.92 -0.2 1.73 ± 4% perf-profile.children.cycles-pp.restore_sigcontext
2.12 -0.2 1.93 perf-profile.children.cycles-pp.__setup_rt_frame
1.72 -0.2 1.56 perf-profile.children.cycles-pp.copy_fpstate_to_sigframe
1.52 -0.2 1.37 ± 4% perf-profile.children.cycles-pp.fpu__restore_sig
1.00 -0.1 0.89 ± 2% perf-profile.children.cycles-pp._copy_from_user
1.00 -0.1 0.88 perf-profile.children.cycles-pp.__entry_text_start
1.04 -0.1 0.93 ± 7% perf-profile.children.cycles-pp.restore_fpregs_from_user
0.89 -0.1 0.78 ± 2% perf-profile.children.cycles-pp.syscall_return_via_sysret
0.52 -0.1 0.46 ± 2% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.49 -0.1 0.44 perf-profile.children.cycles-pp.copy_user_generic_unrolled
0.64 -0.0 0.59 ± 5% perf-profile.children.cycles-pp.__might_fault
0.12 ± 4% -0.0 0.08 ± 27% perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare
0.27 ± 2% -0.0 0.24 ± 2% perf-profile.children.cycles-pp.__clear_user
0.19 ± 2% -0.0 0.16 ± 10% perf-profile.children.cycles-pp.__might_sleep
0.25 -0.0 0.23 ± 2% perf-profile.children.cycles-pp.__get_user_nocheck_8
0.20 ± 3% -0.0 0.18 ± 2% perf-profile.children.cycles-pp.__put_user_nocheck_4
0.14 ± 3% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.syscall_enter_from_user_mode
0.15 -0.0 0.14 ± 3% perf-profile.children.cycles-pp.entry_SYSCALL_64_safe_stack
0.15 ± 3% -0.0 0.13 ± 3% perf-profile.children.cycles-pp.__x64_sys_getpid
0.63 ± 5% +0.1 0.75 ± 7% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.95 +0.1 1.08 ± 7% perf-profile.children.cycles-pp.fpu__clear_user_states
0.63 ± 4% +0.2 0.83 ± 11% perf-profile.children.cycles-pp.fpregs_mark_activate
1.20 +0.4 1.59 perf-profile.children.cycles-pp.native_irq_return_iret
0.66 ± 5% +0.4 1.08 ± 13% perf-profile.children.cycles-pp.signal_setup_done
3.37 +0.5 3.86 ± 2% perf-profile.children.cycles-pp.__x64_sys_rt_sigreturn
0.63 ± 3% +0.5 1.13 ± 26% perf-profile.children.cycles-pp.restore_altstack
0.35 ± 5% +0.5 0.89 ± 34% perf-profile.children.cycles-pp.do_sigaltstack
1.88 ± 4% +0.6 2.50 ± 2% perf-profile.children.cycles-pp.recalc_sigpending
3.17 +0.9 4.08 ± 5% perf-profile.children.cycles-pp.handler
2.67 +1.2 3.92 ± 3% perf-profile.children.cycles-pp.__x64_sys_rt_sigprocmask
1.77 ± 2% +1.3 3.12 ± 4% perf-profile.children.cycles-pp.sigprocmask
2.77 ± 2% +2.0 4.77 ± 7% perf-profile.children.cycles-pp.__set_current_blocked
2.49 ± 3% +2.0 4.54 perf-profile.children.cycles-pp._raw_spin_lock_irq
15.12 ± 2% +2.6 17.72 perf-profile.children.cycles-pp.do_dec_rlimit_put_ucounts
16.73 ± 2% +2.7 19.40 ± 2% perf-profile.children.cycles-pp.dequeue_signal
17.48 ± 2% +2.7 20.15 ± 2% perf-profile.children.cycles-pp.get_signal
21.90 ± 2% +3.0 24.92 perf-profile.children.cycles-pp.syscall_exit_to_user_mode
21.34 ± 2% +3.0 24.39 perf-profile.children.cycles-pp.arch_do_signal_or_restart
21.67 ± 2% +3.1 24.74 perf-profile.children.cycles-pp.exit_to_user_mode_prepare
16.48 ± 2% +3.8 20.25 perf-profile.children.cycles-pp.__send_signal
16.20 ± 2% +3.8 20.01 perf-profile.children.cycles-pp.__sigqueue_alloc
15.60 ± 2% +3.8 19.44 perf-profile.children.cycles-pp.inc_rlimit_get_ucounts
17.40 ± 2% +3.9 21.30 perf-profile.children.cycles-pp.do_send_sig_info
21.19 -4.1 17.07 perf-profile.self.cycles-pp.aa_get_task_label
24.97 -4.0 21.02 perf-profile.self.cycles-pp.apparmor_task_kill
0.81 -0.4 0.40 ± 85% perf-profile.self.cycles-pp.restore_fpregs_from_user
2.37 ± 5% -0.4 1.95 ± 4% perf-profile.self.cycles-pp.aa_may_signal
0.89 -0.1 0.78 ± 2% perf-profile.self.cycles-pp.syscall_return_via_sysret
0.88 -0.1 0.77 perf-profile.self.cycles-pp.raise
0.93 -0.1 0.84 ± 2% perf-profile.self.cycles-pp.copy_fpstate_to_sigframe
0.54 -0.1 0.47 ± 5% perf-profile.self.cycles-pp.fpu__clear_user_states
0.50 -0.1 0.44 ± 2% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.36 ± 2% -0.1 0.31 ± 8% perf-profile.self.cycles-pp.__setup_rt_frame
0.47 -0.1 0.42 perf-profile.self.cycles-pp.copy_user_generic_unrolled
0.16 ± 3% -0.0 0.11 ± 26% perf-profile.self.cycles-pp.kmem_cache_free
0.38 -0.0 0.34 ± 2% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
0.43 -0.0 0.38 perf-profile.self.cycles-pp.__entry_text_start
0.22 -0.0 0.19 ± 3% perf-profile.self.cycles-pp.__x64_sys_rt_sigprocmask
0.17 ± 2% -0.0 0.14 ± 10% perf-profile.self.cycles-pp.__might_sleep
0.25 -0.0 0.22 ± 3% perf-profile.self.cycles-pp.__get_user_nocheck_8
0.19 ± 2% -0.0 0.17 ± 2% perf-profile.self.cycles-pp.__put_user_nocheck_4
0.16 ± 2% -0.0 0.14 ± 4% perf-profile.self.cycles-pp.__send_signal
0.17 ± 2% -0.0 0.15 ± 3% perf-profile.self.cycles-pp.__clear_user
0.22 ± 2% -0.0 0.20 ± 3% perf-profile.self.cycles-pp.kmem_cache_alloc
0.13 -0.0 0.11 ± 3% perf-profile.self.cycles-pp.syscall_enter_from_user_mode
0.15 -0.0 0.13 ± 3% perf-profile.self.cycles-pp.entry_SYSCALL_64_safe_stack
0.12 ± 2% -0.0 0.10 ± 4% perf-profile.self.cycles-pp._copy_from_user
0.10 ± 4% -0.0 0.09 ± 5% perf-profile.self.cycles-pp.handler
0.14 ± 3% -0.0 0.12 ± 5% perf-profile.self.cycles-pp.get_signal
0.11 -0.0 0.09 ± 5% perf-profile.self.cycles-pp.__might_fault
0.08 ± 5% -0.0 0.07 perf-profile.self.cycles-pp.__sigqueue_alloc
0.09 ± 3% -0.0 0.08 ± 4% perf-profile.self.cycles-pp.restore_sigcontext
0.63 ± 5% +0.1 0.75 ± 7% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.60 ± 5% +0.2 0.81 ± 11% perf-profile.self.cycles-pp.fpregs_mark_activate
1.20 +0.4 1.59 perf-profile.self.cycles-pp.native_irq_return_iret
1.48 ± 5% +0.7 2.22 ± 14% perf-profile.self.cycles-pp.recalc_sigpending
2.48 ± 3% +2.0 4.53 perf-profile.self.cycles-pp._raw_spin_lock_irq
15.12 ± 2% +2.6 17.72 perf-profile.self.cycles-pp.do_dec_rlimit_put_ucounts
15.60 ± 2% +3.8 19.44 perf-profile.self.cycles-pp.inc_rlimit_get_ucounts
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
---
0DAY/LKP+ Test Infrastructure Open Source Technology Center
https://lists.01.org/hyperkitty/list/[email protected] Intel Corporation
Thanks,
Oliver Sang
6 months, 3 weeks
- 3
- 3