[sched] cec017ed87c: -35.9% fileio.requests_per_sec
by Fengguang Wu
Yuyang,
FYI, we noticed the below changes on
git://bee.sh.intel.com/git/ydu19/linux cc-v3-on-3.15-rc8
commit cec017ed87c7e5298fabaf1718f4f3c0fada0adb ("Remove update_rq_runnable_avg")
Test case: snb-drag/fileio/600s-100%-1HDD-xfs-64G-1024f-seqrewr-sync
v3.15-rc8 cec017ed87c7e5298fabaf171
--------------- -------------------------
6522 ~ 0% -35.9% 4183 ~ 0% TOTAL fileio.requests_per_sec
26744 ~11% -87.8% 3251 ~ 0% TOTAL proc-vmstat.workingset_nodereclaim
117412 ~ 0% -74.7% 29747 ~ 0% TOTAL proc-vmstat.slabs_scanned
1833 ~ 3% -63.8% 664 ~ 5% TOTAL proc-vmstat.kswapd_high_wmark_hit_quickly
2959 ~ 2% -45.6% 1610 ~ 2% TOTAL proc-vmstat.pageoutrun
7158189 ~ 0% -39.1% 4359933 ~ 0% TOTAL proc-vmstat.pgsteal_kswapd_dma32
7225747 ~ 0% -39.0% 4410503 ~ 0% TOTAL proc-vmstat.pgsteal_kswapd_normal
7202579 ~ 0% -38.8% 4406846 ~ 0% TOTAL proc-vmstat.pgscan_kswapd_dma32
7272151 ~ 0% -38.7% 4461197 ~ 0% TOTAL proc-vmstat.pgscan_kswapd_normal
3305425 ~ 0% -37.9% 2052786 ~ 0% TOTAL cpuidle.C1-SNB.usage
15453350 ~ 0% -36.5% 9816203 ~ 0% TOTAL proc-vmstat.nr_written
15454708 ~ 0% -36.6% 9790561 ~ 0% TOTAL proc-vmstat.pgfree
61898955 ~ 0% -36.4% 39352814 ~ 0% TOTAL proc-vmstat.pgpgout
62643 ~ 0% -35.9% 40129 ~ 0% TOTAL softirqs.BLOCK
15654950 ~ 0% -35.9% 10040787 ~ 0% TOTAL proc-vmstat.nr_dirtied
16729217 ~ 0% -33.9% 11065396 ~ 0% TOTAL proc-vmstat.numa_hit
16729217 ~ 0% -33.9% 11065396 ~ 0% TOTAL proc-vmstat.numa_local
8354814 ~ 0% -33.8% 5534438 ~ 0% TOTAL proc-vmstat.pgalloc_dma32
8419660 ~ 0% -33.8% 5575636 ~ 0% TOTAL proc-vmstat.pgalloc_normal
42342300 ~ 3% -31.0% 29195355 ~ 3% TOTAL cpuidle.C3-SNB.time
40089990 ~ 3% -28.1% 28834724 ~ 2% TOTAL cpuidle.C1E-SNB.time
26312 ~ 3% -27.6% 19054 ~ 2% TOTAL cpuidle.C3-SNB.usage
38112 ~ 3% -19.3% 30755 ~ 1% TOTAL cpuidle.C1E-SNB.usage
1122 ~ 1% +11.2% 1248 ~ 3% TOTAL proc-vmstat.pgactivate
330418 ~ 4% -11.7% 291792 ~ 1% TOTAL cpuidle.C6-SNB.usage
650 ~11% +69.8% 1103 ~ 0% TOTAL iostat.sda.w_await
650 ~11% +69.8% 1103 ~ 0% TOTAL iostat.sda.await
3540598 ~ 0% -35.9% 2269116 ~ 0% TOTAL time.voluntary_context_switches
1.252e+08 ~ 0% -35.9% 80326643 ~ 0% TOTAL time.file_system_outputs
94546 ~11% -31.3% 64935 ~ 0% TOTAL iostat.sda.wkB/s
186 ~11% -31.3% 128 ~ 0% TOTAL iostat.sda.w/s
94678 ~11% -31.3% 65072 ~ 0% TOTAL vmstat.io.bo
50.09 ~ 0% -34.6% 32.75 ~ 0% TOTAL time.system_time
11273 ~11% -29.4% 7964 ~ 0% TOTAL vmstat.system.cs
1.56 ~11% -27.8% 1.12 ~ 0% TOTAL iostat.sda.wrqm/s
131.77 ~11% +8.1% 142.40 ~ 0% TOTAL iostat.sda.avgqu-sz
662 ~14% -9.0% 602 ~ 0% TOTAL time.elapsed_time
Legend:
~XX% - stddev percent
[+-]XX% - change percent
time.system_time
55 ++---------------------------------------------------------------------+
| |
50 *+...*...*....*....*....*...* |
45 ++ |
| |
40 ++ |
| |
35 ++ |
| O O O O O O O O O O O
30 ++ |
25 ++ |
| |
20 ++ |
O O O O O |
15 ++---------------------------------------------------------------------+
time.voluntary_context_switches
4e+06 ++----------------------------------------------------------------+
| |
3.5e+06 *+..*....*...*....*...*...* |
3e+06 ++ |
| |
2.5e+06 ++ |
| O O O O O O O O O O O
2e+06 ++ |
| |
1.5e+06 ++ |
1e+06 ++ |
| |
500000 ++ |
O O O O O |
0 ++----------------------------------------------------------------+
time.file_system_outputs
1.3e+08 ++---------------------------------------------------------------+
1.25e+08 *+..*....*...*...*....*...* |
| |
1.2e+08 ++ |
1.15e+08 ++ |
| |
1.1e+08 ++ |
1.05e+08 ++ |
1e+08 ++ |
| |
9.5e+07 ++ |
9e+07 ++ |
| |
8.5e+07 ++ |
8e+07 O+--O----O---O---O----O---O---O----O---O---O----O---O---O----O---O
fileio.requests_per_sec
7000 ++-------------------------------------------------------------------+
| |
6500 *+...*...*....*...*....*....* |
| |
| |
6000 ++ |
| |
5500 ++ |
| |
5000 ++ |
| |
| |
4500 ++ |
O O O O O O O O O O O O O O O O
4000 ++-------------------------------------------------------------------+
iostat.sda.await
1200 ++-------------------------------------------------------------------+
| |
1100 O+ O O O O O O O O O O O O O O O
1000 ++ |
| |
900 ++ |
| |
800 ++ |
| |
700 ++ ..*...*....*...*. * |
600 *+. .. . |
| . .. |
500 ++ . |
| * |
400 ++-------------------------------------------------------------------+
iostat.sda.w_await
1200 ++-------------------------------------------------------------------+
| |
1100 O+ O O O O O O O O O O O O O O O
1000 ++ |
| |
900 ++ |
| |
800 ++ |
| |
700 ++ ..*...*....*...*. * |
600 *+. .. . |
| . .. |
500 ++ . |
| * |
400 ++-------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Fengguang
7 years, 12 months
[crypto] BUG: unable to handle kernel paging request at ffff88000bb88000
by Fengguang Wu
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
git://git.kernel.org/pub/scm/linux/kernel/git/herbert/cryptodev-2.6.git master
commit 64d1cdfbe20c50877576045145313c9b062c50f7
Author: Stephan Mueller <smueller(a)chronox.de>
AuthorDate: Sat May 31 17:25:36 2014 +0200
Commit: Herbert Xu <herbert(a)gondor.apana.org.au>
CommitDate: Fri Jun 20 21:26:10 2014 +0800
crypto: drbg - Add DRBG test code to testmgr
The DRBG test code implements the CAVS test approach.
As discussed for the test vectors, all DRBG types are covered with
testing. However, not every backend cipher is covered with testing. To
prevent the testmgr from logging missing testing, the NULL test is
registered for all backend ciphers not covered with specific test cases.
All currently implemented DRBG types and backend ciphers are defined
in SP800-90A. Therefore, the fips_allowed flag is set for all.
Signed-off-by: Stephan Mueller <smueller(a)chronox.de>
Signed-off-by: Herbert Xu <herbert(a)gondor.apana.org.au>
+----------------------------------------------------------------------------+------------+------------+
| | 3332ee2a17 | 64d1cdfbe2 |
+----------------------------------------------------------------------------+------------+------------+
| boot_successes | 81 | 3 |
| boot_failures | 0 | 23 |
| BUG:unable_to_handle_kernel_paging_request | 0 | 20 |
| Oops | 0 | 19 |
| RIP:kzfree | 0 | 15 |
| WARNING:CPU:PID:at_kernel/rcu/tree.c:rcu_do_batch() | 0 | 9 |
| backtrace:cryptomgr_test | 0 | 18 |
| backtrace:cpu_startup_entry | 0 | 3 |
| kernel_BUG_at_include/linux/mm.h | 0 | 1 |
| invalid_opcode | 0 | 1 |
| RIP:__free_pages | 0 | 1 |
| Kernel_panic-not_syncing:Fatal_exception_in_interrupt | 0 | 2 |
| BUG:unable_to_handle_kernel_NULL_pointer_dereference | 0 | 8 |
| RIP:cleanup_timers_list | 0 | 5 |
| BUG:scheduling_while_atomic | 0 | 5 |
| INFO:lockdep_is_turned_off | 0 | 5 |
| RIP:set_slob | 0 | 3 |
| backtrace:crc32_le_combine | 0 | 1 |
| backtrace:crc32test_init | 0 | 1 |
| backtrace:kernel_init_freeable | 0 | 2 |
| backtrace:acpi_bus_register_driver | 0 | 1 |
| backtrace:acpi_button_driver_init | 0 | 1 |
| RIP:symbol_string | 0 | 1 |
| backtrace:crypto_alloc_base | 0 | 1 |
| backtrace:drbg_init_sym_kernel | 0 | 1 |
| BUG:soft_lockup-CPU_stuck_for_s | 0 | 1 |
| RIP:native_read_tsc | 0 | 1 |
| Kernel_panic-not_syncing:softlockup:hung_tasks | 0 | 1 |
| RIP:wake_up_process | 0 | 1 |
| Kernel_panic-not_syncing:Attempted_to_kill_init_exitcode= | 0 | 1 |
| backtrace:async_schedule | 0 | 1 |
| backtrace:acpi_battery_init | 0 | 1 |
| general_protection_fault | 0 | 1 |
| RIP:rcu_do_batch | 0 | 1 |
| RIP:no_context | 0 | 0 |
| Kernel_panic-not_syncing:Attempted_to_kill_the_idle_task | 0 | 0 |
| Kernel_panic-not_syncing:CRED:put_cred_rcu()sees_with_mag,put,usage,subscr | 0 | 0 |
| backtrace:apic_timer_interrupt | 0 | 0 |
| backtrace:smpboot_thread_fn | 0 | 0 |
| RIP:__sprint_symbol | 0 | 0 |
| WARNING:CPU:PID:at_fs/inode.c:inc_nlink() | 0 | 0 |
| RIP:inc_nlink | 0 | 0 |
| backtrace:debugfs_create_dir | 0 | 0 |
| backtrace:notifier_err_inject_init | 0 | 0 |
| backtrace:err_inject_init | 0 | 0 |
| RIP:rcu_accelerate_cbs | 0 | 0 |
| kernel_BUG_at_kernel/cred.c | 0 | 0 |
| RIP:__validate_process_creds | 0 | 0 |
| RIP:vsnprintf | 0 | 0 |
| WARNING:CPU:PID:at_kernel/exit.c:do_exit() | 0 | 0 |
| RIP:__wake_up_common | 0 | 0 |
| RIP:pick_next_task_fair | 0 | 0 |
| backtrace:drbg_instantiate | 0 | 0 |
| backtrace:drbg_kcapi_init | 0 | 0 |
+----------------------------------------------------------------------------+------------+------------+
[ 1.905933] Key type big_key registered
[ 1.913728] alg: No test for lz4 (lz4-generic)
[ 1.914544] alg: No test for stdrng (krng)
[ 1.932092] BUG: unable to handle kernel paging request at ffff88000bb88000
[ 1.933086] IP: [<ffffffff81120c8c>] kzfree+0x20/0x2d
[ 1.933791] PGD 2a5c067 PUD 2a5d067 PMD 12792067 PTE 800000000bb88060
[ 1.934722] Oops: 0002 [#1] PREEMPT SMP DEBUG_PAGEALLOC
[ 1.935497] Modules linked in:
[ 1.935927] CPU: 1 PID: 67 Comm: cryptomgr_test Not tainted 3.16.0-rc1-00011-g64d1cdf #1
[ 1.936987] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Bochs 01/01/2011
[ 1.938040] task: ffff88000bbc6000 ti: ffff88000bbcc000 task.ti: ffff88000bbcc000
[ 1.939014] RIP: 0010:[<ffffffff81120c8c>] [<ffffffff81120c8c>] kzfree+0x20/0x2d
[ 1.940013] RSP: 0000:ffff88000bbcfba0 EFLAGS: 00010246
[ 1.940013] RAX: 0000000000000000 RBX: ffff88000bb855d8 RCX: 000000003c0beac4
[ 1.940013] RDX: 0000200000000880 RSI: 000000000000bb85 RDI: ffff88000bb88000
[ 1.940013] RBP: ffff88000bbcfba8 R08: 0000000000000000 R09: 0000000000000000
[ 1.940013] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88000bb855d8
[ 1.940013] R13: ffff88000bd0a3e0 R14: ffff88000bb853d8 R15: 0000000000000001
[ 1.940013] FS: 0000000000000000(0000) GS:ffff880012400000(0000) knlGS:0000000000000000
[ 1.940013] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 1.940013] CR2: ffff88000bb88000 CR3: 00000000017b2000 CR4: 00000000000006a0
[ 1.940013] Stack:
[ 1.940013] ffff88000bb855d8 ffff88000bbcfbd0 ffffffff81211b0e ffff88000bb85430
[ 1.940013] 0000000000000000 ffff88000bbcfcc8 ffff88000bbcfbe8 ffffffff81234a68
[ 1.940013] ffff88000bb85430 ffff88000bbcfc08 ffffffff81235099 ffff88000bb85430
[ 1.940013] Call Trace:
[ 1.940013] [<ffffffff81211b0e>] crypto_destroy_tfm+0x4d/0x54
[ 1.940013] [<ffffffff81234a68>] drbg_fini_sym_kernel+0x1e/0x2b
[ 1.940013] [<ffffffff81235099>] drbg_instantiate+0x1a0/0x266
[ 1.940013] [<ffffffff812352ab>] drbg_kcapi_reset+0x14c/0x15b
[ 1.940013] [<ffffffff812118c3>] ? __crypto_alloc_tfm+0xc4/0x10e
[ 1.940013] [<ffffffff812342b9>] rngapi_reset+0x5c/0x78
[ 1.940013] [<ffffffff81218cae>] drbg_cavs_test+0x102/0x285
[ 1.940013] [<ffffffff810a5690>] ? trace_hardirqs_on+0xd/0xf
[ 1.940013] [<ffffffff81218ea5>] alg_test_drbg+0x74/0xa7
[ 1.940013] [<ffffffff8121ae87>] alg_test+0x221/0x255
[ 1.940013] [<ffffffff81268338>] ? __this_cpu_preempt_check+0x13/0x15
[ 1.940013] [<ffffffff810a5663>] ? trace_hardirqs_on_caller+0x1b7/0x1d7
[ 1.940013] [<ffffffff810a5690>] ? trace_hardirqs_on+0xd/0xf
[ 1.940013] [<ffffffff8121830e>] ? cryptomgr_notify+0x33c/0x33c
[ 1.940013] [<ffffffff81218336>] cryptomgr_test+0x28/0x43
[ 1.940013] [<ffffffff81087928>] kthread+0xf9/0x101
[ 1.940013] [<ffffffff8108782f>] ? kthread_create_on_node+0x199/0x199
[ 1.940013] [<ffffffff814f8abc>] ret_from_fork+0x7c/0xb0
[ 1.940013] [<ffffffff8108782f>] ? kthread_create_on_node+0x199/0x199
[ 1.940013] Code: e0 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 44 00 00 55 48 83 ff 10 48 89 e5 53 48 89 fb 76 17 e8 9d 3c 02 00 48 89 df 48 89 c1 31 c0 <f3> aa 48 89 df e8 0c 49 02 00 5b 5d c3 0f 1f 44 00 00 55 48 89
[ 1.940013] RIP [<ffffffff81120c8c>] kzfree+0x20/0x2d
[ 1.940013] RSP <ffff88000bbcfba0>
[ 1.940013] CR2: ffff88000bb88000
[ 1.940013] ---[ end trace 6c1e6d95c2af0ff8 ]---
[ 1.972664] BUG: unable to handle kernel NULL pointer dereference at (null)
git bisect start 48d858dc21505dc2617c5fa8c0a19be2d93fe661 a497c3ba1d97fc69c1e78e7b96435ba8c2cb42ee --
git bisect good 40b491fefc860b3b366897256b8d5adde6c4be41 # 23:31 20+ 0 Merge 'renesas/devel' into devel-hourly-2014062713
git bisect bad 4f9aca3aee3bdd6c1951b8df8afbab91f6923375 # 23:41 2- 13 Merge 'wireless/master' into devel-hourly-2014062713
git bisect good a6be7250646c37d8048cb99526a16a79f4e0379c # 23:59 21+ 0 Merge 'netdev-next/master' into devel-hourly-2014062713
git bisect bad 4e44b90704b1a70e2c224a6ab42a76e5754c6a7d # 00:02 1- 9 Merge 'gfs2/master' into devel-hourly-2014062713
git bisect good 996422e71c00dfa42c0f5699b8260a2d51545195 # 00:13 21+ 0 Merge 'efi/next' into devel-hourly-2014062713
git bisect bad e2447c52f40ea90a5d6e9847268366775f4c0f78 # 00:26 9- 20 Merge 'cryptodev/master' into devel-hourly-2014062713
git bisect bad b3416fb8a2f5a1653e4ab72b55907794cc10bde1 # 00:30 10- 23 crypto: qat - Intel(R) QAT accelengine part of fw loader
git bisect good 3332ee2a17b1bd69e4602e2d6ba1b07edb0c9a24 # 00:36 27+ 0 crypto: drbg - DRBG testmgr test vectors
git bisect bad d8cba25d2c68992a6e7c1d329b690a9ebe01167d # 00:39 2- 21 crypto: qat - Intel(R) QAT driver framework
git bisect bad 3d77565ba5e5b9075a4f6d7d6d15996f5e582659 # 00:43 0- 17 crypto: ccp - Modify PCI support in prep for arm64 support
git bisect bad 64d1cdfbe20c50877576045145313c9b062c50f7 # 00:45 3- 23 crypto: drbg - Add DRBG test code to testmgr
# first bad commit: [64d1cdfbe20c50877576045145313c9b062c50f7] crypto: drbg - Add DRBG test code to testmgr
git bisect good 3332ee2a17b1bd69e4602e2d6ba1b07edb0c9a24 # 00:48 81+ 0 crypto: drbg - DRBG testmgr test vectors
git bisect bad 48d858dc21505dc2617c5fa8c0a19be2d93fe661 # 00:49 0- 73 0day head guard for 'devel-hourly-2014062713'
git bisect good 3e7b256cba330240c8fcde3d01c65bfda12a2847 # 07:43 81+ 0 Merge tag 'iommu-fixes-v3.16-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/joro/iommu
git bisect bad 96426007c90cde23c0402856f3e0aec0f4cc2e48 # 07:52 0- 1 Add linux-next specific files for 20140627
This script may reproduce the error.
-----------------------------------------------------------------------------
#!/bin/bash
kernel=$1
initrd=quantal-core-x86_64.cgz
wget --no-clobber https://github.com/fengguang/reproduce-kernel-bug/blob/master/initrd/$initrd
kvm=(
qemu-system-x86_64 -cpu kvm64 -enable-kvm
-kernel $kernel
-initrd $initrd
-smp 2
-m 256M
-net nic,vlan=0,macaddr=00:00:00:00:00:00,model=virtio
-net user,vlan=0
-net nic,vlan=1,model=e1000
-net user,vlan=1
-boot order=nc
-no-reboot
-watchdog i6300esb
-serial stdio
-display none
-monitor null
)
append=(
debug
sched_debug
apic=debug
ignore_loglevel
sysrq_always_enabled
panic=10
prompt_ramdisk=0
earlyprintk=ttyS0,115200
console=ttyS0,115200
console=tty0
vga=normal
root=/dev/ram0
rw
)
"${kvm[@]}" --append "${append[*]}"
-----------------------------------------------------------------------------
Thanks,
Fengguang
_______________________________________________
LKP mailing list
LKP(a)linux.intel.com
8 years
[clockevents] WARNING: CPU: 1 PID: 0 at kernel/time/clockevents.c:281 clockevents_program_event()
by Fengguang Wu
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
git://bee.sh.intel.com/git/tchen37/linux.git test
commit 2f89103f5b85386245b434e8e9f66d25df929e65
Author: Viresh Kumar <viresh.kumar(a)linaro.org>
AuthorDate: Tue Jun 10 13:52:25 2014 +0530
Commit: Viresh Kumar <viresh.kumar(a)linaro.org>
CommitDate: Tue Jun 24 10:54:12 2014 +0530
clockevents: x86: add support for ONESHOT_STOPPED mode
Clockevent devices can be stopped from core (hrtimers/tick) when they aren't
used anymore. This will mostly happen on a idle or tickless cpu. This is done to
avoid getting spurious interrupts when core doesn't want to handle them anymore.
For stopping clockevent devices, core requests drivers to switch to a special
optional mode: CLOCK_EVT_MODE_ONESHOT_STOPPED. At this time platforms can also
save some power by disabling these devices.
This patch adds support for handling CLOCK_EVT_MODE_ONESHOT_STOPPED mode for x86
drivers.
Signed-off-by: Viresh Kumar <viresh.kumar(a)linaro.org>
===================================================
PARENT COMMIT NOT CLEAN. LOOK OUT FOR WRONG BISECT!
===================================================
+--------------------------------------------------------------------------+------------+------------+------------------+
| | 12776fe030 | 2f89103f5b | v3.16-rc2_062520 |
+--------------------------------------------------------------------------+------------+------------+------------------+
| boot_successes | 508 | 127 | 10 |
| boot_failures | 2 | 43 | 3 |
| BUG:unable_to_handle_kernel_NULL_pointer_dereference | 1 | | |
| Oops | 1 | | |
| RIP:cipso_v4_sock_delattr | 1 | | |
| Kernel_panic-not_syncing:Fatal_exception_in_interrupt | 1 | | |
| backtrace:SYSC_sendto | 1 | | |
| backtrace:SyS_sendto | 1 | | |
| WARNING:CPU:PID:at_mm/page_alloc.c:__alloc_pages_nodemask() | 1 | | |
| backtrace:SYSC_setsockopt | 1 | | |
| backtrace:SyS_setsockopt | 1 | | |
| WARNING:CPU:PID:at_kernel/time/clockevents.c:clockevents_program_event() | 0 | 43 | 3 |
| backtrace:cpu_startup_entry | 0 | 1 | |
| page_allocation_failure:order:,mode | 0 | 1 | |
| backtrace:vmalloc | 0 | 1 | |
| backtrace:SyS_init_module | 0 | 1 | |
+--------------------------------------------------------------------------+------------+------------+------------------+
[ 0.374384] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[ 0.375068] ------------[ cut here ]------------
[ 0.375068] ------------[ cut here ]------------
[ 0.375077] WARNING: CPU: 1 PID: 0 at kernel/time/clockevents.c:281 clockevents_program_event+0x7c/0xee()
git bisect start b96eb52b4d3f5453ffc4494fa747677531b97b16 a497c3ba1d97fc69c1e78e7b96435ba8c2cb42ee --
git bisect good fb4cfc807d1c5f7a71b20fce26ec710d08451c2e # 23:39 53+ 0 Merge 'ljones-mfd/for-mfd-next' into devel-hourly-2014062520
git bisect good 5481bbb71a5602fd05f79018b5120c41eb79e45c # 23:50 53+ 0 Merge 'asoc/topic/intel' into devel-hourly-2014062520
git bisect good 5ecbbba6188169cc0196c55be04dddb37c0d12ab # 00:29 53+ 0 Merge 'block/for-next' into devel-hourly-2014062520
git bisect good 050d21efb9b17e339b500ba7f7e87917040e17fa # 03:06 53+ 0 Merge 'jlayton/nfsd-devel' into devel-hourly-2014062520
git bisect bad 0c98564ae323a39cd07e137b034c4efaa0ae119d # 05:35 43- 10 Merge 'tip/core/urgent' into devel-hourly-2014062520
git bisect good 8efa8d112f811c64c0cdb0c9e0611f01f98868b9 # 17:21 83+ 1 Merge 'rcu/rcu/urgent' into devel-hourly-2014062520
git bisect bad 929b24513f0f9e75c99499d9bf70e45150874bee # 19:06 7- 1 Merge 'vireshk2/tick/oneshot-stopped' into devel-hourly-2014062520
git bisect good f935474b892829a400f31ec076385b792034a32e # 22:47 346+ 0 clockevents: Introduce CLOCK_EVT_MODE_ONESHOT_STOPPED mode
git bisect good 12776fe0306cfa180168752059efdc34eb3425aa # 23:17 170+ 0 clockevents: mips: add support for ONESHOT_STOPPED mode
git bisect bad 29228f060dc66217023305b34bb442e62524ae3e # 00:00 27- 5 clockevents: misc: add support for ONESHOT_STOPPED mode
git bisect bad 4b62c326e54d2f54b761624a9f002b73b34fdfff # 00:07 4- 4 clockevents: drivers: add support for ONESHOT_STOPPED mode
git bisect bad 2f89103f5b85386245b434e8e9f66d25df929e65 # 00:13 40- 3 clockevents: x86: add support for ONESHOT_STOPPED mode
# first bad commit: [2f89103f5b85386245b434e8e9f66d25df929e65] clockevents: x86: add support for ONESHOT_STOPPED mode
git bisect good 12776fe0306cfa180168752059efdc34eb3425aa # 00:25 510+ 2 clockevents: mips: add support for ONESHOT_STOPPED mode
git bisect bad b96eb52b4d3f5453ffc4494fa747677531b97b16 # 00:25 0- 3 0day head guard for 'devel-hourly-2014062520'
git bisect good 3e7b256cba330240c8fcde3d01c65bfda12a2847 # 09:35 510+ 0 Merge tag 'iommu-fixes-v3.16-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/joro/iommu
git bisect good 96426007c90cde23c0402856f3e0aec0f4cc2e48 # 15:58 510+ 0 Add linux-next specific files for 20140627
This script may reproduce the error.
-----------------------------------------------------------------------------
#!/bin/bash
kernel=$1
initrd=quantal-core-x86_64.cgz
wget --no-clobber https://github.com/fengguang/reproduce-kernel-bug/blob/master/initrd/$initrd
kvm=(
qemu-system-x86_64 -cpu kvm64 -enable-kvm
-kernel $kernel
-initrd $initrd
-smp 2
-m 256M
-net nic,vlan=0,macaddr=00:00:00:00:00:00,model=virtio
-net user,vlan=0
-net nic,vlan=1,model=e1000
-net user,vlan=1
-boot order=nc
-no-reboot
-watchdog i6300esb
-serial stdio
-display none
-monitor null
)
append=(
debug
sched_debug
apic=debug
ignore_loglevel
sysrq_always_enabled
panic=10
prompt_ramdisk=0
earlyprintk=ttyS0,115200
console=ttyS0,115200
console=tty0
vga=normal
root=/dev/ram0
rw
)
"${kvm[@]}" --append "${append[*]}"
-----------------------------------------------------------------------------
Thanks,
Fengguang
_______________________________________________
LKP mailing list
LKP(a)linux.intel.com
8 years
[rcu] 2d033d5c0d4: +225.2% iperf.tcp.sender.bps
by Fengguang Wu
Hi Paul,
FYI, we noticed the below changes on
git://git.kernel.org/pub/scm/linux/kernel/git/paulmck/linux-rcu.git rcu/next
commit 2d033d5c0d424b7029abd0fc82e940ebc318fd89 ("rcu: Bind grace-period kthreads to non-NO_HZ_FULL CPUs")
test case: bens/iperf/300s-tcp
e17adc3f20bc9a1 2d033d5c0d424b7029abd0fc8
--------------- -------------------------
7.011e+09 ~ 1% +225.2% 2.28e+10 ~ 2% TOTAL iperf.tcp.sender.bps
7.011e+09 ~ 1% +225.2% 2.28e+10 ~ 2% TOTAL iperf.tcp.receiver.bps
15620691 ~ 1% +224.3% 50663012 ~ 2% TOTAL proc-vmstat.pgalloc_normal
62969722 ~ 1% +224.3% 2.042e+08 ~ 2% TOTAL proc-vmstat.pgfree
47347349 ~ 1% +224.3% 1.535e+08 ~ 2% TOTAL proc-vmstat.pgalloc_dma32
4996590 ~ 1% +218.9% 15933563 ~ 3% TOTAL softirqs.NET_RX
8084072 ~ 1% +218.4% 25739055 ~ 2% TOTAL proc-vmstat.numa_hit
8084072 ~ 1% +218.4% 25739055 ~ 2% TOTAL proc-vmstat.numa_local
28676 ~ 2% -47.5% 15059 ~11% TOTAL softirqs.RCU
99756 ~ 2% +76.0% 175606 ~ 2% TOTAL softirqs.SCHED
562 ~11% +50.9% 848 ~17% TOTAL slabinfo.proc_inode_cache.active_objs
620 ~ 8% +38.7% 860 ~15% TOTAL slabinfo.proc_inode_cache.num_objs
271905 ~ 4% +17.4% 319216 ~ 0% TOTAL softirqs.TIMER
1117 ~ 1% -9.1% 1015 ~ 2% TOTAL proc-vmstat.pgactivate
9049 ~11% -94.6% 485 ~26% TOTAL time.involuntary_context_switches
23233 ~ 1% +72.1% 39979 ~ 2% TOTAL vmstat.system.cs
13078 ~ 1% +69.1% 22117 ~ 1% TOTAL vmstat.system.in
Legend:
~XX% - stddev percent
[+-]XX% - change percent
iperf.tcp.sender.bps
2.4e+10 ++----O-----O-----------O--------------O-----O--------O-----O-----+
| O O O O O O O O |
2.2e+10 O+ O O O |
2e+10 ++ O |
| |
1.8e+10 ++ |
1.6e+10 ++ O O |
| |
1.4e+10 ++ |
1.2e+10 ++ |
| |
1e+10 ++ |
8e+09 ++ |
*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*
6e+09 ++----------------------------------------------------------------+
iperf.tcp.receiver.bps
2.4e+10 ++----O-----O-----------O--------------O-----O--------O-----O-----+
| O O O O O O O O |
2.2e+10 O+ O O O |
2e+10 ++ O |
| |
1.8e+10 ++ |
1.6e+10 ++ O O |
| |
1.4e+10 ++ |
1.2e+10 ++ |
| |
1e+10 ++ |
8e+09 ++ |
*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*
6e+09 ++----------------------------------------------------------------+
time.involuntary_context_switches
14000 ++------------------------------------------------------------------+
| |
12000 *+. .*.. ..*..*.. .*.. |
| .*..*. *. *. |
10000 ++ *. *..*.. .*..*..*.. ..*..*.. *
| *. *. .*.. ..|
8000 ++ *. * |
| |
6000 ++ |
| |
4000 ++ |
| |
2000 ++ |
| O O O O |
0 O+-O--O--O--O--O---O--O--O--O--O--O--O--O-----O------O--O-----O-----+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Fengguang
8 years
[sched] WARNING: CPU: 0 PID: 1 at kernel/sched/core.c:6069 build_sched_domain()
by Fengguang Wu
Greetings,
0day kernel testing robot got the below dmesg and the first bad commit is
git://bee.sh.intel.com/git/ydu19/linux cc-v4-on-3.16-rc2
commit 981fa8778958e70170ad2e757bc75f5e3c688665
Author: Yuyang Du <yuyang.du(a)intel.com>
AuthorDate: Wed Jun 25 03:57:18 2014 +0800
Commit: Yuyang Du <yuyang.du(a)intel.com>
CommitDate: Thu Jun 26 15:06:56 2014 +0800
Define SD_WORKLOAD_CONSOLIDATION and attach to sched_domain
Workload Consolidation is completely CPU topology and policy driven. To do so,
we define SD_WORKLOAD_CONSOLIDATION, and add some fields in sched_domain struct:
1) total_groups is the group number in total in this domain
2) group_number is this CPU's group sequence number
3) consolidating_coeff is the coefficient for consolidating CPUs, and is changeable
via sysctl tool to make consolidation more aggressive or less
4) first_group is the pointer to this domain's first group ordered by CPU number
This patchset enables SD_WORKLOAD_CONSOLIDATION in MC domain by default. But we need
to come up with a better way to determine on which architecture this flag should be
enabled or not. Thanks to PeterZ and Dietmar for pointing this out and help me
finally understand it.
Signed-off-by: Yuyang Du <yuyang.du(a)intel.com>
===================================================
PARENT COMMIT NOT CLEAN. LOOK OUT FOR WRONG BISECT!
===================================================
Attached dmesg for the parent commit, too, to help confirm whether it is a noise error.
+-------------------------------------------------------------+------------+------------+------------------+
| | 3b3fb61976 | 981fa87789 | v3.16-rc2_062617 |
+-------------------------------------------------------------+------------+------------+------------------+
| boot_successes | 76 | 0 | 0 |
| boot_failures | 3 | 20 | 13 |
| WARNING:CPU:PID:at_mm/early_ioremap.c:__early_ioremap() | 1 | | |
| BUG:kernel_boot_crashed | 2 | | |
| WARNING:CPU:PID:at_kernel/sched/core.c:build_sched_domain() | 0 | 20 | 13 |
| backtrace:build_sched_domains | 0 | 20 | 13 |
| backtrace:sched_init_smp | 0 | 20 | 13 |
| backtrace:kernel_init_freeable | 0 | 20 | 13 |
| BUG:unable_to_handle_kernel_NULL_pointer_dereference | 0 | 0 | 6 |
| Oops | 0 | 0 | 6 |
| RIP:run_timer_softirq | 0 | 0 | 1 |
| Kernel_panic-not_syncing:Fatal_exception_in_interrupt | 0 | 0 | 3 |
| backtrace:cryptomgr_test | 0 | 0 | 2 |
| BUG:unable_to_handle_kernel_paging_request | 0 | 0 | 5 |
| RIP:kzfree | 0 | 0 | 3 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 0 | 4 |
| RIP:__insert_vmap_area | 0 | 0 | 1 |
| backtrace:add_disk | 0 | 0 | 1 |
| backtrace:null_init | 0 | 0 | 1 |
| kernel_BUG_at_kernel/cred.c | 0 | 0 | 1 |
| invalid_opcode | 0 | 0 | 1 |
| RIP:__invalid_creds | 0 | 0 | 1 |
| backtrace:delayed_put_task_struct | 0 | 0 | 1 |
| BUG:u | 0 | 0 | 1 |
| INFO:task_blocked_for_more_than_seconds | 0 | 0 | 1 |
| RIP:native_safe_halt | 0 | 0 | 1 |
| RIP:flat_send_IPI_mask | 0 | 0 | 1 |
| Kernel_panic-not_syncing:hung_task:blocked_tasks | 0 | 0 | 1 |
| backtrace:register_pernet_subsys | 0 | 0 | 1 |
| backtrace:packet_init | 0 | 0 | 1 |
| backtrace:watchdog | 0 | 0 | 1 |
| BUG:unable_to_handle_kernel | 0 | 0 | 1 |
| RIP:no_context | 0 | 0 | 1 |
| INFO:trying_to_register_non-static_key | 0 | 0 | 1 |
+-------------------------------------------------------------+------------+------------+------------------+
[ 0.169944] smpboot: Total of 2 processors activated (9575.99 BogoMIPS)
[ 0.172397] ------------[ cut here ]------------
[ 0.172397] ------------[ cut here ]------------
[ 0.173600] WARNING: CPU: 0 PID: 1 at kernel/sched/core.c:6069 build_sched_domain+0xbe/0x2e8()
git bisect start 9c33bf1e59d26dad8dc45e438cbdc28783589b11 a497c3ba1d97fc69c1e78e7b96435ba8c2cb42ee --
git bisect good 10d9d029067f2aacbdc140786efff146d79b34c5 # 23:21 20+ 1 Merge 'cgroup/for-3.16-fixes' into devel-hourly-2014062617
git bisect bad b8db0fc896849e940f23fbea02c137869c94f3d3 # 23:44 0- 20 Merge 'kvm-ppc/kvm-ppc-queue' into devel-hourly-2014062617
git bisect good 7135b130d9f1c30321f9a9e024498557026cdd03 # 00:11 20+ 0 Merge 'arm-platforms/kvm-arm64/irq-forward' into devel-hourly-2014062617
git bisect good c2484a8acda7d9ff41a98d3e2fcc5a65bbd02747 # 00:21 20+ 1 Merge 'arc/for-next' into devel-hourly-2014062617
git bisect good 1a799f5c9dbbd47d503af1e0cedf9d252cca2d6d # 00:37 20+ 19 Merge 'cryptodev/master' into devel-hourly-2014062617
git bisect bad 9c259d6a46e754ea8fb42bcf688255ffa2c8c048 # 00:40 0- 11 Merge 'yuyang/cc-v4-on-3.16-rc2' into devel-hourly-2014062617
git bisect bad 1a43e8a377f4adc5c9a412de1a57ab453f8313d4 # 00:45 0- 1 Workload Consolidation: Consolidating workload to a subset of CPUs if possible
git bisect good 7dee841147a972e809dfcd75f638d7145dd8e756 # 00:50 20+ 0 sched: Precise accumulated time and acount runnable number in update_entity_runnable_avg
git bisect bad 981fa8778958e70170ad2e757bc75f5e3c688665 # 00:54 0- 20 Define SD_WORKLOAD_CONSOLIDATION and attach to sched_domain
git bisect good 3b3fb61976509ef8f7c0c05adba0b61cea6b05db # 00:59 20+ 1 How CPU ConCurrency (CC) accrues with runqueue change and time
# first bad commit: [981fa8778958e70170ad2e757bc75f5e3c688665] Define SD_WORKLOAD_CONSOLIDATION and attach to sched_domain
git bisect good 3b3fb61976509ef8f7c0c05adba0b61cea6b05db # 01:02 60+ 4 How CPU ConCurrency (CC) accrues with runqueue change and time
git bisect bad 9c33bf1e59d26dad8dc45e438cbdc28783589b11 # 01:02 0- 13 0day head guard for 'devel-hourly-2014062617'
git bisect good eb477e03feb8dacb3a9e3b2f750ff6c6eeffee33 # 05:06 60+ 4 Merge git://git.kernel.org/pub/scm/linux/kernel/git/nab/target-pending
git bisect good 96426007c90cde23c0402856f3e0aec0f4cc2e48 # 08:30 60+ 53 Add linux-next specific files for 20140627
This script may reproduce the error.
-----------------------------------------------------------------------------
#!/bin/bash
kernel=$1
kvm=(
qemu-system-x86_64 -cpu kvm64 -enable-kvm
-kernel $kernel
-smp 2
-m 256M
-net nic,vlan=0,macaddr=00:00:00:00:00:00,model=virtio
-net user,vlan=0
-net nic,vlan=1,model=e1000
-net user,vlan=1
-boot order=nc
-no-reboot
-watchdog i6300esb
-serial stdio
-display none
-monitor null
)
append=(
debug
sched_debug
apic=debug
ignore_loglevel
sysrq_always_enabled
panic=10
prompt_ramdisk=0
earlyprintk=ttyS0,115200
console=ttyS0,115200
console=tty0
vga=normal
root=/dev/ram0
rw
)
"${kvm[@]}" --append "${append[*]}"
-----------------------------------------------------------------------------
Thanks,
Fengguang
_______________________________________________
LKP mailing list
LKP(a)linux.intel.com
8 years
[clockevents] d5a085970b0: -9.2% will-it-scale.per_thread_ops
by Fengguang Wu
Hi Viresh,
I'm not sure how the simple commit will impact will-it-scale/pwrite2
throughput. Just in case you can see more clues.
git://git.linaro.org/people/vireshk/linux tick/ONESHOT-STOPPED
commit d5a085970b0b88b8c82303d2c45f09c9427fd02a ("clockevents: x86: add support for ONESHOT_STOPPED mode")
test case: nhm4/will-it-scale/pwrite2
f4f5df6f142f679 d5a085970b0b88b8c82303d2c
--------------- -------------------------
773859 ~ 0% -9.2% 702704 ~ 0% TOTAL will-it-scale.per_thread_ops
Legend:
~XX% - stddev percent
[+-]XX% - change percent
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Fengguang
8 years
[mempolicy] 5507231dd04: -18.2% vm-scalability.migrate_mbps
by Jet Chen
Hi Naoya,
FYI, we noticed the below changes on
git://git.kernel.org/pub/scm/linux/kernel/git/balbi/usb.git am437x-starterkit
commit 5507231dd04d3d68796bafe83e6a20c985a0ef68 ("mempolicy: apply page table walker on queue_pages_range()")
test case: ivb44/vm-scalability/300s-migrate
8c81f3eeb336567 5507231dd04d3d68796bafe83
--------------- -------------------------
347258 ~ 0% -18.2% 284195 ~ 0% TOTAL vm-scalability.migrate_mbps
0.00 +Inf% 0.94 ~ 7% TOTAL perf-profile.cpu-cycles._raw_spin_lock.__walk_page_range.walk_page_range.queue_pages_range.migrate_to_node
11.49 ~ 1% -100.0% 0.00 ~ 0% TOTAL perf-profile.cpu-cycles.vm_normal_page.queue_pages_range.migrate_to_node.do_migrate_pages.SYSC_migrate_pages
69.40 ~ 0% -100.0% 0.00 ~ 0% TOTAL perf-profile.cpu-cycles.queue_pages_range.migrate_to_node.do_migrate_pages.SYSC_migrate_pages.sys_migrate_pages
3.68 ~ 3% -100.0% 0.00 ~ 0% TOTAL perf-profile.cpu-cycles.vm_normal_page.migrate_to_node.do_migrate_pages.SYSC_migrate_pages.sys_migrate_pages
0.00 +Inf% 4.51 ~ 2% TOTAL perf-profile.cpu-cycles.vm_normal_page.__walk_page_range.walk_page_range.queue_pages_range.migrate_to_node
0.00 +Inf% 8.36 ~ 1% TOTAL perf-profile.cpu-cycles.__walk_page_range.walk_page_range.queue_pages_range.migrate_to_node.do_migrate_pages
1.17 ~ 4% -100.0% 0.00 ~ 0% TOTAL perf-profile.cpu-cycles._raw_spin_lock.queue_pages_range.migrate_to_node.do_migrate_pages.SYSC_migrate_pages
0.00 +Inf% 9.30 ~ 2% TOTAL perf-profile.cpu-cycles.vm_normal_page.queue_pages_pte.__walk_page_range.walk_page_range.queue_pages_range
0.00 +Inf% 63.92 ~ 1% TOTAL perf-profile.cpu-cycles.queue_pages_pte.__walk_page_range.walk_page_range.queue_pages_range.migrate_to_node
61 ~32% +363.8% 286 ~10% TOTAL numa-vmstat.node0.nr_unevictable
257 ~30% +345.5% 1147 ~10% TOTAL numa-meminfo.node0.Unevictable
1133 ~ 8% +129.0% 2596 ~ 0% TOTAL meminfo.Unevictable
282 ~ 8% +129.1% 647 ~ 0% TOTAL proc-vmstat.nr_unevictable
93913 ~ 7% -49.8% 47172 ~ 3% TOTAL softirqs.RCU
113808 ~ 1% -45.4% 62087 ~ 0% TOTAL softirqs.SCHED
362197 ~ 0% -32.9% 243163 ~ 0% TOTAL cpuidle.C6-IVT.usage
1.49 ~ 3% -19.6% 1.20 ~ 4% TOTAL perf-profile.cpu-cycles.intel_idle.cpuidle_enter_state.cpuidle_enter.cpu_startup_entry.start_secondary
743815 ~ 2% -20.3% 592628 ~ 6% TOTAL proc-vmstat.pgmigrate_fail
310 ~ 6% +16.6% 362 ~ 8% TOTAL numa-vmstat.node1.nr_unevictable
1243 ~ 6% +16.5% 1448 ~ 8% TOTAL numa-meminfo.node1.Unevictable
1230 ~ 6% +16.6% 1434 ~ 8% TOTAL numa-meminfo.node1.Mlocked
307 ~ 6% +16.7% 358 ~ 8% TOTAL numa-vmstat.node1.nr_mlock
3943910 ~ 0% -12.3% 3459206 ~ 0% TOTAL proc-vmstat.pgfault
4402 ~ 3% -13.4% 3812 ~ 5% TOTAL numa-meminfo.node1.KernelStack
15303 ~ 7% -17.5% 12621 ~ 9% TOTAL slabinfo.kmalloc-192.num_objs
15301 ~ 7% -17.5% 12621 ~ 9% TOTAL slabinfo.kmalloc-192.active_objs
30438 ~ 0% +91.0% 58142 ~ 0% TOTAL time.involuntary_context_switches
162 ~ 3% +81.9% 296 ~ 0% TOTAL time.system_time
53 ~ 3% +81.1% 96 ~ 0% TOTAL time.percent_of_cpu_this_job_got
2586283 ~ 0% -18.5% 2107842 ~ 0% TOTAL time.minor_page_faults
48619 ~ 0% -18.1% 39800 ~ 0% TOTAL time.voluntary_context_switches
2037 ~ 0% -17.7% 1677 ~ 0% TOTAL vmstat.system.in
2206 ~ 0% -4.7% 2101 ~ 0% TOTAL vmstat.system.cs
~ 1% -3.6% ~ 1% TOTAL turbostat.Cor_W
~ 1% -2.2% ~ 1% TOTAL turbostat.Pkg_W
2.17 ~ 0% -1.4% 2.14 ~ 0% TOTAL turbostat.%c0
Legend:
~XX% - stddev percent
[+-]XX% - change percent
time.system_time
300 O+O--O-O-O--O-O-O--O-O-O--O-O-O--O-O-O--O-O-O-------------------------+
| |
280 ++ |
260 ++ |
| |
240 ++ |
| |
220 ++ |
| |
200 ++ |
180 ++ |
| .*. .* .*. |
160 *+*.. .*. .* *..*.*.*.. .*.*..*.*.*. + .*..*.*. .*.*.*. *.*..*.|
| * *. * * *. *
140 ++--------------------------------------------------------------------+
time.percent_of_cpu_this_job_got
100 ++--------------------------------------------------------------------+
95 O+O O O O O O O O O O O O O O O O O O |
| O |
90 ++ |
85 ++ |
| |
80 ++ |
75 ++ |
70 ++ |
| |
65 ++ |
60 ++ |
| .*. |
55 *+*.. .*. .*.*.*..*.*.*.. .*.*..*.*.*..*. .*..*.*. .*. .*. *.*..*.|
50 ++---*---*----------------*---------------*--------*----*-------------*
time.minor_page_faults
2.7e+06 ++----------------------------------------------------------------+
| .*. .* * |
2.6e+06 *+*.*.. .*. * *.*. + + + .*..*. .*.*.*..*.*. .*.*..*.*.|
| * *.*.*.. + * * * * *
2.5e+06 ++ * |
| |
2.4e+06 ++ |
| |
2.3e+06 ++ |
| |
2.2e+06 ++ |
| O |
2.1e+06 ++ O O O O O O |
O O O O O O O O O O O O |
2e+06 ++-----O----------------------------------------------------------+
time.voluntary_context_switches
50000 ++------------------------------------------------------------------+
*. .*. .*. .*..*.*. .*.. .*.*..*. .*..*.*.*. .*. .*. .*.|
48000 ++*. * *..*.*.* * * *.* *. * *. *
| |
| |
46000 ++ |
| |
44000 ++ |
| |
42000 ++ |
| |
| |
40000 ++ O O O O O |
| O O O O O O O O O |
38000 O+O----O-O------O---O-----------------------------------------------+
time.involuntary_context_switches
60000 ++------------------------------------------------------------------+
O O O O O O O O O O O O O O |
55000 ++ O O O O O O |
| |
| |
50000 ++ |
| |
45000 ++ |
| |
40000 ++ |
| |
| |
35000 ++ |
| .*..*.*. |
30000 *+*--*-*-*-*--*-*-*--------*-*--*-*-*--*-*-*-*--*-*-*-*--*-*-*-*--*-*
vm-scalability.migrate_mbps
360000 ++-----------------------------------------------------------------+
| .*.. .*.*..*. .* *. .*. .*.. |
350000 *+* *.*.*.*..*.* * + .. * *.*..*.*.* *.*.*.*..*.*.|
340000 ++ * *
| |
330000 ++ |
320000 ++ |
| |
310000 ++ |
300000 ++ |
| |
290000 ++ |
280000 ++ O O O O O O O |
O O O O O O O O O O O O |
270000 ++-----O-----------------------------------------------------------+
vmstat.system.in
2100 ++-------------------------------------------------------------------+
| .*..*.*.*.. .*.*..*.*
2000 ++ * *.* |
| + |
1900 *+*..*. .*.. .*. .*. .*..*.*.*..*.*.*.*..* |
| * *.* *. * |
1800 ++ |
| |
1700 ++ O O O O O |
| O O O O O O O O |
1600 ++ |
| |
1500 O+ O O |
| O O O O |
1400 ++-------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Jet
8 years
[sched] 1896c45c3d1: -2.9% turbostat.Pkg_W
by Fengguang Wu
Yuyang,
Here is another bisect result. The reduction of power consumption
looks good.
git://bee.sh.intel.com/git/ydu19/linux cc-v3-on-3.15-rc8
commit 1896c45c3d164ffc3d9d68fe15d5c85674ac4ed0 ("Intercept idle balancing")
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
1332 ~33% +75.9% 2344 ~ 7% brickland1/will-it-scale/pread2
1332 ~33% +75.9% 2344 ~ 7% TOTAL numa-vmstat.node1.nr_active_anon
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
5666 ~31% +65.7% 9388 ~ 7% brickland1/will-it-scale/pread2
5666 ~31% +65.7% 9388 ~ 7% TOTAL numa-meminfo.node1.AnonPages
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
5329 ~33% +75.9% 9375 ~ 7% brickland1/will-it-scale/pread2
5329 ~33% +75.9% 9375 ~ 7% TOTAL numa-meminfo.node1.Active(anon)
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
1418 ~31% +65.5% 2346 ~ 7% brickland1/will-it-scale/pread2
1418 ~31% +65.5% 2346 ~ 7% TOTAL numa-vmstat.node1.nr_anon_pages
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
1163 ~16% -27.5% 842 ~13% brickland1/will-it-scale/page_fault1
1163 ~16% -27.5% 842 ~13% TOTAL proc-vmstat.numa_pages_migrated
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
1163 ~16% -27.5% 842 ~13% brickland1/will-it-scale/page_fault1
1163 ~16% -27.5% 842 ~13% TOTAL proc-vmstat.pgmigrate_success
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
226 ~16% -26.3% 166 ~ 9% brickland1/will-it-scale/pread2
226 ~16% -26.3% 166 ~ 9% TOTAL cpuidle.POLL.usage
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
1275 ~ 5% +21.6% 1550 ~ 4% brickland1/will-it-scale/page_fault1
1275 ~ 5% +21.6% 1550 ~ 4% TOTAL slabinfo.sock_inode_cache.num_objs
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
1275 ~ 5% +21.6% 1550 ~ 4% brickland1/will-it-scale/page_fault1
1275 ~ 5% +21.6% 1550 ~ 4% TOTAL slabinfo.sock_inode_cache.active_objs
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
681 ~ 9% -16.9% 566 ~ 6% brickland1/will-it-scale/pread2
681 ~ 9% -16.9% 566 ~ 6% TOTAL slabinfo.vm_area_struct.active_slabs
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
681 ~ 9% -16.9% 566 ~ 6% brickland1/will-it-scale/pread2
681 ~ 9% -16.9% 566 ~ 6% TOTAL slabinfo.vm_area_struct.num_slabs
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
29997 ~ 9% -16.8% 24947 ~ 6% brickland1/will-it-scale/pread2
29997 ~ 9% -16.8% 24947 ~ 6% TOTAL slabinfo.vm_area_struct.num_objs
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
29784 ~ 9% -16.9% 24755 ~ 6% brickland1/will-it-scale/pread2
29784 ~ 9% -16.9% 24755 ~ 6% TOTAL slabinfo.vm_area_struct.active_objs
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
3928 ~ 6% -16.4% 3284 ~ 6% brickland1/will-it-scale/page_fault1
3928 ~ 6% -16.4% 3284 ~ 6% TOTAL numa-meminfo.node3.KernelStack
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
5491 ~ 1% -11.6% 4852 ~ 1% brickland1/will-it-scale/page_fault1
5540 ~ 1% -13.1% 4816 ~ 3% brickland1/will-it-scale/pread2
11031 ~ 1% -12.4% 9668 ~ 2% TOTAL slabinfo.sigqueue.num_objs
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
5491 ~ 1% -11.6% 4852 ~ 1% brickland1/will-it-scale/page_fault1
5540 ~ 1% -13.1% 4816 ~ 3% brickland1/will-it-scale/pread2
11031 ~ 1% -12.4% 9668 ~ 2% TOTAL slabinfo.sigqueue.active_objs
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
12383 ~ 3% -7.6% 11443 ~ 4% brickland1/will-it-scale/pread2
12383 ~ 3% -7.6% 11443 ~ 4% TOTAL slabinfo.proc_inode_cache.num_objs
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
12206 ~ 2% -8.5% 11166 ~ 3% brickland1/will-it-scale/pread2
12206 ~ 2% -8.5% 11166 ~ 3% TOTAL slabinfo.proc_inode_cache.active_objs
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
3298 ~ 3% -8.7% 3012 ~ 4% brickland1/will-it-scale/page_fault1
3298 ~ 3% -8.7% 3012 ~ 4% TOTAL slabinfo.shmem_inode_cache.active_objs
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
3298 ~ 3% -8.7% 3012 ~ 4% brickland1/will-it-scale/page_fault1
3298 ~ 3% -8.7% 3012 ~ 4% TOTAL slabinfo.shmem_inode_cache.num_objs
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
8105 ~ 2% +2062.5% 175284 ~ 4% brickland1/will-it-scale/page_fault1
6522 ~ 7% +1564.0% 108523 ~ 2% brickland1/will-it-scale/pread2
14627 ~ 4% +1840.2% 283807 ~ 3% TOTAL time.involuntary_context_switches
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
17535 ~ 0% +10.7% 19414 ~ 1% brickland1/will-it-scale/page_fault1
205434 ~ 0% +2.5% 210623 ~ 0% brickland1/will-it-scale/pread2
222969 ~ 0% +3.2% 230038 ~ 0% TOTAL vmstat.system.cs
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
56025 ~ 0% +1.8% 57041 ~ 0% brickland1/will-it-scale/page_fault1
71853 ~ 1% +5.8% 76038 ~ 1% brickland1/will-it-scale/pread2
127879 ~ 1% +4.1% 133080 ~ 1% TOTAL vmstat.system.in
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
271 ~ 0% -3.0% 263 ~ 0% brickland1/will-it-scale/pread2
271 ~ 0% -3.0% 263 ~ 0% TOTAL turbostat.Cor_W
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
285 ~ 0% -2.9% 276 ~ 0% brickland1/will-it-scale/pread2
285 ~ 0% -2.9% 276 ~ 0% TOTAL turbostat.Pkg_W
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
490 ~ 1% +2.3% 502 ~ 0% brickland1/will-it-scale/pread2
490 ~ 1% +2.3% 502 ~ 0% TOTAL time.percent_of_cpu_this_job_got
8552a4536239fc8 1896c45c3d164ffc3d9d68fe1
--------------- -------------------------
1514 ~ 1% +2.3% 1548 ~ 0% brickland1/will-it-scale/pread2
1514 ~ 1% +2.3% 1548 ~ 0% TOTAL time.system_time
Legend:
~XX% - stddev percent
[+-]XX% - change percent
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Fengguang
8 years
[rcu] 7c66b15f870: +1.8% turbostat.Pkg_W
by Fengguang Wu
Hi Paul,
We noticed increased power consumption in our internal merge commit.
It's not a direct evidence, however in the hope you can see any
obvious clues. :)
git://internal_merge_and_test_tree devel-hourly-2014062315
commit 7c66b15f8704703f6861faa246387342f7a05108 ("Merge 'rcu/rcu_cond_resched.2014.06.20c' into devel-hourly-2014062315")
Merge sequence is:
7c66b15 Merge 'rcu/rcu_cond_resched.2014.06.20c' into devel-hourly-2014062315
db47b74 Merge 'ipvs-next/master' into devel-hourly-2014062315
ca8d737 Merge 'regulator/topic/ab8500' into devel-hourly-2014062315
aee9255 Merge 'renesas/devel' into devel-hourly-2014062315
af18816 Merge 'vireshk/tick/lowres-go-tickless' into devel-hourly-2014062315
3cf94bc1 Merge 'vireshk/tick/ONESHOT-STOPPED' into devel-hourly-2014062315
94ae897 Merge 'asoc/topic/tlv320aic32x4' into devel-hourly-2014062315
28ef1ff Merge 'tianyu/dep_support' into devel-hourly-2014062315
f04bc00 Merge 'robclark/msm-next' into devel-hourly-2014062315
03f1b1e Merge 'net/master' into devel-hourly-2014062315
a1a9b33 Merge 'spi/fix/qup' into devel-hourly-2014062315
45bf5db Merge 'renesas/next' into devel-hourly-2014062315
fb20fce Merge 'asoc/for-next' into devel-hourly-2014062315
a385be7 Merge 'asoc/topic/samsung' into devel-hourly-2014062315
1a9f804 0day base guard for 'devel-hourly-2014062315'
a497c3b Linux 3.16-rc2
test case: brickland3/vm-scalability/300s-anon-rx-seq-mt
db47b74b78e1623 7c66b15f8704703f6861faa24
--------------- -------------------------
0.73 ~ 7% -13.4% 0.64 ~ 6% TOTAL turbostat.%c1
1499 ~ 5% +11.6% 1672 ~ 2% TOTAL slabinfo.sock_inode_cache.num_objs
1499 ~ 5% +11.6% 1672 ~ 2% TOTAL slabinfo.sock_inode_cache.active_objs
4.36 ~ 1% -8.1% 4.01 ~ 1% TOTAL turbostat.%c6
11782 ~ 1% +8.0% 12726 ~ 2% TOTAL time.involuntary_context_switches
2848 ~ 0% +4.8% 2983 ~ 0% TOTAL time.user_time
24.26 ~ 0% +4.4% 25.33 ~ 0% TOTAL time.elapsed_time
402 ~ 0% +2.0% 410 ~ 0% TOTAL turbostat.Cor_W
469 ~ 0% +1.8% 477 ~ 0% TOTAL turbostat.Pkg_W
c8bb7487275a9b7 7c66b15f8704703f6861faa24
--------------- -------------------------
2.047e+08 ~ 0% -5.2% 1.942e+08 ~ 0% TOTAL vm-scalability.throughput
58629 ~11% +25.1% 73348 ~13% TOTAL numa-numastat.node3.local_node
58670 ~11% +25.1% 73387 ~13% TOTAL numa-numastat.node3.numa_hit
41 ~ 6% -12.6% 36 ~ 1% TOTAL numa-numastat.node2.other_node
493777 ~ 2% -12.7% 431077 ~ 3% TOTAL proc-vmstat.pgfault
386476 ~ 1% -10.1% 347456 ~ 2% TOTAL proc-vmstat.pgalloc_normal
366616 ~ 2% -9.6% 331587 ~ 2% TOTAL proc-vmstat.numa_hit
366489 ~ 2% -9.6% 331475 ~ 2% TOTAL proc-vmstat.numa_local
11970 ~ 2% +6.3% 12726 ~ 2% TOTAL time.involuntary_context_switches
2829 ~ 0% +5.5% 2983 ~ 0% TOTAL time.user_time
24.02 ~ 0% +5.5% 25.33 ~ 0% TOTAL time.elapsed_time
402 ~ 0% +2.0% 410 ~ 0% TOTAL turbostat.Cor_W
469 ~ 0% +1.7% 477 ~ 0% TOTAL turbostat.Pkg_W
Legend:
~XX% - stddev percent
[+-]XX% - change percent
time.user_time
3000 ++-------------------------------------------------------------------+
2980 ++O O O O O O O O O O O O O |
| O O O O O |
2960 O+ |
2940 ++ |
| |
2920 ++ |
2900 ++ |
2880 ++ |
| |
2860 ++ *. .*. .*. *. .*. |
2840 ++ + * *.* *. + *.* *. |
*. .*.* *.*.*.*.*..*.*.*. .*.*.*.*.*.*.* *.*
2820 ++*.* * |
2800 ++-------------------------------------------------------------------+
time.elapsed_time
29 ++-------------------------------------------------------------------+
28.5 O+ |
| |
28 ++ |
27.5 ++ |
27 ++ |
26.5 ++ |
| |
26 ++ |
25.5 ++O O O O O O O O O O O O O O O O O |
25 ++ O |
24.5 ++ |
| .*. .*.*.*.*.*.*.*. .*.*.*.*.*. |
24 *+*.* * *.*.*.*.*..*.*.*.*.*.*.*.*.*.*.* *.*
23.5 ++-------------------------------------------------------------------+
vm-scalability.throughput
2.06e+08 ++*-*---------------------------------*--------------------------+
* + *.*.*.*.*.**.* *.*.*.*.*.*.* *.|
2.04e+08 ++ *.*. + + + *
| **.*.*.*.*.* **.*.*.* |
2.02e+08 ++ |
| |
2e+08 ++ |
| |
1.98e+08 ++ |
| |
1.96e+08 O+ |
| O OO O |
1.94e+08 ++ O O O O O O O O O O O O OO |
| |
1.92e+08 ++---------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Fengguang
8 years