Complete report #1184293
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
__x86_indirect_thunk_rax
|
vmlinux |
0xffffffffb2f86770
Build id: 3.10.0-957.el7.x86_64
|
-
|
|
2
|
|
xfs |
0xffffffffc02ac4d1
Build id: 3.10.0-957.el7.x86_64
|
0xb1
|
|
3
|
__xfs_trans_commit
|
xfs |
0xffffffffc02a62bd
Build id: 3.10.0-957.el7.x86_64
|
0x12d
|
|
4
|
xfs_trans_commit
|
xfs |
0xffffffffc02a66b0
Build id: 3.10.0-957.el7.x86_64
|
0x10
|
|
5
|
xfs_iomap_write_allocate
|
xfs |
0xffffffffc029601f
Build id: 3.10.0-957.el7.x86_64
|
0x1af
|
|
6
|
xfs_map_blocks
|
xfs |
0xffffffffc027f446
Build id: 3.10.0-957.el7.x86_64
|
0x1a6
|
|
7
|
xfs_do_writepage
|
xfs |
0xffffffffc028071c
Build id: 3.10.0-957.el7.x86_64
|
0x16c
|
|
8
|
write_cache_pages
|
vmlinux |
0xffffffffb2dc2034
Build id: 3.10.0-957.el7.x86_64
|
0x254
|
|
9
|
|
xfs |
0xffffffffc02805b0
Build id: 3.10.0-957.el7.x86_64
|
0x150
|
|
10
|
|
vmlinux |
0xffffffffb2f44f30
Build id: 3.10.0-957.el7.x86_64
|
0x70
|
|
11
|
xfs_vm_writepages
|
xfs |
0xffffffffc02803ab
Build id: 3.10.0-957.el7.x86_64
|
0x6b
|
|
12
|
do_writepages
|
vmlinux |
0xffffffffb2dc3181
Build id: 3.10.0-957.el7.x86_64
|
0x21
|
|
13
|
__writeback_single_inode
|
vmlinux |
0xffffffffb2e6f930
Build id: 3.10.0-957.el7.x86_64
|
0x40
|
|
14
|
writeback_sb_inodes
|
vmlinux |
0xffffffffb2e703c4
Build id: 3.10.0-957.el7.x86_64
|
0x1c4
|
|
15
|
__writeback_inodes_wb
|
vmlinux |
0xffffffffb2e7072f
Build id: 3.10.0-957.el7.x86_64
|
0x9f
|
|
16
|
wb_writeback
|
vmlinux |
0xffffffffb2e70f63
Build id: 3.10.0-957.el7.x86_64
|
0x263
|
|
17
|
|
vmlinux |
0xffffffffb2e5cd7c
Build id: 3.10.0-957.el7.x86_64
|
0x4c
|
|
18
|
bdi_writeback_workfn
|
vmlinux |
0xffffffffb2e718eb
Build id: 3.10.0-957.el7.x86_64
|
0x2cb
|
|
19
|
process_one_work
|
vmlinux |
0xffffffffb2cb9d4f
Build id: 3.10.0-957.el7.x86_64
|
0x17f
|
|
20
|
worker_thread
|
vmlinux |
0xffffffffb2cbade6
Build id: 3.10.0-957.el7.x86_64
|
0x126
|
|
21
|
|
vmlinux |
0xffffffffb2cbacc0
Build id: 3.10.0-957.el7.x86_64
|
0x2a0
|
|
22
|
kthread
|
vmlinux |
0xffffffffb2cc1c31
Build id: 3.10.0-957.el7.x86_64
|
0xd1
|
|
23
|
|
vmlinux |
0xffffffffb2cc1b60
Build id: 3.10.0-957.el7.x86_64
|
0x40
|
|
24
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffb3374c1d
Build id: 3.10.0-957.el7.x86_64
|
0x7
|
|
25
|
|
vmlinux |
0xffffffffb2cc1b60
Build id: 3.10.0-957.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/u48:2:15717]
Modules linked in: veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay(T) sunrpc vfat fat iTCO_wdt iTCO_vendor_support ipmi_ssif coretemp kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ses enclosure pcspkr joydev sg mei_me mei i2c_i801 wmi pinctrl_lewisburg pinctrl_intel ipmi_si ipmi_devintf ipmi_msghandler acpi_cpufreq acpi_power_meter binfmt_misc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ahci crct10dif_pclmul
crct10dif_common crc32c_intel igb serio_raw libahci libata smartpqi ptp pps_core i2c_algo_bit dca scsi_transport_sas dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 15717 Comm: kworker/u48:2 Kdump: loaded Tainted: G W ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: Inspur NF5270M6/NF5270M6, BIOS 07.00.02 05/06/2023
Workqueue: writeback bdi_writeback_workfn (flush-253:2)
task: ffff9fbaaa619040 ti: ffff9fbda4fac000 task.ti: ffff9fbda4fac000
RIP: 0010:[<ffffffffb2f86770>] [<ffffffffb2f86770>] __x86_indirect_thunk_rax+0x0/0x20
RSP: 0018:ffff9fbda4faf788 EFLAGS: 00000202
RAX: ffffffffc02ad570 RBX: ffff9fbda4faf750 RCX: 0000000000000000
RDX: ffff9fbda4faf7dc RSI: ffff9fbda4faf7d8 RDI: ffff9fbe149ffa28
RBP: ffff9fbda4faf810 R08: 0000000000000000 R09: ffff9fbde93c0a00
R10: ffff9fb73fc03600 R11: ffffeab7c0bd4300 R12: ffff9fbda4faf708
R13: 0000000000000282 R14: 0000000000000010 R15: ffffffffc0251310
FS: 0000000000000000(0000) GS:ffff9fbe1f480000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff65e8ba000 CR3: 000000060b810000 CR4: 0000000000760fe0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 00000000
Call Trace:
[<ffffffffc02ac4d1>] ? xfs_log_commit_cil+0xb1/0x660 [xfs]
[<ffffffffc02a62bd>] __xfs_trans_commit+0x12d/0x260 [xfs]
[<ffffffffc02a66b0>] xfs_trans_commit+0x10/0x20 [xfs]
[<ffffffffc029601f>] xfs_iomap_write_allocate+0x1af/0x3a0 [xfs]
[<ffffffffc027f446>] xfs_map_blocks+0x1a6/0x220 [xfs]
[<ffffffffc028071c>] xfs_do_writepage+0x16c/0x510 [xfs]
[<ffffffffb2dc2034>] write_cache_pages+0x254/0x4e0
[<ffffffffc02805b0>] ? xfs_aops_discard_page+0x150/0x150 [xfs]
[<ffffffffb2f44f30>] ? submit_bio+0x70/0x150
[<ffffffffc02803ab>] xfs_vm_writepages+0x6b/0xa0 [xfs]
[<ffffffffb2dc3181>] do_writepages+0x21/0x50
[<ffffffffb2e6f930>] __writeback_single_inode+0x40/0x260
[<ffffffffb2e703c4>] writeback_sb_inodes+0x1c4/0x490
[<ffffffffb2e7072f>] __writeback_inodes_wb+0x9f/0xd0
[<ffffffffb2e70f63>] wb_writeback+0x263/0x2f0
[<ffffffffb2e5cd7c>] ? get_nr_inodes+0x4c/0x70
[<ffffffffb2e718eb>] bdi_writeback_workfn+0x2cb/0x460
[<ffffffffb2cb9d4f>] process_one_work+0x17f/0x440
[<ffffffffb2cbade6>] worker_thread+0x126/0x3c0
[<ffffffffb2cbacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffffb2cc1c31>] kthread+0xd1/0xe0
[<ffffffffb2cc1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffffb3374c1d>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffffb2cc1b60>] ? insert_kthread_work+0x40/0x40
Code: 83 eb 07 48 39 d9 73 0c 0f 01 cb 48 89 01 31 c0 0f 01 ca c3 b8 f2 ff ff ff 0f 01 ca c3 90 90 90 90 90 90 90 90 90 90 90 90 90 90 <0f> 1f 44 00 00 ff e0 e8 07 00 00 00 f3 90 0f ae e8 eb f9 48 89
Complete report #154762
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
kfree
|
vmlinux |
0xffffffff8d41d545
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x55
|
|
2
|
kvfree
|
vmlinux |
0xffffffff8d3d75c5
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x35
|
|
3
|
xfs_log_commit_cil
|
xfs |
0xffffffffc06de743
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x4a3
|
|
4
|
__xfs_trans_commit
|
xfs |
0xffffffffc06d813d
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x12d
|
|
5
|
xfs_trans_commit
|
xfs |
0xffffffffc06d8530
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x10
|
|
6
|
xfs_iomap_write_allocate
|
xfs |
0xffffffffc06c7ddb
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x1bb
|
|
7
|
xfs_map_blocks
|
xfs |
0xffffffffc06b1666
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x1a6
|
|
8
|
xfs_do_writepage
|
xfs |
0xffffffffc06b293c
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x16c
|
|
9
|
write_cache_pages
|
vmlinux |
0xffffffff8d3c368c
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x21c
|
|
10
|
|
xfs |
0xffffffffc06b27d0
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x150
|
|
11
|
|
vmlinux |
0xffffffff8d546da0
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x70
|
|
12
|
xfs_vm_writepages
|
xfs |
0xffffffffc06b25cb
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x6b
|
|
13
|
do_writepages
|
vmlinux |
0xffffffff8d3c47a1
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x21
|
|
14
|
__writeback_single_inode
|
vmlinux |
0xffffffff8d471020
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x40
|
|
15
|
writeback_sb_inodes
|
vmlinux |
0xffffffff8d471ab4
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x1c4
|
|
16
|
__writeback_inodes_wb
|
vmlinux |
0xffffffff8d471e1f
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x9f
|
|
17
|
bdi_writeback_workfn
|
vmlinux |
0xffffffff8d4730e6
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x3d6
|
|
18
|
process_one_work
|
vmlinux |
0xffffffff8d2baf9f
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x17f
|
|
19
|
rescuer_thread
|
vmlinux |
0xffffffff8d2bb4f4
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x294
|
|
20
|
|
vmlinux |
0xffffffff8d2bb260
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x440
|
|
21
|
kthread
|
vmlinux |
0xffffffff8d2c2e81
Build id: 3.10.0-957.27.2.el7.x86_64
|
0xd1
|
|
22
|
|
vmlinux |
0xffffffff8d2c2db0
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x40
|
|
23
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff8d976c37
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x21
|
|
24
|
|
vmlinux |
0xffffffff8d2c2db0
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [writeback:16]
Modules linked in: binfmt_misc ext4 mbcache jbd2 nf_nat_pptp nf_nat_proto_gre nf_conntrack_pptp nf_conntrack_proto_gre ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_nat iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter ip_tables nf_log_ipv4 nf_log_common xt_LOG nfnetlink_queue nfnetlink_log bluetooth rfkill ipt_REJECT nf_reject_ipv4 ip_set_hash_ip vmw_vsock_vmci_transport vsock xt_set ip_set nfnetlink xt_multiport sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper cryptd vmw_balloon joydev pcspkr sg parport_pc parport i2c_piix4 vmw_vmci xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt
fb_sys_fops ttm ata_piix drm mptspi libata scsi_transport_spi mptscsih crct10dif_pclmul crct10dif_common crc32c_intel serio_raw mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod 8021q garp stp llc mrp [last unloaded: nf_defrag_ipv4]
CPU: 0 PID: 16 Comm: writeback Kdump: loaded Tainted: G L ------------ 3.10.0-957.27.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: writeback bdi_writeback_workfn (flush-253:0)
task: ffff92cffc6c1040 ti: ffff92cffc6d0000 task.ti: ffff92cffc6d0000
RIP: 0010:[<ffffffff8d41d545>] [<ffffffff8d41d545>] kfree+0x55/0x140
RSP: 0000:ffff92cffc6d3788 EFLAGS: 00010286
RAX: fffffaea8115a1c0 RBX: 0000000000000400 RCX: 0000000000000000
RDX: 00006d3000000000 RSI: 00000000000000b0 RDI: ffff92cfc5687c00
RBP: ffff92cffc6d37a0 R08: 00000000000000e8 R09: 0000000000000000
R10: 0000000000000001 R11: ffff92cfd141b494 R12: 0000000000000000
R13: 0000000000000001 R14: 000ffffffffe0005 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff92cfffc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc9d02f4270 CR3: 000000007a45c000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff8d3d75c5>] kvfree+0x35/0x40
[<ffffffffc06de743>] xfs_log_commit_cil+0x4a3/0x660 [xfs]
[<ffffffffc06d813d>] __xfs_trans_commit+0x12d/0x260 [xfs]
[<ffffffffc06d8530>] xfs_trans_commit+0x10/0x20 [xfs]
[<ffffffffc06c7ddb>] xfs_iomap_write_allocate+0x1bb/0x3b0 [xfs]
[<ffffffffc06b1666>] xfs_map_blocks+0x1a6/0x220 [xfs]
[<ffffffffc06b293c>] xfs_do_writepage+0x16c/0x510 [xfs]
[<ffffffff8d3c368c>] write_cache_pages+0x21c/0x470
[<ffffffffc06b27d0>] ? xfs_aops_discard_page+0x150/0x150 [xfs]
[<ffffffff8d546da0>] ? submit_bio+0x70/0x150
[<ffffffffc06b25cb>] xfs_vm_writepages+0x6b/0xa0 [xfs]
[<ffffffff8d3c47a1>] do_writepages+0x21/0x50
[<ffffffff8d471020>] __writeback_single_inode+0x40/0x260
[<ffffffff8d471ab4>] writeback_sb_inodes+0x1c4/0x490
[<ffffffff8d471e1f>] __writeback_inodes_wb+0x9f/0xd0
[<ffffffff8d4730e6>] bdi_writeback_workfn+0x3d6/0x460
[<ffffffff8d2baf9f>] process_one_work+0x17f/0x440
[<ffffffff8d2bb4f4>] rescuer_thread+0x294/0x3c0
[<ffffffff8d2bb260>] ? process_one_work+0x440/0x440
[<ffffffff8d2c2e81>] kthread+0xd1/0xe0
[<ffffffff8d2c2db0>] ? insert_kthread_work+0x40/0x40
[<ffffffff8d976c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff8d2c2db0>] ? insert_kthread_work+0x40/0x40
Code: 8b 15 f0 aa 9f 00 48 01 d8 72 0e 48 c7 c2 00 00 00 80 48 2b 15 0d 7f a2 00 48 01 d0 48 c1 e8 0c 48 c1 e0 06 48 03 05 eb 7e a2 00 <48> 8b 10 80 e6 80 0f 85 c8 00 00 00 49 89 c3 49 8b 03 a8 80 0f
Complete report #218634
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
dump_stack
|
vmlinux |
0xffffffff816a3d91
Build id: 3.10.0-693.el7.x86_64
|
0x19
|
|
2
|
__warn
|
vmlinux |
0xffffffff810879c8
Build id: 3.10.0-693.el7.x86_64
|
0xd8
|
|
3
|
warn_slowpath_fmt
|
vmlinux |
0xffffffff81087a4f
Build id: 3.10.0-693.el7.x86_64
|
0x5f
|
|
4
|
__list_del_entry
|
vmlinux |
0xffffffff8133d9a1
Build id: 3.10.0-693.el7.x86_64
|
0xa1
|
|
5
|
xfs_log_commit_cil
|
xfs |
0xffffffffc016078c
Build id: 3.10.0-693.el7.x86_64
|
0x2cc
|
|
6
|
__xfs_trans_commit
|
xfs |
0xffffffffc015a45d
Build id: 3.10.0-693.el7.x86_64
|
0x12d
|
|
7
|
xfs_trans_commit
|
xfs |
0xffffffffc015a840
Build id: 3.10.0-693.el7.x86_64
|
0x10
|
|
8
|
xfs_iomap_write_allocate
|
xfs |
0xffffffffc014a4de
Build id: 3.10.0-693.el7.x86_64
|
0x19e
|
|
9
|
xfs_map_blocks
|
xfs |
0xffffffffc0133f96
Build id: 3.10.0-693.el7.x86_64
|
0x1a6
|
|
10
|
xfs_do_writepage
|
xfs |
0xffffffffc0134af4
Build id: 3.10.0-693.el7.x86_64
|
0x174
|
|
11
|
write_cache_pages
|
vmlinux |
0xffffffff8118dc91
Build id: 3.10.0-693.el7.x86_64
|
0x251
|
|
12
|
|
xfs |
0xffffffffc0134980
Build id: 3.10.0-693.el7.x86_64
|
0x150
|
|
13
|
|
vmlinux |
0xffffffff812f8dc0
Build id: 3.10.0-693.el7.x86_64
|
0x70
|
|
14
|
xfs_vm_writepages
|
xfs |
0xffffffffc013478d
Build id: 3.10.0-693.el7.x86_64
|
0xbd
|
|
15
|
do_writepages
|
vmlinux |
0xffffffff8118effe
Build id: 3.10.0-693.el7.x86_64
|
0x1e
|
|
16
|
__writeback_single_inode
|
vmlinux |
0xffffffff8122d7d0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
|
17
|
writeback_sb_inodes
|
vmlinux |
0xffffffff8122e414
Build id: 3.10.0-693.el7.x86_64
|
0x1c4
|
|
18
|
__writeback_inodes_wb
|
vmlinux |
0xffffffff8122e77f
Build id: 3.10.0-693.el7.x86_64
|
0x9f
|
|
19
|
wb_writeback
|
vmlinux |
0xffffffff8122efb3
Build id: 3.10.0-693.el7.x86_64
|
0x263
|
|
20
|
|
vmlinux |
0xffffffff8121bc3c
Build id: 3.10.0-693.el7.x86_64
|
0x4c
|
|
21
|
bdi_writeback_workfn
|
vmlinux |
0xffffffff8122f45b
Build id: 3.10.0-693.el7.x86_64
|
0x2cb
|
|
22
|
process_one_work
|
vmlinux |
0xffffffff810a881a
Build id: 3.10.0-693.el7.x86_64
|
0x17a
|
|
23
|
worker_thread
|
vmlinux |
0xffffffff810a94e6
Build id: 3.10.0-693.el7.x86_64
|
0x126
|
|
24
|
|
vmlinux |
0xffffffff810a93c0
Build id: 3.10.0-693.el7.x86_64
|
0x2a0
|
|
25
|
kthread
|
vmlinux |
0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
|
0xcf
|
|
26
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
|
27
|
ret_from_fork
|
vmlinux |
0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
|
0x58
|
|
28
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
WARNING: CPU: 10 PID: 17688 at lib/list_debug.c:59 __list_del_entry+0xa1/0xd0
list_del corruption. prev->next should be ffff881eace9c550, but was ffff881ea8e9c550
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter btusb btrtl btbcm btintel bluetooth joydev snd_hda_codec_hdmi snd_hda_codec_generic edac_core intel_powerclamp iTCO_wdt coretemp iTCO_vendor_support amdkfd amd_iommu_v2 amdgpu intel_rapl iosf_mbi eeepc_wmi asus_wmi sparse_keymap kvm_intel rfkill video mxm_wmi kvm irqbypass i2c_algo_bit crc32_pclmul ttm ghash_clmulni_intel aesni_intel drm_kms_helper snd_hda_intel lrw gf128mul glue_helper snd_hda_codec ablk_helper cryptd syscopyarea sysfillrect sysimgblt fb_sys_fops snd_hda_core drm snd_hwdep snd_seq snd_seq_device
nvme snd_pcm nvme_core e1000e snd_timer snd pcspkr sg mei_me ptp soundcore shpchp i2c_designware_platform i2c_i801 pps_core i2c_designware_core mei i2c_core idma64 virt_dma nfit libnvdimm wmi nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ahci libahci libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw dm_mirror dm_region_hash dm_log dm_mod
CPU: 10 PID: 17688 Comm: kworker/u224:2 Not tainted 3.10.0-693.el7.x86_64 #1
Hardware name: System manufacturer System Product Name/PRIME X299-DELUXE II, BIOS 3006 02/07/2020
Workqueue: writeback bdi_writeback_workfn (flush-253:0)
ffff8801855ab738 000000006b47eac6 ffff8801855ab6e8 ffffffff816a3d91
ffff8801855ab728 ffffffff810879c8 0000003be6ec4c68 ffff882017586500
ffff8801846cf598 ffff881eace9c550 ffff882017586508 ffff8801c67eb220
Call Trace:
[<ffffffff816a3d91>] dump_stack+0x19/0x1b
[<ffffffff810879c8>] __warn+0xd8/0x100
[<ffffffff81087a4f>] warn_slowpath_fmt+0x5f/0x80
[<ffffffff8133d9a1>] __list_del_entry+0xa1/0xd0
[<ffffffffc016078c>] xfs_log_commit_cil+0x2cc/0x5b0 [xfs]
[<ffffffffc015a45d>] __xfs_trans_commit+0x12d/0x260 [xfs]
[<ffffffffc015a840>] xfs_trans_commit+0x10/0x20 [xfs]
[<ffffffffc014a4de>] xfs_iomap_write_allocate+0x19e/0x370 [xfs]
[<ffffffffc0133f96>] xfs_map_blocks+0x1a6/0x210 [xfs]
[<ffffffffc0134af4>] xfs_do_writepage+0x174/0x530 [xfs]
[<ffffffff8118dc91>] write_cache_pages+0x251/0x4d0
[<ffffffffc0134980>] ? xfs_aops_discard_page+0x150/0x150 [xfs]
[<ffffffff812f8dc0>] ? submit_bio+0x70/0x150
[<ffffffffc013478d>] xfs_vm_writepages+0xbd/0xe0 [xfs]
[<ffffffff8118effe>] do_writepages+0x1e/0x40
[<ffffffff8122d7d0>] __writeback_single_inode+0x40/0x220
[<ffffffff8122e414>] writeback_sb_inodes+0x1c4/0x490
[<ffffffff8122e77f>] __writeback_inodes_wb+0x9f/0xd0
[<ffffffff8122efb3>] wb_writeback+0x263/0x2f0
[<ffffffff8121bc3c>] ? get_nr_inodes+0x4c/0x70
[<ffffffff8122f45b>] bdi_writeback_workfn+0x2cb/0x460
[<ffffffff810a881a>] process_one_work+0x17a/0x440
[<ffffffff810a94e6>] worker_thread+0x126/0x3c0
[<ffffffff810a93c0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Complete report #3998
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
__slab_alloc
|
vmlinux |
0xffffffffb3560914
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x48
|
|
2
|
__kmalloc
|
vmlinux |
0xffffffffb301e6d0
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x1c0
|
|
3
|
kmem_alloc
|
xfs |
0xffffffffc0360d07
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x97
|
|
4
|
xfs_log_commit_cil
|
xfs |
0xffffffffc0366750
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x4b0
|
|
5
|
__xfs_trans_commit
|
xfs |
0xffffffffc036013d
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x12d
|
|
6
|
xfs_trans_commit
|
xfs |
0xffffffffc0360530
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x10
|
|
7
|
xfs_iomap_write_allocate
|
xfs |
0xffffffffc034fddb
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x1bb
|
|
8
|
xfs_map_blocks
|
xfs |
0xffffffffc0339666
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x1a6
|
|
9
|
xfs_do_writepage
|
xfs |
0xffffffffc033a93c
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x16c
|
|
10
|
write_cache_pages
|
vmlinux |
0xffffffffb2fc368c
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x21c
|
|
11
|
|
xfs |
0xffffffffc033a7d0
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x150
|
|
12
|
|
vmlinux |
0xffffffffb3146da0
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x70
|
|
13
|
xfs_vm_writepages
|
xfs |
0xffffffffc033a5cb
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x6b
|
|
14
|
do_writepages
|
vmlinux |
0xffffffffb2fc47a1
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x21
|
|
15
|
__writeback_single_inode
|
vmlinux |
0xffffffffb3071020
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x40
|
|
16
|
writeback_sb_inodes
|
vmlinux |
0xffffffffb3071ab4
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x1c4
|
|
17
|
__writeback_inodes_wb
|
vmlinux |
0xffffffffb3071e1f
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x9f
|
|
18
|
wb_writeback
|
vmlinux |
0xffffffffb3072653
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x263
|
|
19
|
bdi_writeback_workfn
|
vmlinux |
0xffffffffb3072fdb
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x2cb
|
|
20
|
process_one_work
|
vmlinux |
0xffffffffb2ebaf9f
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x17f
|
|
21
|
worker_thread
|
vmlinux |
0xffffffffb2ebc036
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x126
|
|
22
|
|
vmlinux |
0xffffffffb2ebbf10
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x2a0
|
|
23
|
kthread
|
vmlinux |
0xffffffffb2ec2e81
Build id: 3.10.0-957.27.2.el7.x86_64
|
0xd1
|
|
24
|
|
vmlinux |
0xffffffffb2ec2db0
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x40
|
|
25
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffb3576c37
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x21
|
|
26
|
|
vmlinux |
0xffffffffb2ec2db0
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [kworker/u4:0:3921]
Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables ip_set nfnetlink bridge stp llc vmw_vsock_vmci_transport vsock coretemp iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel vmw_balloon aesni_intel lrw sg gf128mul glue_helper ablk_helper cryptd pcspkr joydev vmw_vmci i2c_piix4 parport_pc parport xfs libcrc32c sr_mod cdrom ahci libahci ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper ata_piix
crct10dif_pclmul crct10dif_common syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crc32c_intel drm serio_raw nfit libata libnvdimm vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
CPU: 1 PID: 3921 Comm: kworker/u4:0 Kdump: loaded Tainted: G L ------------ 3.10.0-957.27.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
Workqueue: writeback bdi_writeback_workfn (flush-253:0)
task: ffff9d6339496180 ti: ffff9d6290d2c000 task.ti: ffff9d6290d2c000
RIP: 0010:[<ffffffffb3560914>] [<ffffffffb3560914>] __slab_alloc+0x48/0x5c
RSP: 0018:ffff9d6290d2f6c0 EFLAGS: 00000246
RAX: ffff9d6290e21c00 RBX: ffff9d6290d2f7c8 RCX: 0000000180100010
RDX: ffff9d6290e21c00 RSI: fffff5e500438800 RDI: 0000000000000246
RBP: ffff9d6290d2f6f0 R08: 0000000000000000 R09: 0000000180100010
R10: ffff9d63bb001500 R11: fffff5e50080cf00 R12: 00148f89b5ef0000
R13: 0000025000000002 R14: ffffffffc0360d07 R15: ffffffff00000000
FS: 0000000000000000(0000) GS:ffff9d63bfd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055648b23f180 CR3: 0000000137252000 CR4: 00000000001607e0
Call Trace:
[<ffffffffb301e6d0>] __kmalloc+0x1c0/0x230
[<ffffffffc0360d07>] kmem_alloc+0x97/0x130 [xfs]
[<ffffffffc0366750>] xfs_log_commit_cil+0x4b0/0x660 [xfs]
[<ffffffffc036013d>] __xfs_trans_commit+0x12d/0x260 [xfs]
[<ffffffffc0360530>] xfs_trans_commit+0x10/0x20 [xfs]
[<ffffffffc034fddb>] xfs_iomap_write_allocate+0x1bb/0x3b0 [xfs]
[<ffffffffc0339666>] xfs_map_blocks+0x1a6/0x220 [xfs]
[<ffffffffc033a93c>] xfs_do_writepage+0x16c/0x510 [xfs]
[<ffffffffb2fc368c>] write_cache_pages+0x21c/0x470
[<ffffffffc033a7d0>] ? xfs_aops_discard_page+0x150/0x150 [xfs]
[<ffffffffb3146da0>] ? submit_bio+0x70/0x150
[<ffffffffc033a5cb>] xfs_vm_writepages+0x6b/0xa0 [xfs]
[<ffffffffb2fc47a1>] do_writepages+0x21/0x50
[<ffffffffb3071020>] __writeback_single_inode+0x40/0x260
[<ffffffffb3071ab4>] writeback_sb_inodes+0x1c4/0x490
[<ffffffffb3071e1f>] __writeback_inodes_wb+0x9f/0xd0
[<ffffffffb3072653>] wb_writeback+0x263/0x2f0
[<ffffffffb3072fdb>] bdi_writeback_workfn+0x2cb/0x460
[<ffffffffb2ebaf9f>] process_one_work+0x17f/0x440
[<ffffffffb2ebc036>] worker_thread+0x126/0x3c0
[<ffffffffb2ebbf10>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffffb2ec2e81>] kthread+0xd1/0xe0
[<ffffffffb2ec2db0>] ? insert_kthread_work+0x40/0x40
[<ffffffffb3576c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb2ec2db0>] ? insert_kthread_work+0x40/0x40
Code: 53 50 4c 89 45 d0 e8 2c 82 ab ff 4c 8b 45 d0 48 89 c3 44 89 f2 4c 89 e7 4c 89 f9 44 89 ee e8 74 b2 ab ff 48 89 df 48 89 c2 57 9d <0f> 1f 44 00 00 48 89 d0 5a 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f