FS#65638 - [linux] Wireless AC 9560 iwlwifi crash

Attached to Project: Arch Linux
Opened by Tomasz Górecki (st1hy) - Thursday, 27 February 2020, 13:32 GMT
Last edited by freswa (frederik) - Sunday, 13 September 2020, 15:51 GMT
Task Type Bug Report
Category Kernel
Status Closed
Assigned To Tobias Powalowski (tpowa)
Jan Alexander Steffens (heftig)
Architecture x86_64
Severity High
Priority Normal
Reported Version
Due in Version Undecided
Due Date Undecided
Percent Complete 100%
Votes 3
Private No

Details

Description:
After couple of hours with wifi connection, wifi disconnects, wifi fails to scan, iwlwifi tries to restart, iwlwifi firmware crashes.
After restarting the machine, wifi connection can be established again.
Turning wifi on and off or suspending the machine sometimes triggers the crash but not always.
Logs before 5.5.6 were little different, I can add them if necessary

Additional info:
* linux 5.5.6-arch1-1
* linux-firmware-20200204.b791e15-1
* Intel(R) Dual Band Wireless AC 9560, REV=0x318
* ASUSTeK COMPUTER INC. ZenBook UX433FN_UX433FN/UX433FN, BIOS UX433FN.309 10/14/2019


Steps to reproduce:
Connect to wifi.
After some time iwlwifi crashes

Errors start here, full logs in attachment.


lut 27 12:51:28 pc-1 kernel: Timeout waiting for hardware access (CSR_GP_CNTRL 0x0c04000c)
lut 27 12:51:28 pc-1 kernel: WARNING: CPU: 4 PID: 1195 at drivers/net/wireless/intel/iwlwifi/pcie/trans.c:2084 iwl_trans_pcie_grab_nic_access+0x1e9/0x220 [iwlwifi]
lut 27 12:51:28 pc-1 kernel: Modules linked in: tun ccm rfcomm cmac algif_hash algif_skcipher af_alg zram bnep nls_iso8859_1 nls_cp437 uvcvideo vfat btusb fat videobuf2_vmalloc btrtl snd_hda_codec_hdmi videobuf2_memops btbcm videobuf2_v4l2 btintel videobuf2_common bluetooth videodev mc ecdh_generic ecc crc16 snd_sof_pci snd_sof_intel_byt snd_sof_intel_ipc snd_sof_xtensa_dsp snd_sof_intel_hda_common snd_soc_hdac_hda snd_sof_intel_hda snd_hda_codec_realtek snd_sof snd_hda_codec_generic ledtrig_audio snd_soc_skl snd_soc_sst_ipc snd_soc_sst_dsp snd_hda_ext_core joydev snd_soc_acpi_intel_match snd_soc_acpi mousedev i915 snd_soc_core snd_compress ac97_bus snd_pcm_dmaengine x86_pkg_temp_thermal snd_hda_intel intel_powerclamp iTCO_wdt spi_pxa2xx_platform 8250_dw hid_multitouch intel_rapl_msr iTCO_vendor_support mei_hdcp asus_nb_wmi kvm_intel snd_intel_dspcfg i2c_algo_bit asus_wmi sparse_keymap wmi_bmof drm_kms_helper mxm_wmi iwlmvm snd_hda_codec kvm snd_hda_core mac80211 irqbypass drm snd_hwdep intel_cstate
lut 27 12:51:28 pc-1 kernel: snd_pcm intel_uncore iwlwifi snd_timer intel_rapl_perf intel_gtt snd pcspkr input_leds agpgart processor_thermal_device cfg80211 syscopyarea i2c_i801 soundcore intel_rapl_common tpm_crb sysfillrect intel_soc_dts_iosf rfkill sysimgblt fb_sys_fops mei_me intel_lpss_pci intel_lpss mei tpm_tis idma64 intel_pch_thermal i2c_hid tpm_tis_core tpm int3403_thermal battery ac int340x_thermal_zone wmi rng_core evdev int3400_thermal acpi_tad acpi_thermal_rel mac_hid nf_log_ipv6 ip6t_REJECT nf_reject_ipv6 xt_hl ip6t_rt nf_log_ipv4 nf_log_common ipt_REJECT nf_reject_ipv4 xt_LOG xt_multiport xt_limit xt_addrtype xt_tcpudp xt_conntrack ip6table_filter ip6_tables nf_conntrack_netbios_ns nf_conntrack_broadcast nf_nat_ftp nf_nat nf_conntrack_ftp nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c crc32c_generic iptable_filter vboxnetflt(OE) vboxnetadp(OE) vboxdrv(OE) coretemp msr sg crypto_user bbswitch(OE) ip_tables x_tables f2fs dm_crypt sd_mod hid_generic usbhid hid uas usb_storage scsi_mod
lut 27 12:51:28 pc-1 kernel: crct10dif_pclmul crc32_pclmul serio_raw atkbd ghash_clmulni_intel libps2 dm_mod aesni_intel crypto_simd cryptd xhci_pci glue_helper xhci_hcd i8042 serio cifs dns_resolver fscache libarc4 libdes crc32c_intel
lut 27 12:51:28 pc-1 kernel: CPU: 4 PID: 1195 Comm: wpa_supplicant Tainted: G OE 5.5.6-arch1-1 #1
lut 27 12:51:28 pc-1 kernel: Hardware name: ASUSTeK COMPUTER INC. ZenBook UX433FN_UX433FN/UX433FN, BIOS UX433FN.309 10/14/2019
lut 27 12:51:28 pc-1 kernel: RIP: 0010:iwl_trans_pcie_grab_nic_access+0x1e9/0x220 [iwlwifi]
lut 27 12:51:28 pc-1 kernel: Code: a5 dd 49 8d 56 08 bf 40 01 00 00 e8 81 ea 5b dc e9 36 ff ff ff 89 c6 48 c7 c7 48 d8 b1 c0 c6 05 29 e8 03 00 01 e8 69 ea 59 dc <0f> 0b e9 f1 fe ff ff 48 8b 7d 38 48 c7 c1 b0 d8 b1 c0 31 d2 31 f6
lut 27 12:51:28 pc-1 kernel: RSP: 0018:ffffa1b600893578 EFLAGS: 00010086
lut 27 12:51:28 pc-1 kernel: RAX: 0000000000000000 RBX: ffffa1b6008935a8 RCX: 0000000000000000
lut 27 12:51:28 pc-1 kernel: RDX: 0000000000000002 RSI: 0000000000000086 RDI: 00000000ffffffff
lut 27 12:51:28 pc-1 kernel: RBP: ffff8c38e7fb0018 R08: 0000000000000500 R09: 0000000000000004
lut 27 12:51:28 pc-1 kernel: R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000000
lut 27 12:51:28 pc-1 kernel: R13: ffff8c38e7fb975c R14: 000000000c04000c R15: ffff8c38e7fb0048
lut 27 12:51:28 pc-1 kernel: FS: 00007fb4536c37c0(0000) GS:ffff8c3a1dd00000(0000) knlGS:0000000000000000
lut 27 12:51:28 pc-1 kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
lut 27 12:51:28 pc-1 kernel: CR2: 00007f6b7e56f000 CR3: 000000032f924003 CR4: 00000000003606e0
lut 27 12:51:28 pc-1 kernel: Call Trace:
lut 27 12:51:28 pc-1 kernel: iwl_write_prph+0x41/0x90 [iwlwifi]
lut 27 12:51:28 pc-1 kernel: iwl_trans_pcie_sync_nmi+0x1c3/0x230 [iwlwifi]
lut 27 12:51:28 pc-1 kernel: iwl_trans_pcie_send_hcmd+0x383/0x470 [iwlwifi]
lut 27 12:51:28 pc-1 kernel: ? wait_woken+0x70/0x70
lut 27 12:51:28 pc-1 kernel: iwl_trans_send_cmd+0x51/0xb0 [iwlwifi]
lut 27 12:51:28 pc-1 kernel: iwl_mvm_send_cmd+0x1b/0x40 [iwlmvm]
lut 27 12:51:28 pc-1 kernel: iwl_mvm_reg_scan_start+0x2b0/0x3f0 [iwlmvm]
lut 27 12:51:28 pc-1 kernel: ? iwl_mvm_mac_hw_scan+0x4c/0x70 [iwlmvm]
lut 27 12:51:28 pc-1 kernel: iwl_mvm_mac_hw_scan+0x4c/0x70 [iwlmvm]
lut 27 12:51:28 pc-1 kernel: __ieee80211_start_scan+0x13a/0x7c0 [mac80211]
lut 27 12:51:28 pc-1 kernel: ieee80211_request_scan+0x2c/0x50 [mac80211]
lut 27 12:51:28 pc-1 kernel: nl80211_trigger_scan+0x595/0x6f0 [cfg80211]
lut 27 12:51:28 pc-1 kernel: genl_rcv_msg+0x1d2/0x480
lut 27 12:51:28 pc-1 kernel: ? genl_family_rcv_msg_attrs_parse+0x100/0x100
lut 27 12:51:28 pc-1 kernel: netlink_rcv_skb+0x75/0x140
lut 27 12:51:28 pc-1 kernel: genl_rcv+0x24/0x40
lut 27 12:51:28 pc-1 kernel: netlink_unicast+0x199/0x240
lut 27 12:51:28 pc-1 kernel: netlink_sendmsg+0x243/0x480
lut 27 12:51:28 pc-1 kernel: sock_sendmsg+0x5e/0x60
lut 27 12:51:28 pc-1 kernel: ____sys_sendmsg+0x21b/0x290
lut 27 12:51:28 pc-1 kernel: ? copy_msghdr_from_user+0xe1/0x160
lut 27 12:51:28 pc-1 kernel: ___sys_sendmsg+0x9e/0xe0
lut 27 12:51:28 pc-1 kernel: ? do_vfs_ioctl+0x441/0x730
lut 27 12:51:28 pc-1 kernel: __sys_sendmsg+0x81/0xd0
lut 27 12:51:28 pc-1 kernel: do_syscall_64+0x4e/0x150
lut 27 12:51:28 pc-1 kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
lut 27 12:51:28 pc-1 kernel: RIP: 0033:0x7fb453a28887
lut 27 12:51:28 pc-1 kernel: Code: 64 89 02 48 c7 c0 ff ff ff ff eb bb 0f 1f 80 00 00 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 2e 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 89 54 24 1c 48 89 74 24 10
lut 27 12:51:28 pc-1 kernel: RSP: 002b:00007ffd645d5ce8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e
lut 27 12:51:28 pc-1 kernel: RAX: ffffffffffffffda RBX: 000055bbe0766f20 RCX: 00007fb453a28887
lut 27 12:51:28 pc-1 kernel: RDX: 0000000000000000 RSI: 00007ffd645d5d20 RDI: 0000000000000006
lut 27 12:51:28 pc-1 kernel: RBP: 000055bbe0766e30 R08: 0000000000000004 R09: 000055bbe075d010
lut 27 12:51:28 pc-1 kernel: R10: 00007ffd645d5df4 R11: 0000000000000246 R12: 000055bbe07b5680
lut 27 12:51:28 pc-1 kernel: R13: 00007ffd645d5d20 R14: 00007ffd645d5df4 R15: 000055bbe07615e0
lut 27 12:51:28 pc-1 kernel: ---[ end trace 90a0e6e17b0f43c3 ]---
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: iwlwifi transaction failed, dumping registers
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: iwlwifi device config registers:
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: 00000000: 9df08086 00100406 02800030 00800010 b431c004 00000000 00000000 00000000
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: 00000020: 00000000 00000000 00000000 00348086 00000000 000000c8 00000000 000001ff
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: 00000040: 00928010 10000ec0 00100c10 00000000 00000000 00000000 00000000 00000000
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: 00000060: 00000000 00080812 00000405 00000000 00000000 00000000 00000000 00000000
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: 00000080: 800f0011 00002000 00003000 00000000 00000000 00000000 00000000 00000000
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: 000000a0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: 000000c0: 00000000 00000000 c823d001 0d000008 00804005 00000000 00000000 00000000
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: 000000e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: 00000100: 14c00000 ff000000 000000ff 00462031 00000000 00002000 00000000 00000000
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: 00000120: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: 00000140: 00000000 00000000 00000000 16410018 00000000 0001001e 00481e1f 00000000
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: iwlwifi device memory mapped registers:
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: 00000000: 00c89008 00000040 00000000 00000000 00000000 00000000 00000000 00000000
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: 00000020: 00000000 0c04000c 00000312 d55555d5 d55555d5 d55555d5 80008040 041f0042
lut 27 12:51:28 pc-1 kernel: iwlwifi 0000:00:14.3: Hardware error detected. Restarting.
This task depends upon

Closed by  freswa (frederik)
Sunday, 13 September 2020, 15:51 GMT
Reason for closing:  Not a bug
Comment by Victor Trac (victortrac) - Friday, 28 February 2020, 05:00 GMT
I'm also experiencing this. X1 Carbon 7th Gen. My wifi will just start to get super slow (500-750ms local pings) and this will show up in dmesg:

[ 8910.062315] iwlwifi 0000:00:14.3: Microcode SW error detected. Restarting 0x0.
[ 8910.062384] iwlwifi 0000:00:14.3: Start IWL Error Log Dump:
[ 8910.062385] iwlwifi 0000:00:14.3: Status: 0x00000040, count: 6
[ 8910.062387] iwlwifi 0000:00:14.3: Loaded firmware version: 50.3e391d3e.0
[ 8910.062388] iwlwifi 0000:00:14.3: 0x00000071 | NMI_INTERRUPT_UMAC_FATAL
[ 8910.062389] iwlwifi 0000:00:14.3: 0x00A022F0 | trm_hw_status0
[ 8910.062390] iwlwifi 0000:00:14.3: 0x00000000 | trm_hw_status1
[ 8910.062391] iwlwifi 0000:00:14.3: 0x004C1EB0 | branchlink2
[ 8910.062392] iwlwifi 0000:00:14.3: 0x004B0CE4 | interruptlink1
[ 8910.062393] iwlwifi 0000:00:14.3: 0x004B0CE4 | interruptlink2
[ 8910.062394] iwlwifi 0000:00:14.3: 0x004BC440 | data1
[ 8910.062395] iwlwifi 0000:00:14.3: 0x00001000 | data2
[ 8910.062395] iwlwifi 0000:00:14.3: 0x00000000 | data3
[ 8910.062396] iwlwifi 0000:00:14.3: 0x224124C2 | beacon time
[ 8910.062397] iwlwifi 0000:00:14.3: 0x127D0B46 | tsf low
[ 8910.062398] iwlwifi 0000:00:14.3: 0x00000003 | tsf hi
[ 8910.062399] iwlwifi 0000:00:14.3: 0x00000000 | time gp1
[ 8910.062400] iwlwifi 0000:00:14.3: 0x7E2B5DF6 | time gp2
[ 8910.062401] iwlwifi 0000:00:14.3: 0x00000001 | uCode revision type
[ 8910.062402] iwlwifi 0000:00:14.3: 0x00000032 | uCode version major
[ 8910.062403] iwlwifi 0000:00:14.3: 0x3E391D3E | uCode version minor
[ 8910.062404] iwlwifi 0000:00:14.3: 0x00000351 | hw version
[ 8910.062404] iwlwifi 0000:00:14.3: 0x00489004 | board version
[ 8910.062405] iwlwifi 0000:00:14.3: 0x80ADFD25 | hcmd
[ 8910.062406] iwlwifi 0000:00:14.3: 0x00020000 | isr0
[ 8910.062407] iwlwifi 0000:00:14.3: 0x00400000 | isr1
[ 8910.062408] iwlwifi 0000:00:14.3: 0x08F00002 | isr2
[ 8910.062409] iwlwifi 0000:00:14.3: 0x00C32F98 | isr3
[ 8910.062410] iwlwifi 0000:00:14.3: 0x00000000 | isr4
[ 8910.062411] iwlwifi 0000:00:14.3: 0x06C8001C | last cmd Id
[ 8910.062412] iwlwifi 0000:00:14.3: 0x004BC440 | wait_event
[ 8910.062413] iwlwifi 0000:00:14.3: 0x000000D4 | l2p_control
[ 8910.062413] iwlwifi 0000:00:14.3: 0x00000000 | l2p_duration
[ 8910.062414] iwlwifi 0000:00:14.3: 0x00000007 | l2p_mhvalid
[ 8910.062415] iwlwifi 0000:00:14.3: 0x00000081 | l2p_addr_match
[ 8910.062416] iwlwifi 0000:00:14.3: 0x00000009 | lmpm_pmg_sel
[ 8910.062417] iwlwifi 0000:00:14.3: 0x00000000 | timestamp
[ 8910.062418] iwlwifi 0000:00:14.3: 0x0000E0DC | flow_handler
[ 8910.062450] iwlwifi 0000:00:14.3: Start IWL Error Log Dump:
[ 8910.062451] iwlwifi 0000:00:14.3: Status: 0x00000040, count: 7
[ 8910.062452] iwlwifi 0000:00:14.3: 0x2010120B | ADVANCED_SYSASSERT
[ 8910.062453] iwlwifi 0000:00:14.3: 0x00000000 | umac branchlink1
[ 8910.062454] iwlwifi 0000:00:14.3: 0x80462CBA | umac branchlink2
[ 8910.062455] iwlwifi 0000:00:14.3: 0xC00870A4 | umac interruptlink1
[ 8910.062456] iwlwifi 0000:00:14.3: 0x00000000 | umac interruptlink2
[ 8910.062456] iwlwifi 0000:00:14.3: 0x00000000 | umac data1
[ 8910.062457] iwlwifi 0000:00:14.3: 0xDEADBEEF | umac data2
[ 8910.062458] iwlwifi 0000:00:14.3: 0xDEADBEEF | umac data3
[ 8910.062459] iwlwifi 0000:00:14.3: 0x00000032 | umac major
[ 8910.062460] iwlwifi 0000:00:14.3: 0x3E391D3E | umac minor
[ 8910.062461] iwlwifi 0000:00:14.3: 0x7E2B5DE7 | frame pointer
[ 8910.062462] iwlwifi 0000:00:14.3: 0xC08875A4 | stack pointer
[ 8910.062463] iwlwifi 0000:00:14.3: 0x00D5010C | last host cmd
[ 8910.062464] iwlwifi 0000:00:14.3: 0x00000000 | isr status reg
[ 8910.062479] iwlwifi 0000:00:14.3: Fseq Registers:
[ 8910.062482] iwlwifi 0000:00:14.3: 0x60000000 | FSEQ_ERROR_CODE
[ 8910.062484] iwlwifi 0000:00:14.3: 0x80260000 | FSEQ_TOP_INIT_VERSION
[ 8910.062487] iwlwifi 0000:00:14.3: 0x00020006 | FSEQ_CNVIO_INIT_VERSION
[ 8910.062489] iwlwifi 0000:00:14.3: 0x0000A384 | FSEQ_OTP_VERSION
[ 8910.062492] iwlwifi 0000:00:14.3: 0x22A791A0 | FSEQ_TOP_CONTENT_VERSION
[ 8910.062494] iwlwifi 0000:00:14.3: 0x4552414E | FSEQ_ALIVE_TOKEN
[ 8910.062497] iwlwifi 0000:00:14.3: 0x20000302 | FSEQ_CNVI_ID
[ 8910.062499] iwlwifi 0000:00:14.3: 0x01300202 | FSEQ_CNVR_ID
[ 8910.062501] iwlwifi 0000:00:14.3: 0x20000302 | CNVI_AUX_MISC_CHIP
[ 8910.062506] iwlwifi 0000:00:14.3: 0x01300202 | CNVR_AUX_MISC_CHIP
[ 8910.062511] iwlwifi 0000:00:14.3: 0x0000485B | CNVR_SCU_SD_REGS_SD_REG_DIG_DCDC_VTRIM
[ 8910.062545] iwlwifi 0000:00:14.3: 0xA5A5A5A2 | CNVR_SCU_SD_REGS_SD_REG_ACTIVE_VDIG_MIRROR

Restarting networking seems to resolve the issue. Curiously, journalctl shows the card as a 9560:
Feb 27 17:51:17 carbon kernel: iwlwifi 0000:00:14.3: Detected Intel(R) Wireless-AC 9560 160MHz, REV=0x354

But lspci shows it as a 9462:
00:14.3 Network controller: Intel Corporation Wireless-AC 9462
Comment by loqs (loqs) - Wednesday, 11 March 2020, 23:05 GMT
Please see [1] to report the issue upstream

[1] https://wireless.wiki.kernel.org/en/users/drivers/iwlwifi/debugging
Comment by Victor Trac (victortrac) - Thursday, 13 August 2020, 15:44 GMT
@Tomasz - are you still having this issue? It magically went away months ago and I haven't noticed this issue since. Maybe a kernel or linux-firmware package fixed the issue (or maybe a firmware update via fwupdmgr). In any case, if you're no longer experiencing this, we can probably close.
Comment by Tomasz Górecki (st1hy) - Thursday, 13 August 2020, 16:11 GMT
At this point in time I am 99% convinced my issue was caused by physical damage in chip. My laptop did suffer a drop some time before the start of this behaviour. When I made this ticket I didn't put two and two together. Your problem could be unrelated. I advise to close the issue.

Loading...