FS#74343 - [linux] Zswap bug
Attached to Project:
Arch Linux
Opened by Tarsin Norbin (tarsin) - Monday, 04 April 2022, 13:03 GMT
Last edited by Jelle van der Waa (jelly) - Thursday, 14 September 2023, 17:55 GMT
Opened by Tarsin Norbin (tarsin) - Monday, 04 April 2022, 13:03 GMT
Last edited by Jelle van der Waa (jelly) - Thursday, 14 September 2023, 17:55 GMT
|
Details
Description:
Seems a upstream zswap problem, i'm not sure should i report this bug to Linux Both Official kernel and zen linux kernel can reproduce that bug, i haven't try other yet [ 254.642710] ------------[ cut here ]------------ [ 254.642714] kernel BUG at mm/zswap.c:1313! [ 254.642720] invalid opcode: 0000 [#1] PREEMPT SMP NOPTI [ 254.642726] CPU: 14 PID: 5803 Comm: GC Thread#4 Tainted: P OE 5.17.1-arch1-1 #1 0ea933cb6bfe82a8dc16ab834a4bccdd297f98b7 [ 254.642731] Hardware name: ASUSTeK COMPUTER INC. ROG Strix G512LV_G512LV/G512LV, BIOS G512LV.314 04/27/2021 [ 254.642733] RIP: 0010:zswap_frontswap_load+0x364/0x380 [ 254.642739] Code: e8 58 e6 d3 ff 45 31 e4 e9 2c ff ff ff 48 8d 7b 10 e8 50 83 8b 00 c7 43 10 00 00 00 00 44 8b 63 30 e9 e6 fe ff ff 0f 0b 0f 0b <0f> 0b 41 bc f4 ff ff ff e9 02 ff ff ff e8 ba cd 8a 00 66 2e 0f 1f [ 254.642742] RSP: 0000:ffffbe43e7b3fc68 EFLAGS: 00010282 [ 254.642745] RAX: 0000000000000000 RBX: ffff97d40f5bda88 RCX: 0000000000000006 [ 254.642747] RDX: 0000000000000000 RSI: ffff97cfc3cd8210 RDI: ffff97d217974010 [ 254.642749] RBP: ffff97d2a931ef50 R08: ffff97d0c0ef9800 R09: 0000000011111111 [ 254.642751] R10: 0000000000000000 R11: 0000000000000000 R12: 00000000ffffffea [ 254.642753] R13: ffff97d0ef92ff98 R14: 00000000000003b0 R15: ffff97d0ef92ff90 [ 254.642755] FS: 00007f90187ff640(0000) GS:ffff97d40f780000(0000) knlGS:0000000000000000 [ 254.642758] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 254.642760] CR2: 00007fa919907f08 CR3: 00000001d8b2a004 CR4: 00000000007706e0 [ 254.642762] PKRU: 55555554 [ 254.642763] Call Trace: [ 254.642766] <TASK> [ 254.642770] __frontswap_load+0x4d/0x60 [ 254.642773] swap_readpage+0x19b/0x2f0 [ 254.642778] do_swap_page+0x7e4/0x920 [ 254.642782] ? update_load_avg+0x7e/0x720 [ 254.642787] ? reweight_entity+0x149/0x160 [ 254.642790] __handle_mm_fault+0x9c8/0x1530 [ 254.642796] handle_mm_fault+0xb2/0x280 [ 254.642800] do_user_addr_fault+0x1ba/0x690 [ 254.642805] exc_page_fault+0x72/0x170 [ 254.642810] ? asm_exc_page_fault+0x8/0x30 [ 254.642815] asm_exc_page_fault+0x1e/0x30 [ 254.642819] RIP: 0033:0x7f90516ce164 [ 254.642822] Code: 05 bd ba 61 00 4a 63 0c 88 48 01 c1 ff e1 49 8b 47 38 49 89 45 38 49 8b 47 30 49 89 45 30 49 8b 47 28 49 89 45 28 49 8b 47 20 <49> 89 45 20 49 8b 47 18 49 89 45 18 49 8b 47 10 49 89 45 10 49 8b [ 254.642825] RSP: 002b:00007f90187fe980 EFLAGS: 00010217 [ 254.642827] RAX: 891873b889651998 RBX: 00000000981e1002 RCX: 00007f90516ce160 [ 254.642829] RDX: 000000008edc866b RSI: 0000000000000010 RDI: 00007f904c01f540 [ 254.642831] RBP: 00007f90187fe9f0 R08: 0000000000000001 R09: 0000000000000005 [ 254.642832] R10: 00007ffd981e1002 R11: 000000008edc8668 R12: 00007f9052244069 [ 254.642834] R13: 000000008edc8668 R14: 00007f8fe0007050 R15: 00000000b0ed6f78 [ 254.642838] </TASK> [ 254.642839] Modules linked in: xt_REDIRECT xt_mark ts_bm xt_string rfcomm snd_seq_dummy snd_hrtimer snd_seq snd_seq_device cmac algif_hash algif_skcipher af_alg xt_CHECKSUM xt_MASQUERADE xt_conntrack ipt_REJECT nf_reject_ipv4 bnep btusb btrtl btbcm btintel btmtk bluetooth ecdh_generic crc16 hid_asus xt_tcpudp snd_sof_pci_intel_cnl snd_sof_intel_hda_common soundwire_intel soundwire_generic_allocation soundwire_cadence snd_sof_intel_hda ip6table_mangle snd_sof_pci snd_sof_xtensa_dsp ip6table_nat snd_sof joydev ip6table_filter mousedev ip6_tables soundwire_bus snd_soc_skl snd_soc_hdac_hda iptable_mangle snd_hda_ext_core snd_soc_sst_ipc iptable_nat intel_tcc_cooling snd_soc_sst_dsp xt_TPROXY nf_nat snd_soc_acpi_intel_match snd_soc_acpi nf_tproxy_ipv6 x86_pkg_temp_thermal iwlmvm nf_conntrack intel_powerclamp snd_soc_core hid_multitouch nf_tproxy_ipv4 ucsi_ccg nf_defrag_ipv6 snd_compress libcrc32c mac80211 kvm_intel snd_hda_codec_realtek tps6598x typec_ucsi ac97_bus iTCO_wdt nf_defrag_ipv4 [ 254.642899] crc32c_generic 8021q intel_pmc_bxt snd_hda_codec_generic snd_pcm_dmaengine typec ledtrig_audio ee1004 libarc4 iTCO_vendor_support snd_hda_codec_hdmi mei_pxp garp qrtr mei_hdcp intel_rapl_msr bridge kvm roles mrp snd_hda_intel zram stp snd_intel_dspcfg irqbypass snd_intel_sdw_acpi llc coretemp crct10dif_pclmul iptable_filter iwlwifi r8169 crc32c_intel snd_hda_codec vfat ghash_clmulni_intel asus_nb_wmi intel_spi_pci processor_thermal_device_pci_legacy aesni_intel crypto_simd snd_hda_core cryptd rapl intel_spi intel_cstate fat processor_thermal_device snd_hwdep realtek asus_wmi intel_uncore iwlmei sparse_keymap processor_thermal_rfim snd_pcm pcspkr spi_nor mdio_devres platform_profile wmi_bmof i2c_i801 processor_thermal_mbox i915 mxm_wmi snd_timer mtd cfg80211 i2c_smbus libphy processor_thermal_rapl tpm_crb mei_me intel_lpss_pci ttm snd rfkill intel_rapl_common intel_lpss mei soundcore i2c_nvidia_gpu intel_gtt idma64 intel_soc_dts_iosf intel_pch_thermal i2c_hid_acpi i2c_hid [ 254.642965] tpm_tis i2c_multi_instantiate tpm_tis_core int3403_thermal tpm int340x_thermal_zone rng_core int3400_thermal acpi_thermal_rel acpi_pad asus_wireless acpi_tad mac_hid vboxnetflt(OE) vboxnetadp(OE) vboxdrv(OE) dm_multipath dm_mod crypto_user fuse bpf_preload ip_tables x_tables f2fs crc32_generic lz4hc_compress usbhid serio_raw atkbd libps2 crc32_pclmul xhci_pci xhci_pci_renesas i8042 serio wmi video nvidia_drm(POE) nvidia_uvm(POE) nvidia_modeset(POE) nvidia(POE) [ 254.643010] ---[ end trace 0000000000000000 ]--- [ 254.643012] RIP: 0010:zswap_frontswap_load+0x364/0x380 [ 254.643016] Code: e8 58 e6 d3 ff 45 31 e4 e9 2c ff ff ff 48 8d 7b 10 e8 50 83 8b 00 c7 43 10 00 00 00 00 44 8b 63 30 e9 e6 fe ff ff 0f 0b 0f 0b <0f> 0b 41 bc f4 ff ff ff e9 02 ff ff ff e8 ba cd 8a 00 66 2e 0f 1f [ 254.643018] RSP: 0000:ffffbe43e7b3fc68 EFLAGS: 00010282 [ 254.643021] RAX: 0000000000000000 RBX: ffff97d40f5bda88 RCX: 0000000000000006 [ 254.643023] RDX: 0000000000000000 RSI: ffff97cfc3cd8210 RDI: ffff97d217974010 [ 254.643024] RBP: ffff97d2a931ef50 R08: ffff97d0c0ef9800 R09: 0000000011111111 [ 254.643026] R10: 0000000000000000 R11: 0000000000000000 R12: 00000000ffffffea [ 254.643028] R13: ffff97d0ef92ff98 R14: 00000000000003b0 R15: ffff97d0ef92ff90 [ 254.643029] FS: 00007f90187ff640(0000) GS:ffff97d40f780000(0000) knlGS:0000000000000000 [ 254.643032] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 254.643033] CR2: 00007fa919907f08 CR3: 00000001d8b2a004 CR4: 00000000007706e0 [ 254.643035] PKRU: 55555554 Additional info: * package version(s) * config and/or log files etc. * link to upstream bug report, if any Steps to reproduce: Have 16G Physical memory and make 16G swap on SSD(or HDD, I use WD sn550) compile AOSP 12 source code, 16G physical mem consumed rapidly, then swap is used, this bug could be found. Then we can find that a java process which once is subprocess of ninja, stuck and can't be killed, unless reboot |
This task depends upon
Closed by Jelle van der Waa (jelly)
Thursday, 14 September 2023, 17:55 GMT
Reason for closing: Deferred
Additional comments about closing: Old kernel, please retry with the latest
Thursday, 14 September 2023, 17:55 GMT
Reason for closing: Deferred
Additional comments about closing: Old kernel, please retry with the latest
What I was doing though was a large amount of random reads and writes on a btrfs disk, and at the same time making a copy of a large files that were very fragmented. Randomly during the thing (I did the same thing before but didn't get this erro) I got the same message for syncthing, which was weird because syncthing wasn't really doing anything at that time. It was pretty much idle. No transfers were happening. The I/O intensive workloads I was doing was not by Syncthing, but other processes.
I didn't try killing the process, but after a few hours, my htops running in the background froze, and opening new htop instances had a frozen black screen. `ps ax` wouldn't even complete running, it would print some processes, then freeze. Syncthing was running in an LXD container and running systemctl commands inside the container would give "transport endpoint is not connected". Sudo was extremely slow to respond. I was able to `killall -9 syncthing` from the host OS and then the htops and `ps ax` started responding again. However, syncthing didn't actually get killed and couldn't die. It was still in the process list with a state of "Z", and another one "D".
[54854.254270] ------------[ cut here ]------------
[54854.254277] kernel BUG at mm/zswap.c:1313!
[54854.254422] invalid opcode: 0000 [#1] PREEMPT SMP PTI
[54854.254487] CPU: 3 PID: 202477 Comm: syncthing Tainted: G U 5.17.3-arch1-1 #1 7a55d2374d124bfa80e113bab2e4c0e86120013b
[54854.254627] Hardware name: Hewlett-Packard HP EliteDesk 800 G1 SFF/1998, BIOS L01 v02.78 02/20/2020
[54854.254730] RIP: 0010:zswap_frontswap_load+0x364/0x380
[54854.254795] Code: e8 08 da d3 ff 45 31 e4 e9 2c ff ff ff 48 8d 7b 10 e8 a0 b9 8a 00 c7 43 10 00 00 00 00 44 8b 63 30 e9 e6 fe ff ff 0f 0b 0f 0b <0f> 0b 41 bc f4 ff ff ff e9 02 ff ff ff e8 2a 02 8a 00 66 2e 0f 1f
[54854.254998] RSP: 0018:ffffb3c741a8bc68 EFLAGS: 00010282
[54854.255067] RAX: 0000000000000000 RBX: ffff9b599fbbdf80 RCX: ffffb3c74067b2dd
[54854.255141] RDX: 0000000000000000 RSI: ffff9b578dca9ad0 RDI: ffff9b57bd17f010
[54854.255224] RBP: ffff9b5887fd2c40 R08: ffff9b5880da9a80 R09: ffffb3c74067e000
[54854.255308] R10: ffffb3c74065c000 R11: ffffb3c74065c4b6 R12: 00000000ffffffea
[54854.255392] R13: ffff9b588dda2b48 R14: 0000000000000000 R15: ffff9b588dda2b40
[54854.255477] FS: 000000c000080490(0000) GS:ffff9b599fb80000(0000) knlGS:0000000000000000
[54854.255572] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[54854.255634] CR2: 000000c00014b008 CR3: 0000000125882005 CR4: 00000000001706e0
[54854.255719] Call Trace:
[54854.255752] <TASK>
[54854.255791] __frontswap_load+0x50/0x60
[54854.255846] swap_readpage+0x19b/0x2f0
[54854.255905] do_swap_page+0x7e4/0x920
[54854.255957] ? futex_wait+0x18d/0x270
[54854.256014] ? ptep_set_access_flags+0x2f/0x40
[54854.256080] ? wp_page_reuse+0x61/0x70
[54854.256136] __handle_mm_fault+0x9c8/0x1530
[54854.256189] ? do_compat_epoll_pwait.part.0+0xc/0x70
[54854.256255] handle_mm_fault+0xb2/0x280
[54854.260331] do_user_addr_fault+0x1ba/0x690
[54854.263880] exc_page_fault+0x72/0x170
[54854.265018] ? asm_exc_page_fault+0x8/0x30
[54854.266123] asm_exc_page_fault+0x1e/0x30
[54854.267211] RIP: 0033:0x558e1c75253b
[54854.268238] Code: 0f b6 11 44 89 c1 45 89 d5 41 d3 ea 41 0f ba e2 04 0f 83 ec 00 00 00 48 89 44 24 58 41 0f a3 cd 0f 83 87 00 00 00 4e 8d 14 20 <4d> 8b 12 66 90 4d 85 d2 74 79 4d 89 d5 4d 29 e2 4c 39 d2 77 6e 89
[54854.269321] RSP: 002b:000000c0001b1e80 EFLAGS: 00010207
[54854.270430] RAX: 0000000000000000 RBX: 000000c000044138 RCX: 0000000000000000
[54854.271502] RDX: 0000000000000500 RSI: 0000000000203000 RDI: 0000558e1d544138
[54854.272573] RBP: 000000c0001b1f08 R08: 0000000000000000 R09: 00007f84652bba00
[54854.273654] R10: 000000c000134000 R11: 00007f84654b1fff R12: 000000c000134000
[54854.274735] R13: 00000000000000f5 R14: 000000c000248680 R15: 00007f84652b5266
[54854.275792] </TASK>
[54854.276840] Modules linked in: tcp_diag udp_diag inet_diag vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock wireguard curve25519_x86_64 libchacha20poly1305 chacha_x86_64 poly1305_x86_64 libcurve25519_generic libchacha ip6_udp_tunnel udp_tunnel 8021q garp mrp stp llc macvlan cfg80211 nf_log_syslog nft_log nft_ct nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink nls_iso8859_1 vfat fat intel_rapl_msr hp_wmi intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel sparse_keymap kvm snd_hda_codec_hdmi irqbypass intel_spi_platform platform_profile intel_spi snd_hda_intel i915 spi_nor at24 rfkill wmi_bmof snd_intel_dspcfg snd_intel_sdw_acpi rapl mtd psmouse intel_cstate snd_hda_codec intel_uncore snd_hda_core wmi snd_hwdep tpm_infineon snd_pcm i2c_i801 ttm tpm_tis snd_timer i2c_smbus lpc_ich pcspkr mac_hid snd video intel_gtt tpm_tis_core soundcore tcp_bbr sch_cake zram fuse bpf_preload ip_tables x_tables btrfs blake2b_generic libcrc32c
[54854.276882] crc32c_generic xor raid6_pq dm_crypt cbc encrypted_keys dm_mod trusted asn1_encoder tee tpm rng_core crct10dif_pclmul serio_raw atkbd crc32_pclmul crc32c_intel libps2 ghash_clmulni_intel aesni_intel crypto_simd xhci_pci i8042 cryptd e1000e xhci_pci_renesas serio
[54854.285498] ---[ end trace 0000000000000000 ]---
[54854.286931] RIP: 0010:zswap_frontswap_load+0x364/0x380
[54854.288218] Code: e8 08 da d3 ff 45 31 e4 e9 2c ff ff ff 48 8d 7b 10 e8 a0 b9 8a 00 c7 43 10 00 00 00 00 44 8b 63 30 e9 e6 fe ff ff 0f 0b 0f 0b <0f> 0b 41 bc f4 ff ff ff e9 02 ff ff ff e8 2a 02 8a 00 66 2e 0f 1f
[54854.289618] RSP: 0018:ffffb3c741a8bc68 EFLAGS: 00010282
[54854.290974] RAX: 0000000000000000 RBX: ffff9b599fbbdf80 RCX: ffffb3c74067b2dd
[54854.292343] RDX: 0000000000000000 RSI: ffff9b578dca9ad0 RDI: ffff9b57bd17f010
[54854.293680] RBP: ffff9b5887fd2c40 R08: ffff9b5880da9a80 R09: ffffb3c74067e000
[54854.295013] R10: ffffb3c74065c000 R11: ffffb3c74065c4b6 R12: 00000000ffffffea
[54854.296330] R13: ffff9b588dda2b48 R14: 0000000000000000 R15: ffff9b588dda2b40
[54854.297693] FS: 000000c000080490(0000) GS:ffff9b599fa80000(0000) knlGS:0000000000000000
[54854.299026] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[54854.300356] CR2: 00007ff6fd4c57c0 CR3: 0000000125882006 CR4: 00000000001706e0
Can you reproduce the issue using an upstream kernel with no external modules loaded?
It only happens when using zram, when using the z3fold zpool, and when zram is being utilised a lot, such as when memory usage becomes high or some application uses memory in a way that often triggers it. For example, it was common on my server running libtorrent-rasterbar and when compiling large software. I recall a comment in a GitHub issue with the repo maintaner stating that z3fold was known to be buggy and they should switch to zbud (echo zbud > /sys/module/zswap/parameters/zpool), unfortunately I cannot find it again. That worked for me as well, I was able to avoid it by switching to zbud. Eventually I upgraded the memory of the server, and experimented without setting the zpool to zbud, and it ran ok (so it only happens when zram is being utilised heavily). It also recently occured to me on my desktop machine (using z3fold) while working in chromium, similar to the person you posted about. I noticed my memory usage was unusually high, tried to close a tab, noticed it hanged, checked kernel ring buffer and saw the same error. I could close down everything and shutdown but there was a stubborn chromium process that wouldn't be terminated with SIGKILL and systemd would be waiting to swapoff my zram swap forever so I needed to force shut it down.
Here is the relevant logs, still occurs on a recent kernel:
[18797.077174] ------------[ cut here ]------------
[18797.077177] kernel BUG at mm/zswap.c:1347!
[18797.077185] invalid opcode: 0000 [#1] PREEMPT SMP PTI
[18797.077188] CPU: 0 PID: 25025 Comm: ThreadPoolForeg Tainted: G U 6.0.8-arch1-1 #1 9d710c2a17e975eb42321436dd1a075089abf66c
[18797.077191] Hardware name: LENOVO 10ADA00WAU/, BIOS FEKTA2AUS 06/11/2020
[18797.077193] RIP: 0010:zswap_frontswap_load+0x39b/0x3b0
[18797.077199] Code: 3c 24 e8 d8 d8 01 00 e9 13 ff ff ff 49 8d 7f 10 e8 9a 83 8f 00 41 c7 47 10 00 00 00 00 41 8b 6f 30 e9 cc fe ff ff 0f 0b 0f 0b <0f> 0b e8 1e c9 8e 00 bd f4 ff ff ff e9 20 ff ff ff 0f 1f 40 00 f3
[18797.077200] RSP: 0018:ffffc18e885e3c48 EFLAGS: 00010282
[18797.077203] RAX: 0000000000000000 RBX: ffff9c1886d3f700 RCX: fffff9a74220df80
[18797.077204] RDX: 0000000000000000 RSI: fffff9a740000000 RDI: ffff9c190837e010
[18797.077205] RBP: 00000000ffffffea R08: ffffc18e8055a000 R09: ffffc18e80539000
[18797.077206] R10: 000000000000000a R11: ffffc18e8055b000 R12: ffff9c19837c6820
[18797.077207] R13: ffff9c1984670828 R14: ffff9c1984670820 R15: ffff9c1a18a3ee78
[18797.077209] FS: 00007fba48ff26c0(0000) GS:ffff9c1a18a00000(0000) knlGS:0000000000000000
[18797.077210] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[18797.077212] CR2: 00001c4b2a06326c CR3: 000000010372c001 CR4: 00000000001706f0
[18797.077213] Call Trace:
[18797.077215] <TASK>
[18797.077218] __frontswap_load+0x5b/0x80
[18797.077221] swap_readpage+0x1b2/0x540
[18797.077224] do_swap_page+0x9a4/0xb60
[18797.077227] ? check_preempt_wakeup+0x17e/0x2c0
[18797.077232] __handle_mm_fault+0x870/0xf70
[18797.077235] handle_mm_fault+0xb2/0x290
[18797.077237] do_user_addr_fault+0x1be/0x6a0
[18797.077241] exc_page_fault+0x74/0x170
[18797.077244] asm_exc_page_fault+0x26/0x30
[18797.077247] RIP: 0033:0x559c17b8383a
[18797.077250] Code: 31 f6 4c 8b bd c8 fc ff ff 49 8d 57 ff 48 39 d0 0f 96 c0 48 39 ca 0f 92 c1 48 39 f2 0f 84 8e 00 00 00 20 c8 0f 85 86 00 00 00 <44> 8b 3a 48 8b b5 28 fc ff ff 4c 03 3e 80 bd a7 fc ff ff 00 0f 84
[18797.077251] RSP: 002b:00007fba48ff0920 EFLAGS: 00010246
[18797.077253] RAX: 00001c4b46e13f00 RBX: 00007fba48ff0b30 RCX: 00001c4b46e40001
[18797.077254] RDX: 00001c4b2a8181d8 RSI: 0000000000000000 RDI: 00001c4b2a817e2d
[18797.077255] RBP: 00007fba48ff0d30 R08: 0000000000000008 R09: 0000000000000000
[18797.077256] R10: 00002460003080f8 R11: 0000000000000206 R12: 00007fba48ff0de8
[18797.077257] R13: 000024600081f980 R14: 00001c4b2a817e2d R15: 00001c4b2a8181d9
[18797.077260] </TASK>
[18797.077261] Modules linked in: snd_seq_dummy snd_hrtimer snd_seq snd_seq_device wireguard curve25519_x86_64 libchacha20poly1305 cfg80211 chacha_x86_64 poly1305_x86_64 libcurve25519_generic libchacha rfkill ip6_udp_tunnel udp_tunnel 8021q garp mrp stp llc veth nft_masq nft_chain_nat nf_nat nf_log_syslog nft_log nft_ct nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables nfnetlink dummy snd_hda_codec_hdmi intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio kvm_intel snd_hda_intel spi_nor snd_intel_dspcfg snd_intel_sdw_acpi kvm i915 mtd snd_hda_codec snd_hda_core irqbypass spi_intel_platform snd_hwdep at24 think_lmi rapl drm_buddy spi_intel wmi_bmof firmware_attributes_class snd_pcm ttm intel_cstate rtsx_usb_ms i2c_i801 memstick snd_timer pcspkr i2c_smbus intel_uncore snd drm_display_helper nls_iso8859_1 lpc_ich vfat cec e1000e fat tpm_tis intel_gtt soundcore wmi tpm_tis_core acpi_als
[18797.077304] industrialio_triggered_buffer kfifo_buf video industrialio joydev mousedev mac_hid tcp_bbr sch_cake zram sg fuse bpf_preload ip_tables x_tables btrfs blake2b_generic libcrc32c crc32c_generic xor raid6_pq rtsx_usb_sdmmc mmc_core rtsx_usb hid_multitouch usbhid dm_crypt cbc encrypted_keys trusted asn1_encoder tee tpm rng_core dm_mod crct10dif_pclmul crc32_pclmul crc32c_intel polyval_clmulni polyval_generic gf128mul ghash_clmulni_intel aesni_intel crypto_simd cryptd sr_mod xhci_pci cdrom xhci_pci_renesas
[18797.081941] ---[ end trace 0000000000000000 ]---
[18797.081957] RIP: 0010:zswap_frontswap_load+0x39b/0x3b0
[18797.081973] Code: 3c 24 e8 d8 d8 01 00 e9 13 ff ff ff 49 8d 7f 10 e8 9a 83 8f 00 41 c7 47 10 00 00 00 00 41 8b 6f 30 e9 cc fe ff ff 0f 0b 0f 0b <0f> 0b e8 1e c9 8e 00 bd f4 ff ff ff e9 20 ff ff ff 0f 1f 40 00 f3
[18797.081977] RSP: 0018:ffffc18e885e3c48 EFLAGS: 00010282
[18797.081981] RAX: 0000000000000000 RBX: ffff9c1886d3f700 RCX: fffff9a74220df80
[18797.081984] RDX: 0000000000000000 RSI: fffff9a740000000 RDI: ffff9c190837e010
[18797.081987] RBP: 00000000ffffffea R08: ffffc18e8055a000 R09: ffffc18e80539000
[18797.081988] R10: 000000000000000a R11: ffffc18e8055b000 R12: ffff9c19837c6820
[18797.081990] R13: ffff9c1984670828 R14: ffff9c1984670820 R15: ffff9c1a18a3ee78
[18797.081992] FS: 00007fba48ff26c0(0000) GS:ffff9c1a18a00000(0000) knlGS:0000000000000000
[18797.081994] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[18797.081995] CR2: 00007f0b65a00088 CR3: 000000010372c001 CR4: 00000000001706f0