FS#78562 - [linux] regression in kernel 6.2 caused by Intel atomisp camera driver

Attached to Project: Arch Linux
Opened by matheus vidal (matheusvidal) - Saturday, 20 May 2023, 21:34 GMT
Last edited by Jelle van der Waa (jelly) - Thursday, 14 September 2023, 17:58 GMT
Task Type Bug Report
Category Kernel
Status Closed
Assigned To Jan Alexander Steffens (heftig)
Architecture x86_64
Severity Low
Priority Normal
Reported Version
Due in Version Undecided
Due Date Undecided
Percent Complete 100%
Votes 0
Private No

Details

Hi,

This message is addressed to the software engineers at Arch Linux who work with Linux kernels, specifically those encountering difficulties installing the Linux operating system on computers with Intel Atom CPUs running Kernel 6.2 (including the new Ubuntu 23.04 and Kubuntu 23.04). I would like to bring to your attention that computers with Intel Atom (and possibly other Intel) CPUs are unable to boot into a Linux OS with Kernel 6.2 or higher.

The last stable Linux Kernel that Intel Atom CPU computers can successfully boot with is 6.1.25. The latest stable Kernel, 6.2.12, still exhibits this issue (downloaded from Ubuntu repositories, not compiled from source).

This bug is caused by the atomisp camera driver, which is utilized by computers with Intel Atom CPUs (https://github.com/linux-surface/linux-surface/issues/1095). It appears that during the transition from Kernel 6.1 to 6.2, some atomisp firmware went missing.

On March 15th, it was reported that even a Microsoft Surface 3 laptop fails to boot with Kernel 6.2 (https://github.com/linux-surface/linux-surface/issues/1095). On March 1st, similar behavior was reported by Arch Linux users as well (https://bbs.archlinux.org/viewtopic.php?id=283920).

Therefore, we can assume that this bug/regression affects all Linux distributions that intend to use or are currently using Kernel 6.2 or higher on computers with Intel Atom CPUs.

This bug has been reported in the Ubuntu bug tracking system (https://www.mail-archive.com/kernel-packages@lists.launchpad.net/msg501664.html) for Ubuntu 23.04 Beta.

In Manjaro Linux Kernel and their special Surface sub-Kernel, the issue was resolved by disabling atomisp and related modules in their Kernels (https://github.com/linux-surface/linux-surface/issues/1095).

I have just filed this bug in the Ubuntu bug tracking system (https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2017444).

Here's what I was doing:
I was updating Kubuntu 22.10 (with Kernel 5.19) to Kubuntu 23.04 (with Kernel 6.2.0-20), and the boot process halted with the following error messages:
watchdog: BUG: soft lockup - cpu# (a number that varied between boots from 2 to 4) stuck for 22s [systemd-udevd:302]
atomisp-isp2: 0000:00:03:0: atomisp: Error-2 while requesting firmware shisp_2401a0_v21.bin
atomisp-isp2: Failed to switch off isp

I have attached a picture and a video showing how the boot process of Kernel 6.2.0-20 gets stuck on an HP x2 210 G2 computer with an Intel Atom CPU.

This bug/regression probably has nothing to do with Intel, but could you please pass this information along to Kernel.org?

Additionally, I would like to mention that this error persists during the installation of Arch Linux with Kernel 6.2. Therefore, both Kubuntu and Arch Linux are facing the same issue with Kernel 6.2 on computers with Intel Atom CPUs. It is important to share this information with the software engineering team at Arch Linux, so they can be aware of the problem and explore possible solutions.
This task depends upon

Closed by  Jelle van der Waa (jelly)
Thursday, 14 September 2023, 17:58 GMT
Reason for closing:  Deferred
Additional comments about closing:  Old kernel, please retry with the latest
Comment by Toolybird (Toolybird) - Saturday, 20 May 2023, 21:47 GMT
Thanks for the report but you're in the wrong place. Upstream issues need to be reported upstream.

> but could you please pass this information along to Kernel.org

Anyone can contact the kernel folks via the kernel mailing list or the kernel bugzilla.

> It is important to share this information with the software engineering team at Arch Linux

The Arch kernel packaging team are aware of this situation, but as already mentioned, you should be talking to the upstream kernel folks yourself.
Comment by loqs (loqs) - Saturday, 20 May 2023, 22:04 GMT
  • Field changed: Percent Complete (100% → 0%)
Upstream ( Hans de Goedeis ) is aware and recommends disabling the atomisp module as it is not ready yet https://github.com/linux-surface/linux-surface/issues/1095#issuecomment-1528730990
Comment by matheus vidal (matheusvidal) - Saturday, 20 May 2023, 22:35 GMT
As mentioned by Hans de Goede:

Assuming that this enabled driver is part of the upstream Ubuntu kernels, please file a bug with Ubuntu to have this driver disabled for now. Enabling this driver for anyone who is not actively working on its development is not benefiting anyone at the moment.

The Arch Linux also keeps this driver enabled, causing the interruption of kernel loading. I am reporting here so that you can follow the instructions provided by Hans, which is to disable this driver for now. Currently, I am unable to install Arch on my laptop because of this issue.

Thank you for your attention.
Comment by loqs (loqs) - Saturday, 20 May 2023, 23:33 GMT
If you blacklist the atomisp module from the bootloader can you then succeed in booting the Arch installation media?

Loading...