Hans De Goede (Hans de Goede), Fedora Linux developer working for Red Hat, introduced at the conference FOSDEM 2024 open stack for cameras connected using the MIPI (Mobile Industry Processor Interface) interface. The prepared open stack has not yet been accepted into the Linux kernel and the libcamera project, but is marked as having reached a state suitable for testing by a wide range of enthusiasts. The operation of the stack has been tested with MIPI cameras based on ov2740, ov01a1s and hi556 sensors used in laptops such as Lenovo ThinkPad X1 yoga gen 8, Dell Latitude 9420 and HP Specter x360 13.5 2023.
The MIPI interface is used in many new laptop models instead of the previously used video streaming over the USB bus from devices that support the UVC (USB Video Class) standard. MIPI provides access to the camera sensor using a CSI (Camera Serial Interface) receiver and an image processor integrated into the CPU (ISP, Image Signal Processor), providing image formation based on raw data coming from the sensor. Intel provides a set proprietary drivers for working with MIPI cameras in Linux via IPU6 (Imaging Processing Unit) in Intel Tiger Lake, Alder Lake, Raptor Lake and Meteor Lake processors.
The main difficulty in developing open drivers for MIPI cameras is due to the fact that the hardware interface of the ISP processor and the image processing algorithms implemented in it are usually not disclosed by CPU manufacturers and are a trade secret. To solve this problem, Linaro and Red Hat have developed a software implementation of an image processor – SoftISPwhich allows you to work with MIPI cameras without using proprietary components (SoftISP can be used as a replacement for IPU6 ISP).
Implementation of SoftISP transferred for inclusion in the project libcamera, which offers a software stack for working with camcorders, cameras and TV tuners in Linux, Android and ChromeOS. In addition to SoftISP, the stack for working with MIPI cameras includes a kernel-level driver for ov2740 and code to support the CSI receiver in the Linux kernel, which is part of the IPU6 of Intel processors.
Packages with the Linux kernel and libcamera, including changes prepared by the project, available in the COPR repository for installation on Fedora Linux 39. The Pipewire media server can be used to capture video from MIPI cameras. Support for working with cameras via Pipewire has already been added to the library libwebrtc. In Firefox, the ability to work with cameras via Pipewire given to a state suitable for use with WebRTC, starting with release 122. By default, working with cameras via Pipewire in Firefox is disabled and requires the “media.webrtc.camera.allow-pipewire” parameter to be activated in about:config.
Thanks for reading: