Software updates for Raspberry Pi AI products

Raspberry Pi Software Engineering Manager Naush Patuck explains how users of our AI products can take advantage of our most recent software updates, including Hailo support for the Trixie release of Raspberry Pi OS and an input tensor injection feature for our AI Camera.

 

Raspberry Pi AI HAT+ and Raspberry Pi AI Kit

The Raspberry Pi AI HAT+ and the Raspberry Pi AI Kit, both based on Hailo AI accelerators, are now fully supported on the recently released Trixie version of Raspberry Pi OS. All the required software packages are available and ready to install from our apt repo.

Raspberry Pi single-board computer with an attached AI accelerator module, likely the Raspberry Pi AI Hat. This hat includes a green circuit board with a central chip that appears to be from Hailo, a company that specializes in artificial intelligence (AI) processors. The board is connected to the Raspberry Pi via the GPIO pins, and it has several components related to AI processing and other features to enable high-performance machine learning on the device. This configuration is designed for AI applications like real-time image processing, neural network acceleration, and other computationally intensive tasks. The text "26 TOPS" refers to the AI hat's ability to perform 26 trillion operations per second, which is a significant performance specification for AI applications.
Raspberry Pi AI HAT+
Raspberry Pi AI Kit

This package release does contain one significant change: we have removed the Hailo device driver from our kernel builds and are now using DKMS to build and install the kernel driver as part of the package installation. This decoupling not only enables more flexibility with software releases going forward, but also allows our users to downgrade the device driver without downgrading the kernel itself. Downgrading a driver is only necessary if custom-built models were generated from an older version of the Hailo Dataflow Compiler.

The installation instructions are exactly the same as before, with the additional step of installing the DKMS framework needed to compile the kernel device driver:

sudo apt install dkms
sudo apt install hailo-all

In related news, Hailo have also recently launched their application infrastructure framework on GitHub. This framework provides a foundation for developing your own AI-based applications by using reusable pipelines and components! Head over to the repo to check out the examples and demos.

Raspberry Pi AI Camera

One previously missing but frequently requested feature on the Raspberry Pi AI Camera is the ability to easily debug custom neural networks running on the device. We have now implemented an input tensor injection feature on the AI Camera that fulfils this request. Input tensor injection allows users to validate the quality and/or performance of the network running on the device using an existing image dataset in a repeatable way. These images may come from a standard dataset (e.g. COCO) or an entirely custom dataset tailored to your application.

Raspberry Pi AI Camera

To use this feature, make sure your software is fully up to date:

sudo apt update
sudo apt full-upgrade -y

You can also give our example input tensor injection script a try.