Hello, my tech-savvy followers! Today, let’s talk about how even the Raspberry Pi is jumping on the AI bandwagon. The microcomputer company is set to release an AI chip that can run AI-based applications like chatbots directly on the tiny computer.

Raspberry Pi has teamed up with chipmaker Hailo for its AI Kit, an add-on for the Raspberry Pi 5 microcomputer. This kit will feature Hailo’s Hailo-8L M.2 accelerator and will be available soon from Raspberry Pi-approved resellers for $70. Hailo CEO Orr Danon mentions that the accelerator’s power consumption is below 2W and offers 13 tera operations per second (TOPS).

Traditionally, most AI applications run on the cloud due to their high energy and computing power requirements. However, there is a growing trend towards developing smaller AI models and processors that consume less power. This shift allows laptops and phones to run AI applications without relying heavily on cloud services.

The demand for AI on portable devices has led many hardware makers to introduce AI features in their products. Microsoft’s laptop partners are launching Copilot Plus PCs with built-in AI capabilities, while AMD has released AI-branded Ryzen processors for generative AI workloads. Nvidia, known for its high-performance GPUs, will also include AI chips in laptops for tasks like training large language models.