What is an NPU?

29 November 2024 AI & ML

An NPU stands for Neural Processing Unit, which is a specialised hardware accelerator designed to efficiently process tasks related to artificial intelligence, in particular deep learning models. NPUs are optimised for operations commonly found in neural networks, such as matrix multiplications, convolutions, and activation functions.

Here are some key points about NPUs:

NPUs are designed to perform the following AI tasks at maximum speed, while using the least amount of energy. NPUs are:

• Optimised for AI workloads: NPUs are designed to handle the vast number of computations involved in neural network processing more efficiently than general-purpose processors (like CPUs or GPUs).

• Power efficient: They are typically more power-efficient than using CPUs or even GPUs for AI tasks, making them ideal for mobile devices and edge computing where power consumption is critical.

• Able to perform real-time processing: NPUs can execute AI tasks, such as image recognition, speech processing, and other inference tasks, in real-time due to their high computational parallelism.

• Used in smartphones and edge devices: NPUs are increasingly common in modern smartphones (like those made by Apple, Huawei, and Google) to accelerate AI tasks such as photography enhancements, face recognition, and voice assistance.

• Integrated with SoCs (System on Chips): Many NPUs are embedded within SoCs, which are used in devices like smartphones, autonomous vehicles, IoT devices, and more, enabling AI computations directly on the device without needing to rely on cloud-based processing.

To summarise, neural processing units are crucial for enabling the growing demand for AI processing in compact, energy-efficient, and real-time environments without needing to be connected to a server to handle the AI processing.

Further reading:

Ryzen-based computer on module
Altron Arrow AI & ML
SolidRun announced the launch of its new Ryzen V3000 CX7 Com module, configurable with the eight-core/16-thread Ryzen Embedded V3C48 processor.

Read more...

---

Low SWaP SoM for AI applications
RFiber Solutions AI & ML
Matchstiq’s G20 and G40 are low SWaP-C SDRs tailored for AI and ML applications by combining an RF module, SDR, FPGA, CPU, and GPU into a single transceiver platform.

Read more...

---

Powering the intelligent edge
EBV Electrolink AI & ML
STMicroelectronics released new devices from the second generation of its industrial MPUs, the STM32MP2 series, to drive future progress in smart factories, smart healthcare, smart buildings, and smart infrastructure.

Read more...

---

A perfect match for next-gen computing
Vepac Electronics AI & ML
Teguar’s collaboration with Hailo marks a significant step forward in their mission to provide powerful and reliable computing solutions for a wide range of industries.

Read more...

---

High-performance low SWaP SDR
RFiber Solutions AI & ML
The Matchstiq X40 from Epiq is a high-performance low SWaP SDR optimised for AI and ML and the RF edge.

Read more...

---

AAEON introduces Amston Lake to processor options
Vepac Electronics AI & ML
Embedded computing company AAEON has launched the PICO-ASL4 and GENE-ASL6, both featuring the new Intel Atom x7000RE processor series for the edge.

Read more...

---

Protecting rhinos with a tech shield
AI & ML
HYDRA provides instant data creation, and aggregates data from drones, cameras, sensors, and mobile apps to provide a comprehensive picture of what’s happening across these large landscapes.

Read more...

---

Avnet Silica launches new AI microsite
Avnet Silica AI & ML
Avnet Silica has developed a new AI microsite where visitors can discover a plethora of AI/ML resources, including technical articles, webinars, and podcasts.

Read more...

---

Embedding AI into your next project?
Altron Arrow AI & ML
ST has collated all its AI tools into one resource, the ST Edge AI Suite, and includes free design tools, case studies, and other resources to accelerate AI development into embedded systems.

Read more...

---

Bridging the gap between MCUs and MPUs
Future Electronics Editor's Choice AI & ML
The Renesas RA8 series microcontrollers feature Arm Helium technology, which boosts the performance of DSP functions and of AI and machine learning algorithms.

Read more...

---