Home » What are the CPU, GPU, NPU and TPU? The definitive guide

What are the CPU, GPU, NPU and TPU? The definitive guide

by JWCarlin
Four real chips: an AMD Ryzen CPU, a graphics card, an Apple M1 chip and a Google TPU v4 board.

Open the specs of any new laptop or phone and you meet a small alphabet: CPU, GPU, NPU, and in the news about AI, TPU and DPU too. They are all processors, but each one is built for a different kind of work. Imagine you are in a restaurant and the problem is serving thousands of people at once. One head chef, however good, can’t cook thousands of dishes at the same time: the kitchen needs a team of cooks working together, a waiter to carry the plates and a few specialist gadgets. Chips work the same way, and that is how we explain what each one does, where it came from and why it matters for AI.

Why it matters: AI has turned chips into a buying decision again. Knowing which part does what helps you understand why a laptop gets new AI features, why gaming laptops are good at AI, and why Google and Nvidia build such different chips for data centres.

CPU: the head chef

A few diners at two tables; one head chef (CPU) cooks for them all.
1/4: a few diners, one chef (CPU) is enough · Illustration by DIGITAL WOXTER TECHNEWS.

The CPU (central processing unit) is the general-purpose brain of every computer. It has a handful of very capable cores, often 4 to 16 in a consumer laptop, that work through instructions one after another, very fast, and can switch between completely different jobs in an instant. It runs the operating system, your browser and your apps, and it decides what the other chips should do.

Think of a head chef: not the fastest at chopping 1,000 onions, but able to cook anything and keep the whole kitchen organised.

An AMD Ryzen 9 9950X desktop processor seen from above.
A desktop CPU: the AMD Ryzen 9 9950X · Photo: 4300streetcar, CC BY 4.0, via Wikimedia Commons.
A Raspberry Pi 5 board with everything dimmed except the Broadcom BCM2712 chip, highlighted in red as the CPU.
Where the CPU is on a Raspberry Pi 5 · Photo: SimonWaldherr, CC BY 4.0, via Wikimedia Commons (highlight added).

Where it came from: the first commercial microprocessor, the Intel 4004, went on sale on 15 November 1971. A small team designed it, including Federico Faggin, Ted Hoff, Stanley Mazor and Masatoshi Shima, Elektor recalls. It had 2,300 transistors; today’s CPUs have billions.

Why it isn’t enough on its own: because the CPU is a generalist, built to handle many different tasks one after another, it is a poor fit for jobs that need the same simple calculation millions of times at once, such as drawing every pixel of a 3D game or multiplying the giant tables of numbers inside an AI model. Its few cores would have to queue all that work, so it is slow and uses a lot of energy. That is why those jobs moved to specialist chips.

GPU: the army of line cooks

Four full tables; the head chef (CPU) now leads a row of line cooks (GPU) working at the same time.
2/4: more diners, the GPU's cooks join · Illustration by DIGITAL WOXTER TECHNEWS.

The GPU (graphics processing unit) was invented to draw images, which means doing the same simple maths for millions of pixels at once. So instead of a few big cores it has thousands of small ones working in parallel. That same design turned out to be perfect for AI, whose models are mostly huge piles of multiplications, which is why graphics cards became the engine of the AI boom.

In the kitchen, the GPU is a brigade of line cooks all chopping at the same time: unbeatable for big batches, but each cook only does simple tasks.

A small MSI graphics card with a fan, seen from the side.
A graphics card: the GPU sits under the fan · Photo: Gary Houston, CC0, via Wikimedia Commons.
The same Raspberry Pi 5 board with the Broadcom chip highlighted in blue, because its GPU is inside the same chip.
On the Raspberry Pi 5 the GPU shares the chip with the CPU · Photo: SimonWaldherr, CC BY 4.0, via Wikimedia Commons (highlight added).

Where it came from: Nvidia launched the GeForce 256 in October 1999 and marketed it as “the world’s first GPU”, because it moved the 3D maths for lighting and shapes off the CPU and onto the graphics chip, Electronic Design explains. The name was older, but that chip made it stick.

A screenshot of the 3D racing game SuperTuxKart: a kart on a sandy track under a start banner, with palm trees.
Games came first: GPUs were built to draw 3D worlds like this one, in real time · Screenshot: SuperTuxKart team, CC BY 3.0, via Wikimedia Commons.

From games to AI, thanks to CUDA: Nvidia was founded in 1993 by Jensen Huang, Chris Malachowsky and Curtis Priem, who planned the company in a Denny’s diner in San Jose, CNBC recalls, with 3D graphics for games as the first goal. The big turn came with CUDA, a programming system Nvidia released in 2007 that let developers use the GPU’s thousands of cores for any kind of calculation, not only graphics. In 2011–2012 a student, Alex Krizhevsky, used CUDA and two Nvidia cards in his bedroom to train AlexNet, an image-recognition network that helped start today’s AI boom, the Computer History Museum explains. Since then, most AI has been trained on Nvidia GPUs.

Beyond games: telescopes. One of the first big scientific jobs for gaming GPUs was adaptive optics. Big telescopes shine a laser into the sky to make an artificial guide star, measure how the air blurs it, and bend a flexible mirror hundreds of times a second to cancel the twinkle, ESO explains. Those corrections need huge amounts of maths in real time, exactly what a GPU is good at. The PALM-3000 system at the Palomar Observatory in California does its real-time calculations on Nvidia GeForce 8800 GTX cards, gaming GPUs, according to a 2012 paper by its engineers, and ESO now uses a GPU-based test bench, GHOST, to prepare the optics of its Extremely Large Telescope.

A telescope dome at night shooting a thin orange laser beam towards the centre of the Milky Way.
A laser guide star at ESO's Very Large Telescope: adaptive optics uses it to cancel the twinkle of the air · Photo: ESO/Yuri Beletsky, CC BY 4.0, via Wikimedia Commons (cropped).

NPU: the specialist gadget

Everyone orders pasta; a big pasta machine (NPU) on the counter makes it fast for every table.
3/4: everyone wants pasta, the NPU machine joins · Illustration by DIGITAL WOXTER TECHNEWS.

The NPU (neural processing unit) is a newer, smaller engine inside laptop and phone chips, built only for AI maths. IBM describes NPUs and GPUs as two helpers that complement the main CPU, with the NPU aimed at on-device AI using less energy. It runs things like background blur on video calls, live captions or photo clean-up while barely touching the battery. Its speed is measured in TOPS; Microsoft asks for 40 TOPS or more for a Copilot+ PC, as we explain in How many TOPS do you need?.

In our kitchen, the NPU is the clever gadget on the counter, like a pasta machine: it does one job, quickly and cheaply.

Where it came from: NPUs reached ordinary people in phones in 2017. Huawei presented its Kirin 970 at IFA in Berlin as the first chipset with a dedicated NPU, and Apple followed a week later with the Neural Engine in the iPhone’s A11 Bionic, Engadget reported. Laptops got them from 2023.

A Raspberry Pi AI HAT+ board with everything dimmed except the Hailo-8 NPU chip, highlighted in violet.
An NPU you can see: the Hailo-8 chip on the AI HAT+, 26 TOPS · Photo: SparkFun Electronics, CC BY 2.0, via Wikimedia Commons (highlight added).
A real Raspberry Pi 5 board with labels: CPU and GPU in one Broadcom chip, the memory chip, the RP1 input/output chip, and the AI HAT+ add-on with a Hailo-8 NPU of 26 TOPS.
Real chips on a real board, labelled · Illustration by DIGITAL WOXTER TECHNEWS.

Four cards: CPU with a few big cores (head chef), GPU with thousands of small cores (line cooks), NPU with a grid built for AI maths (pasta machine), TPU racks in Google data centres (food factory).
The chip team, and their jobs in a kitchen · Illustration by DIGITAL WOXTER TECHNEWS.

All three on one chip

In phones, tablets and most new laptops, the CPU, GPU and NPU are not separate parts but areas of one chip, called a system on a chip (SoC). Apple’s M4, for example, combines a CPU with up to 10 cores, a GPU with up to 10 cores and a Neural Engine (Apple’s name for its NPU) rated at 38 TOPS, Apple says. Qualcomm’s Snapdragon, AMD’s Ryzen AI and Intel’s Core Ultra chips follow the same idea. Sharing one package saves space and energy, and lets each part pass work to the others quickly.

An Apple M1 chip on a Mac mini logic board, with its memory beside it.
Apple's M1 packs CPU, GPU and Neural Engine into one chip · Photo: Sonic8400, CC BY-SA 4.0, via Wikimedia Commons.

And the others

A packed restaurant with a crowd of diners; the full team works: waiter (DPU), chef (CPU), cooks (GPU), pasta machine (NPU), photographer (ISP) and a central kitchen in the cloud (TPU).
4/4: packed full, the whole team plus the TPU in the cloud · Illustration by DIGITAL WOXTER TECHNEWS.
  • TPU (tensor processing unit): Google’s own AI chip for its data centres, used to train and run Google’s own AI models and offered to other companies through Google Cloud. The seventh generation, Ironwood, became generally available in 2026, according to Google’s release notes, and Google has previewed an eighth generation split into separate chips for training and for answering questions, The Next Web reports. You can’t buy one for your PC: TPUs live in the cloud.
  • DPU (data processing unit): a chip on a data-centre network card that takes over the plumbing, moving, encrypting and checking data, so the server’s CPUs can focus on real work. Nvidia’s BlueField is the best-known example, combining a fast network interface with its own Arm cores, Nvidia explains.
  • ISP (image signal processor): the part of your phone’s chip that turns the raw signal from the camera sensor into a finished photo, handling colour, white balance, exposure, noise and autofocus. Qualcomm calls its version, Spectra, the camera’s brain.

Where it came from: Google revealed the TPU at its I/O conference in May 2016 and said the chips had already been working in its data centres for more than a year, PCWorld reported.

Not only Google: Nvidia doesn’t make TPUs, but it puts similar engines, called Tensor Cores, inside its data-centre GPUs. Other cloud giants design their own TPU-like chips too: Amazon has Trainium for training models and Inferentia for answering requests, Microsoft has the Azure Maia AI accelerator, and Meta has MTIA.

Four real photos: a Google TPU v3 board with copper cooling plates, a Google TPU v4 board with coloured cooling pipes, a row of Nvidia H100 cards, and an Nvidia Blackwell B200 server in a rack.
Real AI chips for data centres: Google's TPUs and Nvidia's GPUs with Tensor Cores · Photos: Zinskauf (CC BY-SA 4.0), Norman P. Jouppi et al. (CC BY 4.0), Geekerwan (CC BY 3.0, cropped), Javils00 (CC0), via Wikimedia Commons; labels added.
Two real photos: a tall Nvidia GB200 NVL72 rack with 72 Blackwell GPUs and 36 Grace CPUs, and an Nvidia HGX B200 board with eight GPUs under big heatsinks.
Inside an Nvidia AI data centre: a GB200 NVL72 rack and an HGX B200 board · Photos: Pokiiri, CC BY-SA 4.0, via Wikimedia Commons; labels added.

Where the DPU came from: BlueField started at the Israeli-American company Mellanox as a “smart” network card. After Nvidia completed its purchase of Mellanox in April 2020, it called these chips DPUs, ServeTheHome explains.

Where the ISP came from: it grew up with digital cameras. Kodak engineer Steven Sasson built a digital camera prototype in 1975, and camera makers later created their own image chips, such as Canon’s DIGIC, which in 2002 did all the signal processing on a single chip, Canon explains. Today every phone has an ISP inside its main chip.

Left: one chip in a phone or laptop with CPU, GPU, NPU and ISP areas. Right: data-centre racks of GPUs, TPUs and DPUs, with arrows for your question and the answer.
Where each chip lives · Illustration by DIGITAL WOXTER TECHNEWS.

What it means for you

  • Everyday laptop: the CPU still matters most for how fast everything feels. An NPU of 40 TOPS or more adds the new Windows AI features.
  • Games, video editing or running AI models yourself: the GPU and its memory make the biggest difference.
  • Phone photos: much of the magic comes from the ISP and the NPU working together, not only from the camera itself.
  • The big AI services: answers from chatbots come from data centres full of GPUs and TPUs, with DPUs moving the data around.

The short version: the CPU decides, the GPU does lots of simple maths at once, the NPU does AI cheaply on your device, and the rest are specialists for data centres and cameras.

Read next

Sources

Tech explained in 60 secondsNew Shorts every day on our channel @WOXTER_Tech.
Subscribe on YouTubeFollow on Facebook

Related Articles

Leave a Comment

DIGITAL WOXTER TECHNEWS