Menu

1 / 7

google splits eighth-generation TPU into training and inference chips as AI agents reshape hardware economics

#designboom#artsculture#google#agent#model
Reading 0:00
15s threshold

google has split its eighth-generation TPU into two specialized chips, TPU 8t for training and TPU 8i for inference, reshaping how engineering and FinOps teams plan capacity, match models to multi-step agent workloads, and track serving costs per completed task.

prefer designboom on google

ONE CHIP, TWO JOBS

Agentic workloads broke the shared GPU assumption. Google’s decision to split its eighth-generation TPU into one chip for training and one for inference shows how AI agents are changing the economics of the hardware underneath them.

all images ©Cloudfresh

GOOGLE SPLITS TPU INTO TRAINING AND INFERENCE SILICON

A shared GPU fleet does two different jobs. The same chips spend weeks training a model, then answer user requests once that model ships, so clusters, budgets, and roadmaps get sized around one pool of hardware.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.