google has split its eighth-generation TPU into two specialized chips, TPU 8t for training and TPU 8i for inference, reshaping how engineering and FinOps teams plan capacity, match models to multi-step agent workloads, and track serving costs per completed task.
prefer designboom on google
ONE CHIP, TWO JOBS
Agentic workloads broke the shared GPU assumption. Google’s decision to split its eighth-generation TPU into one chip for training and one for inference shows how AI agents are changing the economics of the hardware underneath them.
all images ©Cloudfresh
GOOGLE SPLITS TPU INTO TRAINING AND INFERENCE SILICON
A shared GPU fleet does two different jobs. The same chips spend weeks training a model, then answer user requests once that model ships, so clusters, budgets, and roadmaps get sized around one pool of hardware.…