Supermicro will build and sell AI inference systems that pair SambaNova’s SN50 chips with Nvidia GPUs, the companies said on Tuesday. The collaboration initially plans for 10,000 SN50 chips, according to SambaNova’s announcement .
The racks will join Supermicro’s Data Center Building Block Solutions, the ready-made data centre systems it sells to customers.
Running an AI model has two stages. First the system reads the prompt, then it writes the answer piece by piece. In the new racks, Nvidia GPUs do the reading and SN50 chips do the writing, SambaNova said. The company says AI agents work nonstop, so how fast they act depends on how fast the model responds.
“Agentic AI is the next wave of inference, and it has to run everywhere,” said Rodrigo Liang, co-founder and chief executive of SambaNova.…