Menu

1 / 5

Why thinking longer helps: test-time compute and the new scaling axis

DEV Community: machinelearning·Adele Chinda·about 7 hours ago
#9inGSOuX
Reading 0:00
15s threshold

Originally published on Medium .

In September 2024, OpenAI released a model that did something strange. Asked a hard question, it paused. It produced a long, hidden chain of thought, reconsidered its own steps, and only then answered. On competition math and coding problems it was dramatically better than the models before it, and the improvement did not come from a bigger model or more training data. It came from spending more computation at the moment of answering.

That release marked a shift in how the field thinks about scaling. For years, the recipe for a better model was fixed: train a bigger model on more data. Test-time compute adds a second axis. Instead of training harder, you let the model think longer. This post explains what that means mechanically, why it works, where it stops working, and why it changes the economics of building with language models.

What test-time compute actually is

Test-time compute is any computation spent per query, after training is finished.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.