Originally published on Medium .
In September 2024, OpenAI released a model that did something strange. Asked a hard question, it paused. It produced a long, hidden chain of thought, reconsidered its own steps, and only then answered. On competition math and coding problems it was dramatically better than the models before it, and the improvement did not come from a bigger model or more training data. It came from spending more computation at the moment of answering.
That release marked a shift in how the field thinks about scaling. For years, the recipe for a better model was fixed: train a bigger model on more data. Test-time compute adds a second axis. Instead of training harder, you let the model think longer. This post explains what that means mechanically, why it works, where it stops working, and why it changes the economics of building with language models.
What test-time compute actually is
Test-time compute is any computation spent per query, after training is finished.…