Anthropic packed roughly two years of benchmark gains into the last 12 months, and an outside reviewer that spent 11 weeks with the company’s internal data thinks most of that speedup came from Anthropic’s own AI doing research work.
The review, published Thursday by the nonprofit METR , tries to put a number on a question that has been hard to answer from outside the labs. Since October 2025, benchmark scores for Anthropic’s models have grown at about 1.9 times their earlier rate, with a 95% confidence interval of 1.5 to 2.8 times. METR’s staff said they were confident the jump did not come from faster growth in training compute.…