Menu

1 / 2

METR Says Anthropic Made Two Years of Benchmark Progress in One, With Most Evidence Redacted

#webpronews#news#metr#anthropic#models
Reading 0:00
15s threshold

Anthropic packed roughly two years of benchmark gains into the last 12 months, and an outside reviewer that spent 11 weeks with the company’s internal data thinks most of that speedup came from Anthropic’s own AI doing research work.

The review, published Thursday by the nonprofit METR , tries to put a number on a question that has been hard to answer from outside the labs. Since October 2025, benchmark scores for Anthropic’s models have grown at about 1.9 times their earlier rate, with a 95% confidence interval of 1.5 to 2.8 times. METR’s staff said they were confident the jump did not come from faster growth in training compute.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.