Anthropic’s AI progress comes with a disclosure gap: some of the evidence explaining its speed is confidential.

In a November 5 assessment, Model Evaluation and Threat Research (METR) estimated that Anthropic’s benchmark scores have improved at 1.9 times their earlier rate since October 2025. The broader finding concerns capabilities on well-specified tasks, with substantial uncertainty about how far those gains extend.

For IT buyers, the distinction matters: faster benchmark progress does not establish how much a new model will improve their own workflows.

The numbers behind the speedup

Metric Finding

Benchmark progress AECI scores growing at an estimated 1.9 times the earlier rate since October 2025; 95% confidence interval: 1.5–2.8

Estimated AI contribution Perhaps 80% of current acceleration, with substantial uncertainty

Training compute Faster scaling of training compute did not explain the acceleration

Public evidence Anthropic redacted much of the evidence METR considered most…