Menu

1 / 4

109 Million Beats 72 Billion: LeCun's Theorem Says Every Model Sees the Same World

DEV Community: machinelearning·Daniel Sam Pete Thiyagu·15 days ago
#EH1xwygi
Reading 0:00
15s threshold

On October 29, 2026, Randall Balestriero (Brown University) and Yann LeCun (New York University / AMI Labs) posted a paper that turns a two-year-old conjecture into a theorem — and then embarrasses the scale-everything playbook with a 109-million-parameter model. Their good-view text JEPA scored 0.184 on a cross-modal alignment benchmark, ahead of every language model they tested up to 72 billion parameters, including Qwen2.5-72B at 0.154 and CLIP's text encoder at 0.124. The small model is 660 times smaller than the 72B model it beat (72,000 / 109 = 660.6). It also reached the same alignment as next-token prediction with 42 times fewer training samples: 21.6 million versus 900 million.

The paper is "Proving and Improving the Platonic Representation Hypothesis with JEPAs" (arXiv 2610.39302).…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.