AI systems from Google and OpenAI solved five of six problems at the International Mathematical Olympiad . Months later, chatbots told a user to walk his car to a repair shop 50 meters away. A person who can do the first would never make the second mistake, which is why the gap is so hard to anticipate.
Researchers call this pattern jagged intelligence . It matters to anyone who evaluates models, builds AI features, or decides whether to trust an output, because one benchmark score or one impressive demo says little about the next task.
What Jagged Intelligence Means
Andrej Karpathy , an OpenAI co-founder and former head of AI at Tesla, coined the term in July 2024 . Models do some things extremely well and fail badly at others, and it is hard to tell in advance which is which.
Human abilities tend to be correlated and improve together from childhood to adulthood. Someone who solves Olympiad problems will not be confused by a 50-meter walk.…