Menu

1 / 3

"You’re right"—LLMs will get climate info wrong if you ask

Long article (412 words) — no AI summary yet.
Reading 0:00
15s threshold

Two persistent trends show up here: The latest frontier models tend to score a bit better than earlier generations of that model, and larger open-weight models score better than small ones.

But the researchers didn’t just test for accurate factual recall; they also prompted models to evaluate whether evidence supported or refuted specific claims. (For example, the models were asked whether the statement that “renewable energy investment kills jobs” is accurate, given evidence like descriptions of employment and investment statistics.)

Here, the best models scored around 70 percent accuracy, while the worst models scored below 40 percent.

The 33 models are grouped into categories. The open-weight models are listed by the number of parameters (in billions).

Credit: Drobnjak, et al./UNESCO

The 33 models are grouped into categories.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.