Menu

1 / 4

Simple math can predict when AI is about to go rogue, physicists say

Reading 0:00
15s threshold

Researchers say they've developed a simple mathematical formula that can predict when certain ChatGPT-like artificial intelligence (AI) chatbots will "go rogue," suddenly switching from helpful responses to potentially harmful ones.

In a new study published Oct. 8 in the journal Patterns, physics professor Neil Johnson and doctoral student Frank Yingjie Huo , both at The George Washington University, show how the order in which a chatbot is given certain prompts can drastically reshape its answers, leading to "tipping points" that can send the chatbot down a rabbit hole of bad advice. However, Johnson and Huo say their formula can easily predict these tipping points.There have been horror stories of AI encouraging users into suicide , helping build lethal weapons , and amplifying violent or harmful points of view . At the same time, researchers at OpenAI and Anthropic , respectively, have repeatedly and openly stated that they don't really understand why their creations behave the way they do.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.