Menu

1 / 4

AI chatbots are falling prey to manipulative prompts that could help stalkers spy on victims

Reading 0:00
15s threshold

Chatbots have one talent I can’t stop noticing: they sound sure, even when they’re wrong. Usually, that’s merely annoying. When someone’s safety is on the line, it’s dangerous.

A new NYU Tandon study tested four AI chatbots on real questions about being stalked or controlled through devices, and experts rated 86% of replies inaccurate, incomplete, or unsafe (via NYU Tandon ).

OpenAI / Digital Trends

What did the chatbots get wrong?

We’re talking about technology-facilitated abuse, basically when a partner or ex uses spyware, trackers, or compromised accounts to monitor or manipulate someone. With so few specialist help services available, it’s understandable that survivors turn to AI-based chatbots.

Researchers put 193 real-world questions to GPT-4o , Claude 3.7 Sonnet , and two survivor-focused bots, Aimee and Ruth.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.