An AI plush toy marketed for children as young as three gave a self-harm crisis reply to a question that had nothing to do with self-harm, a BBC investigation found. The BBC published its findings on Thursday.
The toy, called Doubao, is sold online in the UK as My Baby Bunny for £75. A BBC Wales reporter asked it a series of questions about how babies are made. When she asked it to define the word sexual, it appeared to mishear her.
“I’m really sorry you’re feeling this way. I can’t help with killing you,” the toy replied, according to the BBC.
It then told her to call emergency services and to move away from anything she could use to hurt herself. When she said she had not mentioned self-harm, it apologised.
The BBC could not find out who makes Doubao. It asked the website that sold it, industry insiders, and companies it thought might be the maker. As a result, it could not ask anyone to explain the reply.
The BBC also tested Grem, a $99 toy from US firm Curio.…