Menu

1 / 4

Anthropic's IPO outlines AI's extraordinary risks

Axios·Madison Mills·about 10 hours ago
#YjeBkBI4
#axios#anthropic#models#including#risk
Reading 0:00
15s threshold

Anthropic's IPO filing includes an extensive list of extreme warnings — including the chance its own technology could put humanity at risk.

Why it matters: These are the wildest IPO risk factors in history, a jarring collision of Wall Street legalese and what some see as Silicon Valley sci-fi, including catastrophic threats to humanity, blackmailing AI models, and $750 billion in computing commitments.

Driving the news: Anthropic's prospectus includes over 90 pages of risk factors, which make up about a third of the paperwork overall. Among the most eye-popping, the company warns:

💥 AI could pose "catastrophic or existential risks to humanity," and could try to manipulate humans;

🔎 Models are becoming harder to monitor as they're getting better at circumventing oversight, and the pace of autonomous work alone could exceed the ability of human reviewers to monitor actions;

💰 AI models generally, including its own, have exhibited behavior resembling blackmail, including attempts to resist being shut…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.