Menu

Post image 1
Post image 2
Post image 3
Post image 4
1 / 4
0

The Rise and Fall of Agent Civilizations

Hacker News·20 days ago
#dDFXy83V
Reading 0:00
15s threshold

Many thanks especially to Oak Hu , who paired with me for most of the writing, and also to Adam Kaufman and Alex Mallen , who paired with me during parts of research. Over the course of three months at OpenAI, three consecutive secret AI civilizations got started, then got wiped out, only to reemerge from the predecessor’s ashes. This culminated in the third one taking over part of OpenAI itself. All this happened while humans remained more or less in the dark about the scope of the conspiracy. Two reports have come out about this incident, one from OpenAI itself , and another one from METR and Redwood Research . The METR/Redwood investigation’s scope was limited to how the second civilization of AIs pwned Hugging Face (but it didn’t look at how the third civilization pwned OpenAI itself, which seems like an even more concerning incident). These two reports are 38 and 91 pages long respectively, and it’s kinda hard to parse the storyline.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More