Anthropic claims to be near something along the lines of recursive self-improvement , or RSI, according to the latest revision of its S-1/A filing, published Monday . The new warning in the “Risk Factors” section of the document is a subtle but notable update spotted by TechCrunch .
RSI, if real, would be a point at which a computer system can improve itself autonomously, and then the improved version would be able to improve itself, and on, and on. A version of the concept was central to my own humble work on “the singularity” back in 2016, but jargon has changed with the times. RSI as it relates to contemporary AI is a somewhat hazy concept, although some specifics have been hashed out over the past few years in rationalist and effective altruist -affiliated spaces online like Lesswrong .…