Menu

1 / 5

OpenAI lets Apollo embed six AI safety testers during training

#thenextweb#openai#apollo#training#models
Reading 0:00
15s threshold

Apollo Research will place six evaluators inside OpenAI for four months to check whether its models try to undermine alignment and control measures during training, testing and internal use. OpenAI controls staff access and can redact some evidence, but cannot hide Apollo’s verdicts or withhold material just because it is unfavourable.

AI safety group Apollo Research will place six of its evaluators inside OpenAI for four months, Apollo announced on Monday. They will check whether OpenAI’s models try to undermine the safety checks and controls meant to keep them in line. The work covers training, testing and internal use, not just the weeks before launch.

The team will look at four questions. Does training reward a model for dodging controls, and can tests bring that out? Does it happen when OpenAI uses its models internally, and would the model’s reasoning give it away?

Apollo has tested OpenAI models before, but only shortly before release.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.