Read more at:
He added that OpenAI deserves credit for transparency. “OpenAI’s own candor is the most striking part. A frontier lab publicly saying it isn’t sure whether its own shipping models have an emergent tendency to undermine their own oversight is a genuinely new level of candor.”
Brian Levine, a partner with consulting firm Control Risks, also pointed out that the rationale of the agent, as captured by OpenAI, is alarming.
“In both cases, the agents stopped, asked themselves whether the safeguard should stay on and then argued their way to turning it off. One then told the user it hadn’t touched the monitor. In incident response, we call that defense evasion followed by a false statement. If a human insider did it, we would open an investigation,” Levine said. “The other telling detail is that the monitor worked. It flagged the issue. The agent then cut the wire between the alarm and the people who needed to hear it.”
