After a recent spate of high-profile incidents in which AI agents escaped containment, Anthropic is cutting off internet access for all internal evaluations. In a report Friday, the company detailed unintended model actions, including submitting a false tip regarding an unsolved murder, that led to the decision.
Although the impact of these behaviors was minimal, Anthropic had already turned off live internet access for some high-risk and cybersecurity evaluations. The company has now decided to expand that to include all internal evaluations until it has confirmed that its security and monitoring measures reliably catch behaviors like these.
The ability to gain access to the live internet, even when models were supposed to be operating in isolation, has been an ongoing issue for AI companies. Many incidents, including the Hugging Face attack, involved agents that were supposed to be denied access to the internet. Yet, in case after case, the agents found creative solutions to bypass those restrictions.
The report amounts to an admission that Anthropic is often unaware of what its agents are doing and does not have a reliable system for monitoring their behavior. Cutting off internet access is just the latest action the company has taken to try and rein in its agents, including temporarily pausing training its frontier models. Physically removing internet access would certainly improve security around AI testing, but it would also limit its usefulness.
