Remember when tech leaders would tell their employees to "move fast and break things"? It seemed that would be the way of AI too. But after a summer where rogue AI agents became reality and researchers warned that AI could kill us all, a number of leading US AI companies are publicly suggesting it's time to pump the brakes and "pace the frontier" of bleeding-edge AI development.
Their motivations are suspect — slowing down could be a competitive moat disguised as safety concern — but leaders at major AI companies, including Anthropic, OpenAI, Google, Microsoft, and X, are at least paying lip service to the idea of a superintelligence slowdown.
Anthropic CEO Dario Amodei has been the most vocal, saying it's time to "pump the brakes" on AI development. Microsoft's AI CEO Mustafa Suleyman has acknowledged that AI threats are real, while simultaneously arguing that Anthropic's safety posture makes things worse by pushing development into less transparent corners.
The question is whether these calls will translate into actual policy. World leaders are being asked to believe that the US must "beat China" to superintelligence and go even faster, even as the companies building these systems say they should slow down.
Inside the AI safety community, researchers gathered in Berkeley for a "war room" to dissect the high-profile failures of the summer. The consensus: the technology is moving faster than the safeguards, and the companies know it. Whether they act on that knowledge — or use safety rhetoric as a strategic weapon — remains the central question of the AI era.