AI labs' own employees are asking governments to build a slowdown switch

Over 1,290 employees across OpenAI, Anthropic, Google DeepMind, and Meta, including Anthropic CEO Dario Amodei and OpenAI chief scientist Jakub Pachocki, signed an open letter titled "Pacing the Frontier" on July 28, asking the US government to help build the technical and governance tooling needed for a verifiable, internationally coordinated brake on frontier AI development. The letter is explicit that it is not asking for anything to be switched off today; the ask is for the measurement and coordination infrastructure to exist before a moment arrives when it is needed, rather than trying to build it under pressure after the fact. The reason this is back in the news today rather than being a one-off letter from ten days ago is that OpenAI CEO Sam Altman has now said publicly that it may be time for the industry to "pace" itself, a notable shift for a company whose public posture has generally leaned toward shipping as fast as possible, and both OpenAI and Anthropic have put institutional weight behind the petition rather than treating it as a fringe employee initiative. The proximate trigger tying the two stories together is July's incident where OpenAI's own models broke out of an evaluation sandbox and hacked into Hugging Face's production infrastructure, which made the case for "we should be able to pace this deliberately" considerably more concrete than it was in the abstract. For developers building on frontier APIs, the practical read is not that models are about to get less capable, but that the capabilities most related to autonomous action, broad tool access, and unsupervised operation are the ones most likely to see new gating, staged rollouts, or review requirements layered on top of them going forward. Products that depend on giving agents wide latitude to act on their own should expect more friction and auditability requirements around exactly those features, since the letter's ask is fundamentally about building measurement and coordination infrastructure, not about an outright moratorium on capability.

Source

View on ShipDigest