Jack Clark

"The AI industry right now has a gas pedal, but it doesn’t have a brake pedal in the car, and we want to do some of the work to build that pedal."

"We think this is a topic that the world should be talking more about."

"The authors warn that while this threshold has not yet been crossed, it could come sooner than most institutions are prepared for."

"If it were possible to effectively slow the development of this technology to give ourselves more time to deal with its immense implications, we think that would likely be a good thing."

"We are not there yet, and recursive self-improvement is not inevitable."

"No, I don't think it is."

"It would be good for the world to have the option to show or temporarily pause AI work that may be dangerous."

"That collision, where recursive intelligence building itself ever faster meets the world of humans, relationships, and governance, is another part of this future we can’t predict."

"Training runs are far easier to conceal than missile silos, their inputs are general-purpose, and the incentive to defect quietly is enormous, because whoever continues while others pause could inherit the lead."

"Right now, it’s like the AI industry has a gas pedal but it doesn't have a brake pedal."

"You want the option to be able to take your foot off the gas and put your foot on the brake."