AI capabilities are advancing exponentially while policy and legislation lag years behind, creating a dangerous gap. This article argues for binding, FAA-style regulation of frontier models, plus updates to tax, innovation, social power balance, and geopolitical strategies to keep pace.

• AI capabilities went from barely coherent code to handling most software work at top AI firms in four years, tracking scaling laws that predict continued exponential gains
• Frontier models already pose real threats to cybersecurity, finance, critical infrastructure and national security (e.g. the Claude Mythos Preview breach), with bio and autonomy risks likely next
• Voluntary disclosure and optionality-preserving measures (transparency rules, export controls) are no longer sufficient given these demonstrated risks
• Anthropic will back binding federal pre-deployment testing requirements for frontier AI plus job-displacement policy, modeled on an FAA-style certification and audit system, building on early state laws like California's SB 53, New York's RAISE act and Illinois's SB 315

This post lists nine key quotes from a San Francisco talk by Demis Hassabis and Sebastian Mallaby covering everything from OpenAI’s 50% bankruptcy risk to the need for new “AlphaFold” moments in drug discovery. They debate AGI probabilities, frontier cyber defense access, global AI optimism, and the economic and philosophical challenges of a post-scarcity future.

• Mallaby puts a 50% chance OpenAI goes bankrupt within 18 months
• Hassabis says six more AlphaFold-level breakthroughs are needed to cut drug-delivery timelines from 10 years to months
• Hassabis calls the idea that p(doom) is zero "crazy," acknowledging real existential risk from AI
• Hassabis argues economists, social scientists, and philosophers must join scientists in shaping decisions about how AI's value gets shared