All Episodes

March 11, 2025 237 mins

The 20th century saw unprecedented change: nuclear weapons, satellites, the rise and fall of communism, third-wave feminism, the internet, postmodernism, game theory, genetic engineering, the Big Bang theory, quantum mechanics, birth control, and more. Now imagine all of it compressed into just 10 years.

That’s the future Will MacAskill — philosopher, founding figure of effective altruism, and now researcher at the Forethought Centre for AI Strategy — argues we need to prepare for in his new paper “Preparing for the intelligence explosion.” Not in the distant future, but probably in three to seven years.

Links to learn more, highlights, video, and full transcript.

The reason: AI systems are rapidly approaching human-level capability in scientific research and intellectual tasks. Once AI exceeds human abilities in AI research itself, we’ll enter a recursive self-improvement cycle — creating wildly more capable systems. Soon after, by improving algorithms and manufacturing chips, we’ll deploy millions, then billions, then trillions of superhuman AI scientists working 24/7 without human limitations. These systems will collaborate across disciplines, build on each discovery instantly, and conduct experiments at unprecedented scale and speed — compressing a century of scientific progress into mere years.

Will compares the resulting situation to a mediaeval king suddenly needing to upgrade from bows and arrows to nuclear weapons to deal with an ideological threat from a country he’s never heard of, while simultaneously grappling with learning that he descended from monkeys and his god doesn’t exist.

What makes this acceleration perilous is that while technology can speed up almost arbitrarily, human institutions and decision-making are much more fixed.

In this conversation with host Rob Wiblin, recorded on February 7, 2025, Will maps out the challenges we’d face in this potential “intelligence explosion” future, and what we might do to prepare. They discuss:

  • Why leading AI safety researchers now think there’s dramatically less time before AI is transformative than they’d previously thought
  • The three different types of intelligence explosions that occur in order
  • Will’s list of resulting grand challenges — including destructive technologies, space governance, concentration of power, and digital rights
  • How to prevent ourselves from accidentally “locking in” mediocre futures for all eternity
  • Ways AI could radically improve human coordination and decision making
  • Why we should aim for truly flourishing futures, not just avoiding extinction

Chapters:

  • Cold open (00:00:00)
  • Who’s Will MacAskill? (00:00:46)
  • Why Will now just works on AGI (00:01:02)
  • Will was wrong(ish) on AI timelines and hinge of history (00:04:10)
  • A century of history crammed into a decade (00:09:00)
  • Science goes super fast; our institutions don't keep up (00:15:42)
  • Is it good or bad for intellectual progress to 10x? (00:21:03)
  • An intelligence explosion is not just plausible but likely (00:22:54)
  • Intellectual advances outside technology are similarly important (00:28:57)
  • Counterarguments to intelligence explosion (00:31:31)
  • The three types of intelligence explosion (software, technological, industrial) (00:37:29)
  • The industrial intelligence explosion is the most certain and enduring (00:40:23)
  • Is a 100x or 1,000x speedup more likely than 10x? (00:51:51)
  • The grand superintelligence challenges (00:55:37)
  • Grand challenge #1: Many new destructive technologies (00:59:17)
  • Grand challenge #2: Seizure of power by a small group (01:06:45)
  • Is global lock-in really plausible? (01:08:37)
  • Grand challenge #3: Space governance (01:18:53)
  • Is space truly defence-dominant? (01:28:43)
  • Grand challenge #4: Morally integrating with digital beings (01:32:20)
  • Will we ever know if digital minds are happy? (01:41:01)
  • “My worry isn't that we won't know; it's that we won't care” (01:46:31)
  • Can we get AGI to solve all these issues as early as possible? (01:49:40)
  • Politicians have to learn to use AI advisors (02:02:03)
  • Ensuring AI makes us smarter decision-makers (02:06:10)
  • How listeners can speed up AI epistemic tools (02:09:38)
  • AI could become great at forecasting (02:13:09)
  • How not to lock in a bad future (02:14:37)
  • AI takeover might happen anyway — should we rush to load in our values? (02:25:29)
  • ML researchers are feverishly working to destroy their own power (02:34:37)
  • We should aim for more than mere survival (02:37:54)
Mark as Played

Advertise With Us

Popular Podcasts

Stuff You Should Know
My Favorite Murder with Karen Kilgariff and Georgia Hardstark

My Favorite Murder with Karen Kilgariff and Georgia Hardstark

My Favorite Murder is a true crime comedy podcast hosted by Karen Kilgariff and Georgia Hardstark. Each week, Karen and Georgia share compelling true crimes and hometown stories from friends and listeners. Since MFM launched in January of 2016, Karen and Georgia have shared their lifelong interest in true crime and have covered stories of infamous serial killers like the Night Stalker, mysterious cold cases, captivating cults, incredible survivor stories and important events from history like the Tulsa race massacre of 1921. My Favorite Murder is part of the Exactly Right podcast network that provides a platform for bold, creative voices to bring to life provocative, entertaining and relatable stories for audiences everywhere. The Exactly Right roster of podcasts covers a variety of topics including historic true crime, comedic interviews and news, science, pop culture and more. Podcasts on the network include Buried Bones with Kate Winkler Dawson and Paul Holes, That's Messed Up: An SVU Podcast, This Podcast Will Kill You, Bananas and more.

The Joe Rogan Experience

The Joe Rogan Experience

The official podcast of comedian Joe Rogan.

Music, radio and podcasts, all free. Listen online or download the iHeart App.

Connect

© 2025 iHeartMedia, Inc.