Our guest in this episode is Nate Soares, President of the Machine Intelligence Research Institute, or MIRI.
MIRI was founded in 2000 as the Singularity Institute for Artificial Intelligence by Eliezer Yudkowsky, with support from a couple of internet entrepreneurs. Among other things, it ran a series of conferences called the Singularity Summit. In 2012, Peter Diamandis and Ray Kurzweil, acquired the Singularity Summit, including the Singularity brand, and the Institute was renamed as MIRI.
Nate joined MIRI in 2014 after working as a software engineer at Google, and since then he’s been a key figure in the AI safety community. In a blogpost at the time he joined MIRI he observed “I turn my skills towards saving the universe, because apparently nobody ever got around to teaching me modesty.”
MIRI has long had a fairly pessimistic stance on whether AI alignment is possible. In this episode, we’ll explore what drives that view—and whether there is any room for hope.
Selected follow-ups:
- Nate Soares - MIRI
- Yudkowsky and Soares Announce Major New Book: “If Anyone Builds It, Everyone Dies” - MIRI
- The Bayesian model of probabilistic reasoning
- During safety testing, o1 broke out of its VM - Reddit
- Leo Szilard - Physics World
- David Bowie - Five Years - Old Grey Whistle Test
- Amara's Law - IEEE
- Robert Oppenheimer calculation of p(doom)
- JD Vance commenting on AI-2027
- SolidGoldMagikarp - LessWrong
- ASML
- Chicago Pile-1 - Wikipedia
- Castle Bravo - Wikipedia
Music: Spike Protein, by Koi Discovery, available under CC0 1.0 Public Domain Declaration
Real Talk About MarketingAn Acxiom podcast where we discuss marketing made better, bringing you real...
Listen on: Apple Podcasts Spotify
Digital Disruption with Geoff NielsonDiscover how technology is reshaping our lives and livelihoods.
Listen on: Apple Podcasts Spotify
Popular Podcasts
On Purpose with Jay Shetty
I’m Jay Shetty host of On Purpose the worlds #1 Mental Health podcast and I’m so grateful you found us. I started this podcast 5 years ago to invite you into conversations and workshops that are designed to help make you happier, healthier and more healed. I believe that when you (yes you) feel seen, heard and understood you’re able to deal with relationship struggles, work challenges and life’s ups and downs with more ease and grace. I interview experts, celebrities, thought leaders and athletes so that we can grow our mindset, build better habits and uncover a side of them we’ve never seen before. New episodes every Monday and Friday. Your support means the world to me and I don’t take it for granted — click the follow button and leave a review to help us spread the love with On Purpose. I can’t wait for you to listen to your first or 500th episode!
Crime Junkie
Does hearing about a true crime case always leave you scouring the internet for the truth behind the story? Dive into your next mystery with Crime Junkie. Every Monday, join your host Ashley Flowers as she unravels all the details of infamous and underreported true crime cases with her best friend Brit Prawat. From cold cases to missing persons and heroes in our community who seek justice, Crime Junkie is your destination for theories and stories you won’t hear anywhere else. Whether you're a seasoned true crime enthusiast or new to the genre, you'll find yourself on the edge of your seat awaiting a new episode every Monday. If you can never get enough true crime... Congratulations, you’ve found your people. Follow to join a community of Crime Junkies! Crime Junkie is presented by audiochuck Media Company.
Ridiculous History
History is beautiful, brutal and, often, ridiculous. Join Ben Bowlin and Noel Brown as they dive into some of the weirdest stories from across the span of human civilization in Ridiculous History, a podcast by iHeartRadio.