Eric chats with 2024 Nobel Laureate Geoffrey Hinton and Stanford Professor Jay McClelland, two pioneers who have spent nearly half a century laying the groundwork for modern-day AI, advancing research on neural networks long before it captured the world's imagination.
In fact, their early work faced significant skepticism from the scientific community - an experience they candidly discuss in this episode. This wide-ranging conversation covers everything from the capabilities of recent breakthrough LLMS like DeepSeek to AI agents, the nature of memory and confabulation, the challenges to aligning AI with human values when we humans don’t even agree on our values, and Geoff's fascinating new theory of language, featuring an analogy of words as thousand-dimensional, shape-shifting Lego blocks with hands.
Geoff, who retired in 2023, divided his time between the University of Toronto and Google DeepMind. With numerous accolades including the 2018 Turing Award and 2024 Nobel Prize in Physics, he is perhaps best known for co-developing the backpropagation algorithm - now a cornerstone of AI research. Jay, currently at Stanford and Google DeepMind, has revolutionized our understanding of human learning through his work on Parallel Distributed Processing (PDP), applying neural network principles to understand phenomena like language acquisition. His insights into human learning have profoundly influenced how we understand machine learning.
Their friendship dates back to the late 1970s and grew stronger as both collaborated with fellow pioneer David Rumelhart. They share some touching memories about Dave in this episode. Remarkably, despite decades of friendship and building upon each other's work, this appears to be their first recorded conversation together. Eric challenged them to discuss their latest insights and disagreements.
This episode was recorded on January 29, 2025.
JOIN OUR SUBSTACK! Stay up to date with the pod and become part of the ever-growing community! https://stanfordpsypod.substack.com/
If you found this episode interesting at all, consider leaving us a good rating! It just takes a second but will allow us to reach more people and make them excited about psychology.
Links:
Geoff's website
Geoff's Google Scholar
Jay's website
Jay's Google Scholar
Eric's website
Eric's X @EricNeumannPsy
Podcast X @StanfordPsyPod
Podcast Substack https://stanfordpsypod.substack.com/
Let us know what you think of this episode, or of the podcast! stanfordpsychpodcast@gmail.com
Popular Podcasts
CrimeLess: Hillbilly Heist
It’s 1996 in rural North Carolina, and an oddball crew makes history when they pull off America’s third largest cash heist. But it’s all downhill from there. Join host Johnny Knoxville as he unspools a wild and woolly tale about a group of regular ‘ol folks who risked it all for a chance at a better life. CrimeLess: Hillbilly Heist answers the question: what would you do with 17.3 million dollars? The answer includes diamond rings, mansions, velvet Elvis paintings, plus a run for the border, murder-for-hire-plots, and FBI busts.
Crime Junkie
Does hearing about a true crime case always leave you scouring the internet for the truth behind the story? Dive into your next mystery with Crime Junkie. Every Monday, join your host Ashley Flowers as she unravels all the details of infamous and underreported true crime cases with her best friend Brit Prawat. From cold cases to missing persons and heroes in our community who seek justice, Crime Junkie is your destination for theories and stories you won’t hear anywhere else. Whether you're a seasoned true crime enthusiast or new to the genre, you'll find yourself on the edge of your seat awaiting a new episode every Monday. If you can never get enough true crime... Congratulations, you’ve found your people. Follow to join a community of Crime Junkies! Crime Junkie is presented by audiochuck Media Company.
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.