ChatGPT is the most well known of the Large Language Models (LLMs) but what is an LLM? We go deep into how this remarkable new technology is built, and why their performance is inconsistent — or jagged — across similar tasks. We dive into the techniques AI engineers use to align these tools’ behavior with our values, and explain why they don’t always work, and sometimes we get hallucinations or biased output.
This episode was produced by Steven Jackson and Jesse Dukes
Editing: Alexandra Salomon and Ruxandra Guidi
Reporting and research from Holly McDede, Natasha Esteves, Andrew Parsons, Andrew Meriwether, Marnette Federis, and Chris Bagg.
Sound design and music supervision by Steven Jackson.
Production assistance from Yebu Ji and Nathan Ray.
Data analysis from Manee Ngozi Nnamani and Manasa Kudumu.
Special thanks to Josh Sheldon, Camila Lee, Liz Hutner, and Eric Klopfer.
Administrative support from Jessica Rondon.
The research and reporting you heard in this episode was supported by the Spencer Foundation, the Kapor Foundation, the Jameel World Education Lab, the Social and Ethical Responsibility of Computing initiative at MIT, and the RAISE initiative, Responsible AI for Social Empowerment and Education also at MIT.
We had support from Google’s Academic Research Awards program.
The Homework Machine is a program of the MIT Teaching Systems Lab, Justin Reich, director.
Popular Podcasts
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.
Dateline NBC
Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations. Special Summer Offer: Exclusively on Apple Podcasts, try our Dateline Premium subscription completely free for one month! With Dateline Premium, you get every episode ad-free plus exclusive bonus content.
On Purpose with Jay Shetty
I’m Jay Shetty host of On Purpose the worlds #1 Mental Health podcast and I’m so grateful you found us. I started this podcast 5 years ago to invite you into conversations and workshops that are designed to help make you happier, healthier and more healed. I believe that when you (yes you) feel seen, heard and understood you’re able to deal with relationship struggles, work challenges and life’s ups and downs with more ease and grace. I interview experts, celebrities, thought leaders and athletes so that we can grow our mindset, build better habits and uncover a side of them we’ve never seen before. New episodes every Monday and Friday. Your support means the world to me and I don’t take it for granted — click the follow button and leave a review to help us spread the love with On Purpose. I can’t wait for you to listen to your first or 500th episode!