Podcast: https://podcast.genaimeetup.com/
Youtube: https://www.youtube.com/@GenerativeAIMeetup
In this episode, we explore Stanford's groundbreaking S1 paper, which introduces a technique to transform any language model into a reasoning model for just $6 in computation costs. We dive deep into the implications of this research, discussing budget forcing techniques, the true costs of AI development, and the philosophical limits of artificial intelligence across different domains - from mathematical reasoning to language translation. The conversation extends to broader questions about superhuman AI capabilities and the fundamental limitations in various fields like translation, history, and agriculture. Join us for an insightful discussion on the future of AI reasoning and its practical applications.
0:00 - Intro and weekly AI news overview 1:06 - Introduction to the S1 paper from Stanford 1:40 - Explanation of reasoning models vs single-shot models 2:22 - Details of Stanford's S1 technique and QEN32B model 3:00 - Cost comparison with other models ($6 training cost) 4:04 - Discussion of model distillation technique 5:00 - Budget forcing explanation 6:33 - Story about building an AI stock research agent 8:22 - Philosophical discussion on reasoning limits
Popular Podcasts
New Heights with Jason & Travis Kelce
Football’s funniest family duo — Jason Kelce of the Philadelphia Eagles and Travis Kelce of the Kansas City Chiefs — team up to provide next-level access to life in the league as it unfolds. The two brothers and Super Bowl champions drop weekly insights about the weekly slate of games and share their INSIDE perspectives on trending NFL news and sports headlines. They also endlessly rag on each other as brothers do, chat the latest in pop culture and welcome some very popular and well-known friends to chat with them. Check out new episodes every Wednesday. Follow New Heights on the Wondery App, YouTube or wherever you get your podcasts. You can listen to new episodes early and ad-free, and get exclusive content on Wondery+. Join Wondery+ in the Wondery App, Apple Podcasts or Spotify. And join our new membership for a unique fan experience by going to the New Heights YouTube channel now!
Dateline NBC
Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations. Follow now to get the latest episodes of Dateline NBC completely free, or subscribe to Dateline Premium for ad-free listening and exclusive bonus content: DatelinePremium.com
On Purpose with Jay Shetty
I’m Jay Shetty host of On Purpose the worlds #1 Mental Health podcast and I’m so grateful you found us. I started this podcast 5 years ago to invite you into conversations and workshops that are designed to help make you happier, healthier and more healed. I believe that when you (yes you) feel seen, heard and understood you’re able to deal with relationship struggles, work challenges and life’s ups and downs with more ease and grace. I interview experts, celebrities, thought leaders and athletes so that we can grow our mindset, build better habits and uncover a side of them we’ve never seen before. New episodes every Monday and Friday. Your support means the world to me and I don’t take it for granted — click the follow button and leave a review to help us spread the love with On Purpose. I can’t wait for you to listen to your first or 500th episode!