Podcast: https://podcast.genaimeetup.com/
Youtube: https://www.youtube.com/@GenerativeAIMeetup
In this episode, we explore Stanford's groundbreaking S1 paper, which introduces a technique to transform any language model into a reasoning model for just $6 in computation costs. We dive deep into the implications of this research, discussing budget forcing techniques, the true costs of AI development, and the philosophical limits of artificial intelligence across different domains - from mathematical reasoning to language translation. The conversation extends to broader questions about superhuman AI capabilities and the fundamental limitations in various fields like translation, history, and agriculture. Join us for an insightful discussion on the future of AI reasoning and its practical applications.
0:00 - Intro and weekly AI news overview 1:06 - Introduction to the S1 paper from Stanford 1:40 - Explanation of reasoning models vs single-shot models 2:22 - Details of Stanford's S1 technique and QEN32B model 3:00 - Cost comparison with other models ($6 training cost) 4:04 - Discussion of model distillation technique 5:00 - Budget forcing explanation 6:33 - Story about building an AI stock research agent 8:22 - Philosophical discussion on reasoning limits
Popular Podcasts
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.
Cardiac Cowboys
The heart was always off-limits to surgeons. Cutting into it spelled instant death for the patient. That is, until a ragtag group of doctors scattered across the Midwest and Texas decided to throw out the rule book. Working in makeshift laboratories and home garages, using medical devices made from scavenged machine parts and beer tubes, these men and women invented the field of open heart surgery. Odds are, someone you know is alive because of them. So why has history left them behind? Presented by Chris Pine, CARDIAC COWBOYS tells the gripping true story behind the birth of heart surgery, and the young, Greatest Generation doctors who made it happen. For years, they competed and feuded, racing to be the first, the best, and the most prolific. Some appeared on the cover of Time Magazine, operated on kings and advised presidents. Others ended up disgraced, penniless, and convicted of felonies. Together, they ignited a revolution in medicine, and changed the world.
The Joe Rogan Experience
The official podcast of comedian Joe Rogan.