What does it take to transform a brilliant AI model from a research paper into a product customers can rely on? We're joined by Elizabeth Lingg, Director of Applied Research at Contextual AI (the team behind RAG), to explore the immense challenge of bridging the gap between the lab and the real world. Drawing on her impressive career at Microsoft, Apple, and in the startup scene, Elizabeth details her journey from academic researcher to an industry leader shipping production AI.
Elizabeth shares her expert approach to measuring AI impact, emphasizing the need to correlate "inner loop" metrics like accuracy with "outer loop" metrics like customer satisfaction and the crucial "vibe check." Learn why specialized, grounded AI is essential for the enterprise and how using multiple, diverse metrics is the key to avoiding model bias and sycophancy. She provides a framework for how research and engineering teams can collaborate effectively to turn innovative ideas into robust products.
Check out:
Follow the hosts:
Follow today's guest(s):
- Learn more about Contextual AI: Contextual.ai Website
- Follow Contextual AI on Social Media: LinkedIn | X (formerly Twitter)
- Connect with Elizabeth: LinkedIn
Referenced in today's show:
- Throwing AI at Developers Won’t Fix Their Problems
- Why language models hallucinate
- i ran Claude in a loop for three months, and it created a genz programming language called cursed
Support the show:
- Subscribe to our Substack
- Leave us a review
- Subscribe on YouTube
- Follow us on Twitter or LinkedIn
Offers:
Popular Podcasts
On Purpose with Jay Shetty
I’m Jay Shetty host of On Purpose the worlds #1 Mental Health podcast and I’m so grateful you found us. I started this podcast 5 years ago to invite you into conversations and workshops that are designed to help make you happier, healthier and more healed. I believe that when you (yes you) feel seen, heard and understood you’re able to deal with relationship struggles, work challenges and life’s ups and downs with more ease and grace. I interview experts, celebrities, thought leaders and athletes so that we can grow our mindset, build better habits and uncover a side of them we’ve never seen before. New episodes every Monday and Friday. Your support means the world to me and I don’t take it for granted — click the follow button and leave a review to help us spread the love with On Purpose. I can’t wait for you to listen to your first or 500th episode!
Dateline NBC
Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations. Follow now to get the latest episodes of Dateline NBC completely free, or subscribe to Dateline Premium for ad-free listening and exclusive bonus content: DatelinePremium.com
What Are We Even Doing? with Kyle MacLachlan
Join award-winning actor and social media madman Kyle MacLachlan on “What Are We Even Doing,” where he sits down with Millennial and Gen Z actors, musicians, artists, and content creators to share stories about the entertainment industry past, present, and future. Kyle and his guests will talk shop, compare notes on life, and generally be weird together. In a good way. Their conversations will resonate with listeners of any age whose interests lie in television & film, music, art, or pop culture.