In this episode, Ruben Amarasingham discusses the latest advancements at Pieces, focusing on their innovative system to classify, detect, and prevent hallucinatory errors in clinical summarization. The conversation delves into the development and impact of their proprietary Safe Read platform, the challenges faced, the October publication they released to the public, and the future of AI in healthcare.
Section Summaries
Introduction [00:00:01]
Adam Carewe welcomes Ruben Amarasingham back to the podcast, highlighting the recurring guest status and setting the stage for a discussion on the latest developments at Pieces.
Overview of Pieces' Whitepaper [00:01:40]
Adam introduces the main topic of the episode: a whitepaper by Pieces titled "A system to classify, detect, and Prevent Hallucinatory Error in Clinical Summarization." He provides a high-level summary of the paper, emphasizing the importance of addressing hallucinations in AI-generated clinical summaries.
Reuben's Insights on the Whitepaper [00:04:20]
Reuben elaborates on the motivation behind the whitepaper, explaining the significance of creating accurate and reliable clinical summaries. He discusses the challenges of hallucinations in large language models and the framework Pieces developed to classify and mitigate these errors.
Development of the Classification Framework [00:07:36]
Ruben shares the history and development process of the classification framework, highlighting the importance of inter-rater reliability and the rigorous testing involved. He introduces the Safe Read platform, which helps measure and manage hallucinations in clinical summaries.
Safe Read Platform and Its Impact [00:11:23]
The conversation shifts to the Safe Read platform, an internal tool used by Pieces to detect and address hallucinations. Ruben explains how the platform works, its components, and the continuous improvement process through adversarial AI and knowledge graphs.
Challenges and Evolution of Safe Read [00:13:38]
Ruben discusses the challenges faced in developing and iterating the Safe Read platform. He highlights the importance of human intervention in improving the system and the role of adversarial AI in detecting hallucinations.
Impact of Safe Read on Clinical Summarization [00:18:46]
Ruben talks about the positive impact of the Safe Read platform on reducing hallucinations in clinical summaries. He explains how the system has evolved to address less severe hallucinations and improve the overall accuracy and reliability of summaries.
Industry Standards and Regulatory Challenges [00:22:19]
The discussion touches on the lack of industry benchmarks for AI systems in healthcare and the role of regulatory bodies. Ruben shares insights on Pieces' interactions with the Texas Attorney General and the importance of transparency and reporting in AI development.
Future Directions for Pieces [00:33:15]
Ruben outlines the future goals for Pieces, including expanding the Safe Read platform to other forms of AI documentation and patient interactions. He discusses the potential for collaboration with other AI companies and the broader impact on healthcare.
Closing Thoughts and Nerd Alert Questions [00:42:05]
Adam wraps up the conversation with some light-hearted "nerd alert" questions, asking Ruben about his favorite ways to relax, recent books he's read, and skills he wants to master. Ruben shares his love for reading, spending time with family, and his interest in art and AI-driven creative projects.
Get full access to Rewskidotcom | Adam Carewe MD at .css-j9qmi7{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-flex-direction:row;-ms-flex-direction:row;flex-direction:row;font-weight:700;margin-bottom:1rem;margin-top:2.8rem;width:100%;-webkit-box-pack:start;-ms-flex-pack:start;-webkit-justify-content:start;justify-content:start;padding-left:5rem;}@media only screen and (max-width: 599px){.css-j9qmi7{padding-left:0;-webkit-box-pack:center;-ms-flex-pack:center;-webkit-justify-content:center;justify-content:center;}}.css-j9qmi7 svg{fill:#27292D;}.css-j9qmi7 .eagfbvw0{-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;color:#27292D;}
Popular Podcasts
On Purpose with Jay Shetty
I’m Jay Shetty host of On Purpose the worlds #1 Mental Health podcast and I’m so grateful you found us. I started this podcast 5 years ago to invite you into conversations and workshops that are designed to help make you happier, healthier and more healed. I believe that when you (yes you) feel seen, heard and understood you’re able to deal with relationship struggles, work challenges and life’s ups and downs with more ease and grace. I interview experts, celebrities, thought leaders and athletes so that we can grow our mindset, build better habits and uncover a side of them we’ve never seen before. New episodes every Monday and Friday. Your support means the world to me and I don’t take it for granted — click the follow button and leave a review to help us spread the love with On Purpose. I can’t wait for you to listen to your first or 500th episode!
Boysober
Have you ever wondered what life might be like if you stopped worrying about being wanted, and focused on understanding what you actually want? That was the question Hope Woodard asked herself after a string of situationships inspired her to take a break from sex and dating. She went "boysober," a personal concept that sparked a global movement among women looking to prioritize themselves over men. Now, Hope is looking to expand the ways we explore our relationship to relationships. Taking a bold, unfiltered look into modern love, romance, and self-discovery, Boysober will dive into messy stories about dating, sex, love, friendship, and breaking generational patterns—all with humor, vulnerability, and a fresh perspective.
Crime Junkie
Does hearing about a true crime case always leave you scouring the internet for the truth behind the story? Dive into your next mystery with Crime Junkie. Every Monday, join your host Ashley Flowers as she unravels all the details of infamous and underreported true crime cases with her best friend Brit Prawat. From cold cases to missing persons and heroes in our community who seek justice, Crime Junkie is your destination for theories and stories you won’t hear anywhere else. Whether you're a seasoned true crime enthusiast or new to the genre, you'll find yourself on the edge of your seat awaiting a new episode every Monday. If you can never get enough true crime... Congratulations, you’ve found your people. Follow to join a community of Crime Junkies! Crime Junkie is presented by audiochuck Media Company.