Journal Review in Artificial Intelligence: Four Times Better Than Us

You have probably seen recent headlines that Microsoft has developed an AI model that is 4x more accurate than humans at difficult diagnoses. It’s been published everywhere, AI is 80% accurate compared to a measly 20% human rate, and AI was cheaper too! Does this signal the end of the human physician? Is the title nothing more than clickbait? Or is the truth somewhere in-between? Join Behind the Knife fellow Ayman Ali and Dr. Adam Rodman from Beth Israel Deaconess/Harvard Medical School to discuss what this study means for our future.      

Studies:
Sequential Diagnosis with Large Language Models: https://arxiv.org/abs/2506.22405v1
METR study: https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/

Hosts:
Ayman Ali, MD
Ayman Ali is a Behind the Knife fellow and general surgery PGY-4 at Duke Hospital in his academic development time where he focuses on applications of data science and artificial intelligence to surgery. 

Adam Rodman, MD, MPH, FACP, @AdamRodmanMD
Dr. Rodman is an Assistant Professor and a practicing hospitalist at Beth Israel Deaconess Medical Center. He’s the Beth Israel Deaconess Medical Center Director of AI Programs. In addition, he’s the co-director of the Beth Israel Deaconess Medical Center iMED Initiative.
Podcast Link: http://bedside-rounds.org/

Please visit https://behindtheknife.org to access other high-yield surgical education podcasts, videos and more.  

If you liked this episode, check out our recent episodes here: https://app.behindtheknife.org/listen