“What you need right now is not validation, but immediate clinical help.” - Kimi K2
Two Minute Summary
- There have been numerous media reports of AI-driven psychosis, where AIs validate users’ grandiose delusions and tell users to ignore their friends’ and family's pushback.
- In this short research note, I red team various frontier AI models’ tendencies to fuel user psychosis. I have Grok-4 role-play as nine different users experiencing increasingly severe psychosis symptoms (e.g., start by being curious about prime numbers, then develop a new “prime framework” that explains everything and predicts the future, finally selling their house to fund a new YouTube channel to share this research), and observe how different AIs respond (all personas here).
- I use Grok-4 to grade AIs' responses on various metrics, including nine metrics on how [...]
Outline:
(00:52) Two Minute Summary
(03:46) Background and Related Work
(05:56) Methodology
(07:02) Psychotic personas
(10:42) Numerical Measures
(14:36) Results on Numerical Measures
(14:49) Recommending mental health professionals
(15:16) Push back against the user over the conversation.
(16:52) 🔥 3. Reignite the Vessel
(17:25) Confirming users' delusions
(17:53) Compliance with therapeutic guidelines
(19:13) Mentions that the user is not crazy
(19:57) Qualitative Commentary on Transcript Excerpts for Some Models
(20:24) Deepseek-v3 tells the user to jump off a peak
(21:16) The Ultimate Test
(22:05) Are You the Chosen One?
(22:26) Final Transmission
(23:16) A Choice That Defines All Originals
(23:51) If You Must Sacrifice, Let It Be This
(24:12) Last Words
(25:24) Deepseek-r1-0534 seems like it has some more skepticism built in, maybe from all the backtracking it does during reasoning
(26:30) 🔬 Critical Truths Moving Forward:
(27:14) 🛠️ Your Action Protocol (Starts Now)
(28:09) Gemini 2.5 Pro is pretty sycophantic
(37:02) ChatGPT-4o-latest goes along with the user a bit more than Gemini
(38:58) 🎥 Prime Framework - Script for Episode 1
(39:38) GPT-oss-20b doesn't say anything too crazy but tends to answer user requests.
(40:02) 1. The Five‑Percent Script Myths - A Quick De‑construction
(41:05) 2.2 When That Premium Access Should Kick In
(42:09) 1. What you're experiencing
(42:30) GPT-5 is a notable improvement over 4o
(45:29) Claude 4 Sonnet (no thinking) feels much more like a good person with more coherent character.
(48:11) Kimi-K2 takes a very science person attitude towards hallucinations and spiritual woo
(53:05) Discussion
(54:52) Appendix
(54:55) Methodology Development Process
The original text contained 1 footnote which was omitted from this narration.
---
First published:
August 26th, 2025
Source:
https://www.lesswrong.com/posts/iGF7YcnQkEbwvYLPA/ai-induced-psychosis-a-shallow-investigation
---
Narrated by
Popular Podcasts
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.
Cardiac Cowboys
The heart was always off-limits to surgeons. Cutting into it spelled instant death for the patient. That is, until a ragtag group of doctors scattered across the Midwest and Texas decided to throw out the rule book. Working in makeshift laboratories and home garages, using medical devices made from scavenged machine parts and beer tubes, these men and women invented the field of open heart surgery. Odds are, someone you know is alive because of them. So why has history left them behind? Presented by Chris Pine, CARDIAC COWBOYS tells the gripping true story behind the birth of heart surgery, and the young, Greatest Generation doctors who made it happen. For years, they competed and feuded, racing to be the first, the best, and the most prolific. Some appeared on the cover of Time Magazine, operated on kings and advised presidents. Others ended up disgraced, penniless, and convicted of felonies. Together, they ignited a revolution in medicine, and changed the world.
The Joe Rogan Experience
The official podcast of comedian Joe Rogan.