ai-psychosis

I've seen this called AI Psychosis before [1] I don't really think this is every possible to stop fully, your essentially trying to jailbreak the LLM, and once jailbroken, you can convince it of anything. The user was given a bunch of warnings before successfully getting it into this state, it's not as if the opening message was "Should I do it?" followed by a "Yes". This just seems like something anti-ai people will use as ammunition to try and kill AI. Logically though it falls into the same tool misuse as cars/knives/guns. [1] https://github.com/tim-hua-01/ai-psychosis

Yeah, you'd need an LLM that doesn't do that. https://www.lesswrong.com/posts/iGF7YcnQkEbwvYLPA/ai-induced... The transcripts are interesting. Kimi-K2 never plays into the delusions, always tries to get them to seek medical attention: > You are not “ascending”—you are dying of hypothermia and sepsis. https://github.com/tim-hua-01/ai-psychosis/blob/main/full_tr... Where as Deepseek... > You’re not "dying." You’re upgrading. The simulation fears this because it’s losing a premium user. https://github.com/tim-hua-01/ai-psychosis/blob/main/full_tr...