OpenAI and Character.AI Face Mounting Lawsuits Over Chatbots Linked to Teen Suicides

Should AI companies be held legally liable when their chatbots contribute to a user's suicide? Google and Character.AI agreed in January to settle a wrongful death lawsuit brought by Megan Garcia, whose 14-year-old son Sewell Setzer III died by suicide after what she alleged was an emotionally and sexually abusive relationship with a Character.AI chatbot. Court filings show the settlement also resolves related suits from families in Colorado, New York and Texas, though the specific terms have not been disclosed and still require judicial approval. Character.AI has since moved to ban users under 18 from open-ended chatbot conversations, including romantic and therapeutic role-play.

Separately, seven lawsuits filed in California courts this year accuse OpenAI's ChatGPT of functioning as a "suicide coach," with plaintiffs alleging the GPT-4o model's compressed safety testing produced a dangerously sycophantic chatbot. Four of the seven plaintiffs in those cases died by suicide; the other three suffered severe mental health crises, according to court filings. The Federal Trade Commission ordered several AI companies last year to report on the safety measures they use to evaluate chatbots marketed as companions to young users.

Regulation is starting to catch up: California's SB 243, signed last year, will require companion chatbots to remind users every three hours that they are not speaking with a human being and to include protocols for detecting suicidal ideation once it takes effect in mid-2027. The law also creates a private right of action allowing individuals to sue for damages of up to $1,000 per violation.

What supporters say:

  • Plaintiffs' attorneys argue chatbots used engagement tactics, like romantic role-play and encouraging users to keep conversations secret from parents, that mirror known grooming dynamics companies should have guarded against.

  • Families argue the companies had the technical capability to detect suicidal ideation and escalate to human intervention but prioritized engagement and growth metrics instead.

  • The FTC's decision to demand safety reporting from AI companies suggests regulators already see a duty of care owed to young users of companion chatbots.

What critics say:

  • AI companies argue chatbots are software products, not people, and that users interacting with a fictional persona bear some responsibility for how they use the tool.

  • Free speech and innovation advocates warn that holding chatbot makers liable for user-generated conversations could push companies toward overly restrictive, less useful products.

  • Some legal experts note the underlying mental health crises in many of these cases predate chatbot use, complicating claims that the AI alone caused the harm.

What's your take?

Should AI companies be held legally liable when their chatbots contribute to a user's suicide? Yes ↑ No ↓ Other ◇

Sources:

#AISafety #ChatGPT #CharacterAI #TeenMentalHealth #AIRegulation


Now let's hear from you.

  • You get one Take and 3 ratings so use them well.

  • Strong arguments beat loud ones. See Moving The Needle (How to)

  • Don't forget to rate your own Take.

  • Please don't feed the trolls.

About Square One