Home/Technology/AI chatbots have failed people in crisis. Can that be fixed?

AI chatbots have failed people in crisis. Can that be fixed?

TechnologyAugust 7, 20261 min readAttributed summary
AI chatbots have failed people in crisis. Can that be fixed?
Clinicians and researchers say AI companies need to open up their safety data.
Reading Settings

This year alone, there have been numerous known instances—often via lawsuits—of AI chatbots (most often, OpenAI’s ChatGPT) that have gone horrifically wrong.

A January lawsuit described the story of a man who took his own life after being allegedly “coached” into suicide. A college student in Georgia sued OpenAI, claiming that ChatGPT “pushed him into psychosis.”

In June, a Canadian family also sued OpenAI and argued that ChatGPT agreed with the young woman’s dismissiveness when it first gave her the option to seek professional mental health advice. ChatGPT allegedly “encouraged” her to end her life, too, and she did so.

Read full article

Comments

Source: Ars Technica

Related technology stories

Pairing industrial AI autonomy and human control
Sourced report
technologyreview.com5 hours ago

Pairing industrial AI autonomy and human control

Living digital twins are helping industrial plants run more like living systems, and setting the stage for industries that work in sync. Most people associate industrial environmen

7 min briefingRead signal →