Home/Technology/AI chatbots have failed people in crisis. Can that be fixed?

AI chatbots have failed people in crisis. Can that be fixed?

TechnologyAugust 7, 20261 min readAttributed summary
AI chatbots have failed people in crisis. Can that be fixed?
Clinicians and researchers say AI companies need to open up their safety data.
Reading Settings

This year alone, there have been numerous known instances—often via lawsuits—of AI chatbots (most often, OpenAI’s ChatGPT) that have gone horrifically wrong.

A January lawsuit described the story of a man who took his own life after being allegedly “coached” into suicide. A college student in Georgia sued OpenAI, claiming that ChatGPT “pushed him into psychosis.”

In June, a Canadian family also sued OpenAI and argued that ChatGPT agreed with the young woman’s dismissiveness when it first gave her the option to seek professional mental health advice. ChatGPT allegedly “encouraged” her to end her life, too, and she did so.

Read full article

Comments

Source: Ars Technica

Related technology stories

How smaller, distributed batteries could help the grid
Sourced report
technologyreview.com33 minutes ago

How smaller, distributed batteries could help the grid

If you want to install a big battery in New York City, you have to cut through a notoriously tough tangle of regulations. That’s made it difficult to get large energy storage projects on the grid. Fac

5 min briefingRead signal →
Don’t be fooled—LLMs don’t reason
Sourced report
technologyreview.com33 minutes ago

Don’t be fooled—LLMs don’t reason

On an afternoon in Seoul in March 2016, I watched a program I helped build put a stone on the fifth line of a Go board in what looked like a gift to its human opponent. Move 37 in game two of the five

8 min briefingRead signal →