welcome
Vox

Vox

Technology

Technology

Exclusive: California’s new plan to stop AI from claiming to be your therapist

Vox
Summary
Nutrition label

75% Informative

Bill introduced in California would ban companies from developing AI systems that pretends to be a human certified as a health provider.

Many people already turn to AI chatbots for mental health support; one of the older offerings, Woebot , has been downloaded by around 1.5 million users.

The bill may have an easier time becoming enshrined in law than the broader AI safety bill introduced by California state Sen. Scott Wiener last year .

The bill has support from some of California ’s health care industry players.

It shouldn’t come as a surprise that people are turning to chatbots for therapy.

Chatbots have come a long way since they’re able to engage in plausible-sounding dialogues.

The most serious concern with chatbot therapy is that it could harm to users by offering inappropriate advice.

VR Score

73

Informative language

68

Neutral language

51

Article tone

informal

Language

English

Language complexity

50

Offensive language

possibly offensive

Hate speech

not hateful

Attention-grabbing headline

not detected

Known propaganda techniques

not detected

Time-value

short-lived

External references

20

https://www.nytimes.com/2024/10/23/technology/characterai-lawsuit-teen-suicide.htmlhttps://arstechnica.com/information-technology/2023/01/contoversy-erupts-over-non-consensual-ai-mental-health-experiment/https://www.vox.com/future-perfect/361562/california-ai-bill-scott-wiener-sb-1047https://openai.com/index/gpt-4o-system-card/https://www.vox.com/future-perfect/23617185/ai-chatbots-eliza-chatgpt-bing-sydney-artificial-intelligence-historyhttps://www.vox.com/technology/2023/12/14/24000435/chatbot-therapy-risks-and-potentialhttps://www.cnn.com/2024/12/10/tech/character-ai-second-youth-safety-lawsuit/index.htmlhttps://www.vox.com/future-perfect/22916602/ai-bias-fairness-tradeoffs-artificial-intelligencehttps://theaipi.org/voters-support-sb1047-in-collaborative-poll/https://www.vox.com/future-perfect/22672414/ai-artificial-intelligence-gpt-3-bias-muslimhttps://blog.character.ai/community-safety-updates/https://www.theguardian.com/technology/2024/oct/23/character-ai-chatbot-sewell-setzer-deathhttps://www.vox.com/the-highlight/23402638/mental-health-psychiatrist-shortage-community-care-africahttps://woebothealth.com/a-pioneering-collaboration/#:~:text=Over%20the%20last%20six%20years,%2D%20to%20medium%2Dsized%20businesses.https://www.newamerica.org/the-thread/ai-mental-health-apps-data-privacy/https://www.vox.com/future-perfect/367188/love-addicted-ai-voice-human-gpt4-emotionhttps://www.nature.com/articles/s41398-023-02462-xhttps://www.kokocares.org/ethical-commitments/https://www.vice.com/en/article/man-dies-by-suicide-after-talking-with-ai-chatbot-widow-says/https://www.vox.com/future-perfect/369628/ai-safety-bill-sb-1047-gavin-newsom-california

Affiliate links

no affiliate links