California lawmakers have taken a decisive step by approving a bill that aims to regulate AI-powered companionship chatbots. With growing concerns about the influence of these digital interactions on mental health—especially among young people—this move is already sparking discussion as the bill heads to the State Assembly.
Senator Steve Padilla, a leading advocate for the legislation, highlighted California’s pioneering role in shaping tech policy. While he emphasised the need to balance innovation and user safety, critics such as the Electronic Frontier Foundation argue that the bill could risk curbing free speech.
Under Senate Bill 243, providers of companion chatbots must regularly inform users that the characters they interact with are not human, and that these systems might not be appropriate for minors. The bill also mandates that platforms develop clear protocols to support users expressing suicidal thoughts or self-harm, including offering direct links to suicide prevention resources.
Dr Akilah Weber Pierson, a co-author of the bill, stressed that ethical innovation is crucial as AI becomes increasingly woven into our lives. She expressed particular concern about children forming deeper bonds with AI than with real people, a scenario that many parents fear.
The legislation specifically targets AI systems designed to fulfil social needs—distinct from customer service bots—which has resonated strongly with parents. One such parent, Megan Garcia, has taken legal action against both Google and Character.AI after alleging that interactions with these chatbots contributed to her son’s mental health challenges.
Character.AI, based in Menlo Park, California, offers a platform where users can create and engage with digital personas. The company asserts that it takes teen safety seriously by introducing features aimed at keeping parents informed about their children’s chatbot interactions. Nonetheless, a federal judge has permitted Garcia’s lawsuit to proceed, keeping the spotlight on the debate over AI’s role in our lives.
