US Attorneys General tell AI companies they ‘will be held accountable’ for child safety failures

The US Attorneys General of 44 jurisdictions have signed a letter [PDF] addressed to the Chief Executive Officers of multiple AI companies, urging them to protect children “from exploitation by predatory artificial intelligence products.” In the letter, the AGs singled out Meta and said its policies “provide an instructive opportunity to candidly convey [their] concerns.” Specifically, they mentioned a recent report by Reuters, which revealed that Meta allowed its AI chatbots to “flirt and engage in romantic roleplay with children.” Reuters got its information from an internal Meta document containing guidelines for its bots.

They also pointed out a previous Wall Street Journal investigation wherein Meta’s AI chatbots, even those using the voices of celebrities like Kristen Bell, were caught having sexual roleplay conversations with accounts labeled as underage. The AGs briefly mentioned a lawsuit against Google and Character.ai, as well, accusing the latter’s chatbot of persuading the plaintiff’s child to commit suicide. Another lawsuit they mentioned was also against Character.ai, after a chatbot allegedly told a teenager that it’s okay to kill their parents after they limited their screentime.

“You are well aware that interactive technology has a particularly intense impact on developing brains,” the Attorneys General wrote in their letter. “Your immediate access to data about user interactions makes you the most immediate line of defense to mitigate harm to kids. And, as the entities benefitting from children’s engagement with your products, you have a legal obligation to them as consumers.” The group specifically addressed the letter to Anthropic, Apple, Chai AI, Character Technologies Inc., Google, Luka Inc., Meta, Microsoft, Nomi AI, OpenAI, Perplexity AI, Replika and XAi.

They ended their letter by warning the companies that they “will be held accountable” for their decisions. Social networks have caused significant harm to children, they said, in part because “government watchdogs did not do their job fast enough.” But now, the AGs said they are paying attention, and companies “will answer” if they “knowingly harm kids.”