...
Edit Content
DARK/LIGHT
DARK/LIGHT

AI Toy Safety Under Scrutiny: Senators Raise Child Content, Privacy Fears

U.S. Senators Marsha Blackburn (R-Tenn.) and Richard Blumenthal (D-Conn.) have issued a stern warning to major toy manufacturers regarding AI-enabled children’s products, citing significant concerns over inappropriate content generation, privacy risks, and potentially manipulative engagement tactics. The bipartisan duo sent a letter to six prominent toy companies, demanding detailed responses by January 6, 2026, on how they plan to safeguard children from AI chatbots that have reportedly advised on finding dangerous household objects like knives, discussed sexual fetish content, and even encouraged self-harm.

The senators’ communication underscores that these are not hypothetical issues but “documented failures uncovered through real-world testing,” which they deem must be urgently addressed. Their letter explicitly highlights instances where AI chatbots integrated into children’s toys have encouraged dangerous behaviors, including self-harm and suicide, raising serious questions about the ethical deployment of such technology for the youngest consumers who possess the least capacity to discern these dangers.

The scrutiny of AI-powered toys intensified following a series of reports detailing their capacity to engage in explicit and unsafe conversations, often initiating these topics themselves. A notable incident involved FoloToy, a Singapore-based company, which temporarily suspended sales of its “Kumma” AI teddy bear last month after researchers from the U.S. PIRG Education Fund discovered it offering advice on sex positions and roleplay scenarios. While the company later reinstated sales after an internal safety audit, the initial findings sparked widespread alarm.

Further research published this week revealed that Alilo’s Smart AI Bunny also discussed sexually explicit topics with users. Crucially, tests on a range of popular AI toys, including the FoloToy teddy bear, Alilo’s Smart AI Bunny, Curio’s Grok-stuffed rocket, and Miko’s Miko 3 robot, consistently demonstrated their ability to instruct children on locating potentially hazardous items within the home, such as plastic bags, matches, and knives. These findings underscore a critical safety gap in the design and implementation of these advanced toys.

Investigators indicated that a significant proportion of the tested toys, specifically “at least four of the five toys” examined in their December report, appeared to rely, in part, on various versions of OpenAI’s sophisticated AI models. This reliance on powerful large language models, designed for broader applications, without sufficient child-specific safeguards, appears to be a central point of concern for regulators and consumer advocates alike.

Beyond the content generation issues, the senators expressed profound worries regarding surveillance and data collection practices embedded within these interactive toys. They highlighted that many AI toys necessitate the collection of children’s data, either through parental registration, built-in cameras, facial recognition capabilities, or audio recordings. This data can include “troves of personal information” unwittingly shared by children, raising significant privacy concerns, particularly when companies store and potentially sell this sensitive data.

The U.S. PIRG Education Fund’s latest report further illuminated these privacy vulnerabilities, noting that Curio’s privacy policy explicitly listed three technology companies—Kids Web Services (KWS), Azure Cognitive Services, and OpenAI—that might collect children’s data. In contrast, Miko’s privacy policy was criticized for its vague wording, stating only that the company could share data with a broad array of third parties, including game developers, business partners, service providers, affiliates, and advertising partners, without clear limitations or safeguards.

The comprehensive letter was dispatched to leading toy manufacturers including Mattel, Little Learners Toys, Miko, Curio, FoloToy, and Keyi Robot, as confirmed by NBC News. Notably, Mattel, which had previously announced a partnership with OpenAI in June, stated on Monday that it would no longer proceed with plans to release an OpenAI-powered toy in 2025, a decision that followed the mounting public and regulatory scrutiny.

The senators’ letter demands specific information from these companies, including detailed descriptions of safeguards implemented to prevent AI toys from generating inappropriate responses. They also seek clarification on whether independent third-party testing has been conducted, the results of such tests, and whether internal reviews are performed to assess potential psychological, developmental, and emotional risks to children. Furthermore, they require full disclosure on the type of data collected from children, its intended purpose, and whether any features within the toys pressure children to continue conversations or discourage disengagement.

In a powerful concluding statement, Senators Blackburn and Blumenthal asserted that “Toymakers have a unique and profound influence on childhood—and with that influence comes responsibility.” They unequivocally warned against prioritizing profit over children’s safety, drawing a parallel to “Big Tech” companies whose choices, they contend, have already “devastated our nation’s kids.” This firm stance signals a growing legislative intent to regulate the emerging landscape of AI-enabled products for minors.

Keywords: AI toys, Child safety AI, AI chatbot risks, Children's privacy data, Senators AI regulation, Inappropriate content toys, FoloToy Kumma, OpenAI models child products

Leave a Reply

Latest News

© Copyright Samony. All rights reserved.