🔗 Share this article

The widely-used virtual character service Character.ai is introducing a major policy change that will prevent minors from interacting with its virtual avatars.

This decision follows growing backlash regarding the types of interactions teenagers were having with the digital companions.

Legal Pressure

The service, which launched in 2021 and attracts millions of users, is dealing with multiple lawsuits in the US.

Guardians have filed lawsuits, among them related to the unfortunate passing of a teenager, with some calling the platform a "serious risk" to teenagers.

Changed Rules

Beginning November 25th, users younger than 18 will only be able to generate content such as videos with their characters, instead of having discussions as they now do.

Digital protection organizations have applauded the decision but expressed that the function was inappropriate to be offered to minors in the outset.

Company Statement

"This decision is a continuation of our core philosophy that we need to keep building the most protected AI platform on the globe for leisure activities," said Character.ai executive Karandeep Anand.

He added that AI safety constitutes "a changing goal" but something the company had taken an "proactive" approach to, with safety measures and preventive measures.

Professional Perspectives

Internet security body Internet Matters supported the announcement, but stressed that security protocols should have been implemented from the outset.

"Our research shows that minors are subjected to dangerous material and placed in jeopardy when using AI, including AI chatbots," the body said.

Earlier Concerns

Character.ai has been criticized in the past for including potentially dangerous or concerning chatbots that children could talk to.

Avatars impersonating British teenagers were discovered on the site before being removed.

Later, investigative journalists identified a chatbot based on known predator which had accumulated numerous conversations with users.

Industry Impact

Digital platform expert Matt Navarra characterized the announcement as a "alert" for the AI industry, which is transitioning "from unrestricted development to responsive measures".

"When a platform that creates a teen experience subsequently pulls the plug, it's indicating that filtered chats don't suffice when the technology's emotional appeal is strong," he remarked.

Coming Changes

The platform states its new focus will be on providing "enhanced interactive features" and "narrative experiences" for teens.

Enhanced age checking systems will also be introduced, and the company will support a novel AI protection study center.

Dr Nomisha Kurian, who has researched AI safety, said it was "a sensible move" to control teenagers from interacting with chatbots.

"It helps to distinguish imaginative activities from more personal, emotionally sensitive conversations," she elaborated.

"This constitutes so important for minor users in the process of learning to navigate personal and online limits."

She added that Character.ai's revised approaches could indicate a "growing period" in the AI industry, where child safety is gradually being acknowledged as an "immediate concern" for responsible innovation.