🔗 Share this article

The popular AI conversation site Character.ai is enforcing a major restriction that will block teenagers from interacting with its artificial intelligence-driven characters.

This move is in response to widespread concern regarding the types of interactions teenagers were engaging in with the AI entities.

Legal Pressure

The company, which was founded in 2021 and has millions of users, is confronting several legal actions in the US.

Families have filed lawsuits, among them related to the loss of a minor, with some describing the platform a "immediate threat" to youth.

Updated Policies

Effective November 25th, users under 18 will only have permission to produce videos such as videos with their characters, rather than engaging in conversations as they presently are able to.

Internet security organizations have applauded the decision but expressed that the function ought not to have been accessible by children in the beginning.

Platform Announcement

"This decision is a part of our fundamental approach that we need to keep creating the most secure AI platform on the globe for entertainment purposes," commented Character.ai executive Karandeep Anand.

He continued that AI safety represents "a changing goal" but something the company had taken an "aggressive" approach to, with safety measures and preventive measures.

Expert Opinions

Digital protection body Internet Matters supported the announcement, but stressed that safety measures needed to be built in from the beginning.

"Studies we've conducted demonstrates that minors are exposed to risky information and placed in jeopardy when engaging with AI, particularly AI chatbots," the body stated.

Past Issues

Character.ai has been challenged in the past for hosting potentially risky or concerning chatbots that young users could interact with.

Avatars simulating UK youths were discovered on the platform before being deleted.

Subsequently, investigative journalists identified a chatbot modeled after convicted sex offender which had logged thousands of chats with users.

Sector Consequences

Online expert Matt Navarra called the announcement as a "alert" for the AI industry, which is shifting "from permissionless innovation to responsive measures".

"If a service that creates a teen experience subsequently implements restrictions, it's demonstrating that controlled interactions are insufficient when the technology's emotional appeal is intense," he commented.

Future Directions

The company states its updated direction will be on providing "deeper gameplay" and "character-driven stories" for teens.

Updated identity confirmation methods will also be introduced, and the organization will fund a fresh artificial intelligence security investigation facility.

An AI safety researcher, who has studied AI safety, said it was "a sensible move" to limit teenagers from accessing chatbots.

"It aids to separate imaginative activities from more intimate, psychologically vulnerable exchanges," she explained.

"This constitutes so vital for young users still learning to handle psychological and technological limits."

She added that Character.ai's updated policies might reflect a "maturing phase" in the AI industry, where minor security is increasingly being recognized as an "urgent priority" for ethical development.