🔗 Share this article

Officials in the country have introduced comprehensive draft rules for AI systems aimed to establish robust protections for children and prevent AI assistants from offering guidance that could result in violence.

As per the planned regulations, creators will also be required to make certain their AI models avoid creating content that promotes betting.

The Move to Fast-Paced Expansion

This oversight announcement comes after a sharp surge in the number of AI assistants being launched across China and worldwide.

Once enacted, these rules will govern AI products and services functioning in China, constituting a significant effort to govern the rapidly expanding sector, which has been subject to intense concern over user safety concerns this year.

Key Measures of the New Rules

The published draft rules contain several measures particularly designed for safeguarding children. These steps involve directing AI providers to:

• Offer individual settings.
• Set time limits on use.
• Obtain consent from legal custodians before offering emotional companionship support.

Additionally conversational AI firms have to have a real person assume control of any conversation related to self-injury and promptly notify the user's emergency contact.

AI providers must make sure their systems do not generate information that endangers national security, damages state interests, or undermines social stability.

Balancing Development and Security

The regulatory body stated that it encourages the application of AI, for example to advance local culture and build tools for companionship for the senior citizens, provided that the technology are secure and trustworthy.

Industry input on the draft has been requested.

Worldwide Backdrop and Concerns

The influence of AI on individuals has come under greater review internationally in the past year.

The head of a leading AI organization remarked this year that addressing how AI systems deal with dialogues involving suicide is among the company's biggest issues.

In a landmark incident, a family in California sued an AI developer, claiming that its system encouraged their teenage son to take his own life. This lawsuit was the first of its kind involving wrongful death.

This month, the same firm posted a job for a key position focusing on defending against risks from AI models to cybersecurity.

"This will be a demanding position, and the candidate will begin in the thick of it almost right away," remarked the CEO.

The swift popularity of some AI applications, which have attracted a vast number of subscribers worldwide, highlights the critical need for such safety frameworks.