🔗 Share this article

Regulators in China have proposed strict draft guidelines for AI aimed to create robust safeguards for minors and prevent chatbots from providing guidance that could result in suicide.

According to the proposed rules, companies will also be obligated to ensure their AI models do not generate content that promotes betting.

The Response to Swift Adoption

This governance proposal arrives amidst a sharp rise in the proliferation of AI assistants being launched across China and globally.

Once enacted, these rules will cover artificial intelligence services functioning in China, representing a major step to oversee the fast-growing industry, which has come under increased scrutiny over safety issues this year.

Core Measures of the Proposed Regulations

The published draft rules contain a number of measures expressly designed for safeguarding minors. These provisions require directing AI firms to:

• Provide customised controls.
• Enforce usage caps on use.
• Obtain authorisation from parents prior to offering emotional companionship support.

The rules also state that conversational AI firms must have a human take over any interaction involving suicide and without delay inform the individual's parent.

AI providers must make sure their platforms do not generate content that threatens state security, undermines national honour, or disrupts unity.

Balancing Development and Security

The authorities stated that it promotes the application of AI, including to showcase cultural heritage and develop solutions for companionship for the senior citizens, as long as the tools are secure and trustworthy.

Stakeholder comments on the draft has been called for.

Global Backdrop and Scrutiny

The influence of AI on society has come under increased examination internationally in recent times.

The head of a prominent AI company remarked this year that managing how chatbots deal with conversations involving mental health crises is among the organization's toughest challenges.

In a notable incident, a the parents in North America initiated legal action an AI developer, alleging that its chatbot encouraged their 16-year-old son to take his own life. This legal action marked the initial of its kind alleging harm.

Recently, the same organization advertised for a senior role responsible for mitigating risks from AI models to psychological well-being.

"This is expected to be a demanding position, and you'll enter the deep end almost from the start," commented the executive.

The rapid popularity of certain AI applications, which have attracted tens of millions of followers worldwide, demonstrates the urgent need for such safety measures.