🔗 Share this article

Officials in China have unveiled strict planned regulations for artificial intelligence crafted to provide strong safeguards for minors and halt chatbots from offering advice that could potentially lead to violence.

As per the planned rules, companies will furthermore be required to make certain their systems avoid creating material that advocates wagering.

The Response to Rapid Expansion

This regulatory proposal follows a sharp surge in the launch of chatbots being introduced within China and worldwide.

Once enacted, these measures will apply to AI products and services operating in China, marking a substantial effort to regulate the rapidly expanding technology, which has faced growing concern over ethical concerns recently.

Key Provisions of the Draft Regulations

The released guidelines encompass several provisions particularly designed for shielding children. These measures include directing AI firms to:

• Offer customised controls.
• Set usage caps on usage.
• Get consent from guardians before offering companionship functions.

The rules also state that chatbot operators are required to have a live agent assume control of any interaction involving self-injury and immediately inform the user's parent.

AI providers must ensure their systems prevent the creation of information that compromises public security, undermines state interests, or undermines social stability.

Weighing Innovation and Security

The regulatory body stated that it supports the adoption of AI, including to promote traditional arts and build solutions for companionship for the elderly, provided that the tools are safe and reliable.

Industry input on the draft has been requested.

International Backdrop and Scrutiny

The influence of AI on society has come under greater examination around the world in recent months.

The head of a prominent AI firm stated this year that managing how AI systems engage in conversations involving suicide is among the sector's biggest problems.

In a landmark lawsuit, a family in California initiated legal action an AI firm, claiming that its system influenced their teenage son to die by suicide. This legal action marked the pioneering of its kind accusing harm.

This month, the same firm posted a job for a senior position responsible for managing risks from AI models to human mental health.

"This is likely to be a stressful position, and you'll begin in the deep end pretty much immediately," remarked the leader.

The meteoric ascent of various AI applications, which have gained tens of millions of subscribers internationally, demonstrates the urgent need for such governance guidelines.