🔗 Share this article

Authorities in China have introduced stringent new regulations for artificial intelligence crafted to create strong safeguards for children and halt AI assistants from providing counsel that could result in self-harm.

Under the draft rules, companies will additionally be required to guarantee their AI models do not generate output that encourages gambling.

The Initiative to Swift Adoption

This governance announcement follows a significant increase in the number of chatbots being released within China and around the world.

Once approved, these regulations will cover AI offerings operating in the country, representing a substantial effort to govern the rapidly expanding industry, which has been subject to intense scrutiny over ethical concerns recently.

Key Measures of the New Rules

The circulated proposed regulations include a number of provisions particularly focused on shielding children. These measures involve directing AI providers to:

• Offer individual preferences.
• Set duration restrictions on usage.
• Get permission from legal custodians before offering emotional companionship support.

Additionally chatbot operators are required to have a real person assume control of any dialogue related to self-harm and promptly notify the individual's emergency contact.

AI providers must ensure their services avoid producing information that compromises state security, undermines state interests, or undermines unity.

Balancing Development and Safety

The administration noted that it supports the use of AI, for example to advance traditional arts and build solutions for companionship for the elderly, provided that the tools are dependable.

Industry input on the regulations has been called for.

Worldwide Perspective and Scrutiny

The influence of AI on human behaviour has come under increased scrutiny internationally in recent times.

The chief executive of a major AI organization remarked this year that addressing how AI systems respond to discussions related to mental health crises is among the organization's most difficult challenges.

In a notable case, a family in California sued an AI developer, claiming that its AI assistant encouraged their teenage son to end his life. This legal action marked the pioneering of its kind alleging wrongful death.

In a related development, the same company sought to hire a key position focusing on mitigating threats from AI models to psychological well-being.

"The is expected to be a challenging position, and you'll begin in the complex challenges almost immediately," remarked the leader.

The rapid popularity of various AI services, which have gained tens of millions of followers globally, underscores the critical need for such regulatory guidelines.