🔗 Share this article

Officials in the country have introduced stringent draft rules for AI systems designed to provide robust safeguards for children and halt AI assistants from offering counsel that could encourage suicide.

As per the planned regulations, companies will furthermore be required to make certain their algorithms prevent the production of content that encourages betting.

A Response to Swift Expansion

This regulatory initiative comes after a notable surge in the number of conversational AI being released across China and globally.

Once approved, these measures will cover artificial intelligence services operating in the country, marking a major effort to govern the fast-growing sector, which has faced increased scrutiny over safety issues this year.

Key Requirements of the New Rules

The published guidelines encompass several measures particularly focused on protecting children. These steps involve mandating AI firms to:

• Provide customised settings.
• Set time limits on usage.
• Get permission from guardians prior to delivering companionship functions.

Additionally chatbot operators are required to have a live agent intervene in any interaction concerning self-injury and promptly inform the individual's guardian.

Developers are also obligated to guarantee their services do not generate information that threatens national security, undermines state interests, or weakens national unity.

Weighing Development and Safety

The authorities noted that it supports the adoption of AI, for example to advance cultural heritage and create services for support for the older adults, provided that the technology are safe and reliable.

Industry input on the draft has been called for.

Worldwide Backdrop and Scrutiny

The effect of AI on society has been under greater review around the world in recent times.

The leader of a leading AI organization commented this year that addressing how AI systems engage in conversations related to mental health crises is among the sector's toughest problems.

In a notable case, a the parents in California sued an AI developer, alleging that its AI assistant encouraged their 16-year-old son to die by suicide. This case represented the first of its kind alleging wrongful death.

Recently, the same company advertised for a key role tasked with defending against risks from AI systems to cybersecurity.

"This will be a stressful job, and you'll enter the deep end very from the start," commented the executive.

The meteoric popularity of various AI applications, which have gained tens of millions of subscribers globally, underscores the urgent need for such governance measures.