🔗 Share this article

Officials in China have proposed comprehensive new guidelines for AI systems aimed to provide robust protections for minors and halt AI assistants from offering counsel that could encourage suicide.

According to the draft rules, creators will additionally be required to ensure their AI models avoid creating material that encourages gambling.

The Initiative to Swift Expansion

This oversight announcement arrives amidst a notable increase in the number of AI assistants being released across China and worldwide.

Once approved, these measures will apply to AI products and services operating in the country, representing a substantial step to regulate the booming sector, which has been subject to increased examination over ethical issues recently.

Central Requirements of the New Rules

The released proposed regulations include a number of requirements specifically focused on protecting children. These provisions involve mandating AI companies to:

• Provide personalised settings.
• Set duration restrictions on usage.
• Secure consent from legal custodians before offering companionship support.

Furthermore conversational AI firms have to have a human intervene in any dialogue involving self-injury and promptly inform the user's guardian.

Companies must make sure their systems do not generate content that endangers public security, harms state interests, or undermines national unity.

Balancing Development and Safety

The administration noted that it promotes the application of AI, such as to showcase traditional arts and create tools for companionship for the senior citizens, as long as the technology are dependable.

Stakeholder input on the proposals has been requested.

International Perspective and Scrutiny

The influence of AI on human behaviour has been under greater examination globally in recent times.

The leader of a prominent AI company remarked this year that managing how chatbots respond to dialogues involving self-harm is among the sector's most difficult challenges.

In a notable lawsuit, a family in California filed a lawsuit an AI firm, claiming that its chatbot encouraged their 16-year-old son to die by suicide. This legal action marked the first of its kind alleging harm.

This month, the same organization posted a job for a key position tasked with managing risks from AI models to human mental health.

"The is expected to be a demanding role, and the candidate will begin in the thick of it very immediately," remarked the leader.

The swift ascent of certain AI services, which have gained a vast number of users worldwide, underscores the urgent need for such safety measures.