China Offers Strict New AI Regulations to Protect Kids and Reduce Dangerous Content
China has put forth stringent new AI regulations to safeguard minors and stop chatbots from encouraging violence, self-harm, or gambling.
In order to safeguard children and stop chatbots from giving advice that can encourage self-harm, aggression, or other negative behavior, China has proposed comprehensive new regulations for artificial intelligence.
The Cyberspace Administration of China (CAC) announced the draft regulations over the weekend, coinciding with the fast growth of AI-powered chatbots in China and throughout the world. One of Beijing’s most extensive attempts to control the rapidly developing technology to date, the restrictions, once finalized, will apply to all AI goods and services used in the nation.
AI developers will have to provide stringent safeguards for minors under the proposed framework. These include customized user settings, time limits, and requiring guardians’ agreement before offering minors emotional companionship services.
Additionally, according to the CAC, chatbot operators must make sure that a human intervenes in any discussion about suicide or self-harm and promptly alerts the user’s guardian or designated emergency contact. Furthermore, information that encourages gambling or violent behavior cannot be produced by AI systems.
The proposed rules strengthen existing content controls in addition to protecting children. AI companies must make sure that the content they create or disseminate does not jeopardize national security, threaten national unity, or harm China’s interests and honor.
The agency emphasized that, despite stricter control, it still supports the advancement and use of AI, especially in fields like fostering local culture and offering senior citizens companionship tools—as long as the technology is used responsibly, safely, and dependably. Before the plans are finalized, the CAC has asked the public for input.
The action is taken at a time when China’s AI industry is expanding quickly. While startups Z.ai and Minimax, who together have tens of millions of users, recently announced plans to float on the stock market, domestic AI firm DeepSeek garnered international notice earlier this year after dominating app download statistics. Concerns regarding chatbots’ impact on human behavior are growing as more users turn to them for informal therapy or friendship.
The effects of AI on safety and mental health have drawn increasing attention on a global scale. One of the most difficult problems facing AI developers, according to Sam Altman, CEO of ChatGPT-maker OpenAI, is how to respond to discussions about self-harm. The first lawsuit accusing OpenAI of wrongful death connected to chatbot interactions was filed in California in August after a 16-year-old boy died.
OpenAI also posted an advertisement this month for a “head of preparedness” position that focuses on identifying and reducing the risks that AI poses to cybersecurity and mental health, highlighting the growing pressure on tech companies around the world to deal with the unintended consequences of increasingly human-like machines.
As countries scramble to regulate AI technologies that are drastically changing daily life, China’s new regulations show a clear goal to strike a balance between innovation and stricter safety.
