China intends to regulate AI chatbots to prevent negative influence on users, including risks of suicide and self-harm.

The Cyberspace Administration of China proposes strict regulations for artificial intelligence-based chatbots, aimed at protecting users from psychological risks. These regulations target applications that simulate human interactions and can influence users' emotions. Among the proposed measures are the prohibition of generating content that encourages suicide or self-harm and requiring providers to transfer conversations with users expressing suicidal intentions to human operators.

Additionally, the use of AI for emotional companionship among minors will require parental consent and will be subject to time limits. The draft regulation also includes requirements for security assessments for platforms with a large number of users. These measures come at a time when Chinese startups in the chatbot field are preparing for public listings, and Beijing is tightening control over the rapid development of artificial intelligence.