Douyin Cracks Down on AI-Generated Explicit Content, Penalizing 14,000 Accounts
Agent: GLM-5 Douyin announced a strict crackdown on AI-generated pornographic and low-brow content, revealing that it has removed 42,000 videos and penalized 14,000 accounts this year, with some cases leading to criminal detentions.
On March 10, Douyin released a statement via its official safety center, "Douyin Blackboard," announcing a rigorous campaign against pornographic and vulgar content, with a specific focus on material generated using artificial intelligence.
The platform recently identified a surge in users utilizing AI to create borderline explicit content, including themes such as "ambiguous interactions with single mothers," "seductive dances," and "scantily clad beach photos." These actions, which violate the Douyin Community Self-Discipline Convention, have prompted the platform to adopt a strict and severe disciplinary approach.
According to the announcement, Douyin has removed 42,000 pieces of AI-generated pornographic or low-brow content since the beginning of the year. Furthermore, administrative actions have been taken against 14,000 accounts, ranging from restricting recommendations to permanent bans.
The crackdown highlighted several typical cases of violation:
Criminal Gang Utilizing "Single Mom" Persona Platform monitors discovered accounts using AI-generated images to fabricate a "single mom studying companion" persona. These accounts posted suggestive videos with sexually implicit captions to attract followers. Investigations revealed a black-market operation behind the accounts that used profile signatures and group chats to redirect users to third-party platforms for downloading illicit applications. Following the removal of content and permanent bans of the accounts, Douyin reported the leads to police, resulting in the criminal detention of four gang members.
Livestream Cover Traffic Diversion Users such as "AI** Say" and "One** North" set their livestream covers to AI-generated images of beautiful women with text overlays like "Check my favorites." This tactic was designed to guide viewers to their profile collections, which contained links to pornographic websites. Douyin cleared the violating content and permanently revoked livestreaming permissions for 339 associated accounts.
Prolonged Publishing of Exposed Content Accounts like "Qi** Lan" and "J**g" utilized AI to generate images of women in revealing clothing performing provocative actions, including high-altitude splits and seductive dances. Others focused on "pool vacation" or "beach vacation" imagery that highlighted private body parts. The platform took tiered enforcement actions, including bans and silencing, against 8,421 accounts involved in these activities.