UK Children’s Commissioner calls for ban on AI deepfake apps targeting children

The Children’s Commissioner for England, Dame Rachel de Souza, has called for an immediate UK government ban on AI-powered 'nudification' and deepfake apps that create sexually explicit images of children. She warns that these generative AI tools—now widely available and often free—are fueling fears among children, especially girls, who are altering their online behavior to avoid victimization. Although creating or sharing sexually explicit images of children is illegal, the apps enabling such abuse are not, prompting calls for new regulation targeting the technology itself. De Souza's report urges stronger legal duties on AI developers, the introduction of an AI bill to address these risks, and improved mechanisms for removing explicit deepfake content. She emphasizes that these apps have no societal benefit and contribute to real-world harm, arguing for their removal from mainstream platforms and better enforcement of age restrictions. The Commissioner also calls for policy to recognize deepfake sexual abuse as a form of violence against women and girls.