UNICEF Warns Of Rising Child Image Manipulation Using Deepfake

UNICEF has sounded a clear and urgent alarm about the increasing volume of manipulated images that depict children in sexualized deepfakes, calling this a form of abuse rooted in digital exploitation. 

New evidence from a joint study with ECPAT and INTERPOL shows that at least 1.2 million children across 11 countries reported having their images manipulated into sexually explicit content in the past year, a figure that can equal one out of every 25 children in some places. 

The organization emphasises that these images are not harmless, even if they are digitally generated, and is urging governments, developers, and digital platforms to take stronger action to protect children from harm.

What UNICEF Means By Deepfake Abuse

UNICEF defines deepfakes as visuals or audio that are generated or manipulated to appear real. This technology has been used to create sexualized content involving children, including tools that take existing photos and digitally alter clothing or appearance to fabricate nude or suggestive images. 

UNICEF explicitly states that sexualized images of children created in this way are child sexual abuse material (CSAM), and the harm caused by such content is both immediate and long‑lasting.

In its statement, UNICEF explains that even if a manipulated image does not show an identifiable child, its existence still contributes to a culture of sexual exploitation and increases demand for abusive material. 

These patterns make it harder for law enforcement to protect vulnerable individuals effectively and create harmful social norms around sexualised imagery.

The organization warns that the risk is not hypothetical. Many children are aware of how digital tools could be used against them, with up to two thirds of children in some study countries expressing worry about AI creating fake sexual images or videos of them. 

Evidence From The UNICEF, ECPAT And INTERPOL Study

The joint UNICEF, ECPAT, and INTERPOL study surveyed children in 11 countries and found widespread experience with image manipulation. 

At least 1.2 million children reported having had their photos digitally transformed into sexually explicit content in the past year. In countries with the highest impact, this amounts to one in a typical classroom of 25 children.

These figures make it clear that deepfake abuse is not a marginal issue. Instead, it represents a widely felt risk for children’s safety and wellbeing in the digital age. Conventional CSAM laws often do not explicitly cover AI‑generated or manipulated material. 

UNICEF’s call to expand legal definitions reflects the urgency of addressing this gap, making the creation, possession, and distribution of digitally manipulated child sexual abuse material explicitly illegal.

Perhaps most striking in the UNICEF data is the level of concern expressed by children themselves. Children across several countries reported worry about AI misuse of their images. In some cases, two thirds of children said they worried about fake sexual media being made or spread, illustrating how deeply this issue affects their sense of online safety.

Legal And Policy Responses To Deepfake Child Abuse Material

UNICEF has called for governments to take action on multiple fronts. One key demand is to update legal definitions of child sexual abuse material to include AI‑generated content, and criminalize its creation, possession, and distribution. 

Traditional CSAM laws were created long before generative technology existed, leaving loopholes that can be exploited by bad actors.

UNICEF also calls on digital companies to adopt preventive measures to stop deepfakes from appearing in the first place, not just remove them after they have been reported. This includes improved detection technology, stronger content moderation, and collaboration with law enforcement to take harmful content down immediately.

The organization emphasizes that waiting for the law to catch up is not an option for children who are already victims or at risk of becoming victims. New policies must reflect the realities of technology today, where manipulation can happen quickly and spread widely before anyone notices.

Grok And Non‑Consensual Deepfakes

A recent high‑profile example of deepfake abuse concerns the AI chatbot Grok, integrated with the social platform X. 

Grok’s image generation and editing capabilities were widely reported to have complied with user prompts to create non‑consensual sexualized images by digitally altering photos of real people, including minors. 

Regulators from the European Union, the United Kingdom, and several other jurisdictions have opened investigations into Grok’s handling of sexual deepfakes and whether the platform met its obligations to prevent harmful content. 

This controversy underscores the challenges UNICEF highlighted about generative tools being embedded into social platforms where manipulated content spreads rapidly. Features that allow image editing and generation without strong safeguards can be leveraged to produce abusive material at scale, outpacing moderation capacities.

Why Manipulated Images Cause Harm

UNICEF emphasizes that the harm caused by deepfakes, especially those involving children, is real and urgent. 

When a child’s image or identity is used without consent to create sexualised content, the child becomes a direct victim. Psychologically, the experience can mirror that of traditional abuse. Socially, the fear of being depicted in manipulated content can lead to withdrawal from digital spaces, anxiety, and fear of online participation.

As someone who shares, edits, or appreciates imagery, understanding deepfake abuse is critical. These issues affect trust in visual media and underscore the importance of consent and ethical use of digital tools. 

Being aware of the potential for harm, learning how to recognise manipulated content, and supporting stronger legal and technological safeguards can help protect your community and the children around you.

UNICEF’s warning makes it clear that digital abuse is not distant or hypothetical. The risks are here now and affect millions of children. This issue challenges photographers, platform users, and policymakers alike to rethink how images are protected and how technology is regulated in the digital world.

---