The Internet Watch Foundation (IWF), an internet safety organization, has issued a warning that addressing the threat of artificially generated images of child sexual abuse should be a priority at the upcoming global AI summit hosted by the UK. The IWF highlighted the risk of normalising child sex abuse through the use of “astoundingly realistic images” and expressed concern that distinguishing between genuine and artificially created images could divert attention from assisting real victims. The organization emphasised the potential for criminals to produce large quantities of lifelike child sexual abuse imagery using AI technology.
The IWF shared its first data on AI-generated child sexual abuse imagery, revealing that of the 29 reported web addresses containing suspected AI-generated imagery between May 24 and June 30, seven were confirmed to contain such content. The images included Category A and B material, depicting severe forms of sexual abuse, with victims as young as three years old.
The IWF also discovered an online “manual” authored by offenders aiming to guide other criminals in training AI systems and improving the realism of generated results. The organization stressed that although these images do not feature real children, they contribute to the normalisation of child sexual abuse and make it harder to detect real instances of abuse.
The global AI summit, announced by Prime Minister Rishi Sunak, will focus on the need for coordinated international action to mitigate the risks associated with AI technology. The IWF urged the implementation of legislation specifically targeting the use of AI to create child sexual abuse images, emphasising the urgency to address the serious threat posed by this technology.
Susie Hargreaves, CEO of the IWF, emphasized the need for proactive measures, stating that AI is becoming increasingly sophisticated and urging the Prime Minister to prioritise this threat at the global AI summit. The IWF warned that the continued abuse of AI-generated imagery could have devastating consequences, making the internet a more dangerous place and exposing more individuals to harmful content.
The National Crime Agency (NCA) acknowledged the increasing risk posed by AI-generated content, highlighting that while it currently appears in a limited number of cases, the threat is being taken extremely seriously. The NCA stressed that the creation or possession of pseudo-images using AI or other technology is an offence in the UK and plays a role in normalising and escalating abuse among offenders. The agency also expressed concern that the growing volume of AI-generated material could strain law enforcement resources and delay the identification and protection of real children in need.
