The rising threat of AI-powered apps

The websites and apps that use AI to produce fake naked images are attracting a large number of visitors. These ‘nudifying’ apps mostly target women. There is rising threat of AI-powered apps that 'undress' women's photos.

The use of AI for generating non-consensual pornography has been a worrying trend for years now. Websites that create deepfake nudes – digitally manipulated images to make someone appear naked – have surfaced in the past few years.

With AI tools becoming more accessible, it has also become easier and cheaper to produce non-consensual sexually explicit content. From celebrities to a layperson, deepfakes can be deployed to target anyone with just a few clicks. The rise of apps and websites using AI to undress women in photos is a deeply concerning development, raising serious ethical and legal questions.

Some key aspects to consider, related to Ethical Concerns:

· Consent and privacy: This technology violates the privacy and autonomy of individuals, particularly women, by creating non-consensual nudity. It can be used for harassment, stalking, and revenge porn, causing significant emotional distress and reputational damage.

· Objectification and hyper-sexualization: These applications perpetuate harmful stereotypes and contribute to the objectification and hyper-sexualization of women. They promote unrealistic body image expectations and reinforce harmful gender norms.

· Potential for abuse: The technology could be misused to create deepfake pornography, further victimizing individuals and contributing to the exploitation of children.

According to social network analysis company Graphika, as many as 24 million (2.4 crore) people visited such sites in September alone. The rise in popularity corresponds to the release of several open source diffusion models, or artificial intelligence that can create images that are far superior to those created just a few years ago, Graphika said. Because they are open source, the models that the app developers use are available for free. You can create something that actually looks realistic.

Apps that ‘undress’ women

These undressing, or “nudify”, sites and apps alter existing clothed pictures and videos of real individuals. It then uses AI to generate a fake nude image of them, stated Business Insider. Most of these “nudifying” apps work only on women.

Graphika said in its December report, “A Revealing Picture”, that it analysed 34 websites that offer these services, which it described as non-consensual intimate imagery (NCII).

The researchers found that the number of links advertising undressing apps rose over 2,400% since the beginning of this year on social media, including on X and Reddit, reported Bloomberg. The report uncovers that 53 Telegram groups used to access these services have atleast 1 million users.

S Mohini Ratna, Editor, VARINDIA