AI-generated deepfakes and voice cloning are possible risks during election season

Security experts are concerned about the potential exploitation of deepfake and artificial intelligence technologies, among others, to manipulate voters as political parties try their hardest to win over support before the general elections. The Indian Election Commission has previously released standard operating procedures for spotting false information and acting quickly on it.

It has been believed that a major challenge before the police is timely detection of such content and taking prompt action. There is no technology available that can automatically detect and differentiate between original and fake video content created using artificial intelligence (AI).

"Deepfake videos and voice cloning are two tools that could be massively used during the election campaign. By the time it gets noticed, the damage is already done because it gets spread on social media," a senior officer of the Delhi Police's cyber crimes unit said.

Former Indian Police Service (IPS) officer and cybersecurity expert Triveni Singh said the widespread dissemination of AI-generated misinformation can erode public trust in the electoral process and democratic institutions. The government should engage with stakeholders, including cybersecurity experts, tech companies and civil society organisations, to develop transparent and fair guidelines for evaluating and approving AI tools. Talking about the measures being taken to tackle the potential danger that AI poses during elections, he said the Centre has made the Indian Cybercrime Coordination Centre (I4C) the nodal agency for taking down objectionable online content.

Shashank Shekhar, co-founder of Future Crime Research Foundation, a think-tank incubated at IIT-Kanpur, said law enforcement agencies work closely with social media companies to detect and remove malicious content.

According to an Election Commission official, social media cells have been constituted in collaboration with cyber cells in all districts for quick response and action within the legal framework.