Author: Shubham Choudhary, Chandigarh University
Abstract
Recent advances in artificial intelligence have blurred the line between genuine digital content and artificially generated material, making verification more challenging than ever.Among the recent advancements in artificial intelligence, synthetic media generation has emerged as a technology with far-reaching social and legal implications, which enables the creation of highly realistic images, videos, and audio recordings that appear genuine despite depicting events that never actually occurred. Through the use of advanced AI techniques, individuals can be shown saying or doing things that they have never said or done in reality. Such content is often created to defame individuals, damage reputations, spread misinformation, commit fraud, or seek personal revenge.
As internet penetration continues to expand across India, the country faces growing challenges arising from the misuse of AI-powered content generation tools. The widespread use of social media platforms has further accelerated the circulation of manipulated content, creating serious legal, social, political, and cybersecurity concerns. India currently lacks a comprehensive legal framework specifically regulating AI-generated synthetic media. This article examines the concept of deepfakes, their growing misuse, the legal challenges they present, and the urgent need for stronger cyber laws to address the risks posed by this emerging technology.
To the Point
The term “deepfake” describes AI-generated digital content that imitates a real person’s appearance, voice, or actions through advanced machine-learning techniques.By using machine learning algorithms and facial mapping technology, deepfakes can manipulate images, videos, and audio recordings in a manner that makes them appear authentic. Through techniques such as face-swapping, voice cloning, image replacement, and video manipulation, a person’s face or voice can be superimposed onto another individual’s body or speech without their knowledge or consent.
The misuse of deepfakes extends across multiple sectors. They are commonly used for revenge pornography, cyberbullying, blackmail, financial fraud, fake evidence creation, political propaganda, market manipulation, and misinformation campaign The spread of false information has become significantly easier in the digital age, while correcting misinformation remains a difficult and time-consuming process. The production of deepfake content is not limited to a single category of actors. Broadly, four major groups are involved in creating deepfakes.
1. First, technology enthusiasts and hobbyists often create deepfakes out of curiosity or for experimentation and share them within online communities.
2. Second, political groups, activists, or even foreign governments may employ deepfakes to influence public opinion and advance political objectives.
3. Third, fraudsters and malicious actors use deepfake technology to conduct scams, commit financial fraud, spread misinformation, and deceive victims.
Finally, legitimate organisations, including media companies and entertainment industries, may utilise deepfake technology for lawful purposes such as dubbing, visual effects, content production, and educational applications. The challenge therefore lies not in the technology itself, but in preventing its malicious and unlawful use.
Use of Legal Jargon
Deepfakes frequently result in cyber defamation, reputational harm, identity theft, privacy violations, online harassment, and even cyber terrorism.
Legal Framework in India
1. Bharatiya Nyaya Sanhita, 2023 (BNS)
• Section 111 – Deals with organised crime. If deepfakes are created and circulated by a criminal group acting in a coordinated manner, liability may arise under this provision.
• Section 318 – Punishes cheating and digital fraud where deepfakes are used to deceive individuals for unlawful gain.
• Section 319 – Covers cheating by personation. Deepfake creators may impersonate another person through manipulated audio or video content.
• Sections 351 & 356 – Address criminal intimidation and defamation where deepfakes are used to threaten or damage a person’s reputation.
2. Information Technology Act, 2000
• Section 66C – The offence of identity theft under Section 66C extends to situations where a person’s digital identity is misappropriated without consent. The creation of deepfake content using another individual’s image, voice, or personal identifiers may attract liability under this provision.
• Section 66D – Deals with cheating by personation through computer resources and online platforms.
• Section 66E – Protects privacy and penalizes the capture, publication, or transmission of images without consent.
• Section 74 – Penalizes the fraudulent use of false electronic signatures and digital certificates.
3. Digital Personal Data Protection Act, 2023
• Section 6 – Requires free, informed, and unambiguous consent before processing personal data. Deepfakes created without consent may violate this principle.
• Article 21 of the Constitution of India – RIGHT TO LIFE AND LIBERTY
• Indecent Representation of Women (Prohibition) Act, 1986
• Provides protection against the creation and circulation of obscene or sexually exploitative deepfake content targeting women.
The Proof
The growing number of deepfake incidents across the world demonstrates that the threat posed by AI-generated content is no longer hypothetical.
1. One of the most notable examples occurred during the Russia–Ukraine conflict in 2022. A manipulated video of Ukrainian President Volodymyr Zelenskyy circulated online, appearing to show him urging Ukrainian soldiers to surrender and lay down their weapons. The video was later exposed as a deepfake created using artificial intelligence. Although the misinformation was quickly countered by an authentic statement from the President, the incident highlighted how deepfake technology can be weaponized during armed conflicts to spread propaganda, create confusion, and weaken public morale. The event demonstrated the potential impact of synthetic media on national security and information warfare.
2. The misuse of deepfake technology has also raised serious concerns regarding privacy and dignity. In 2024, AI-generated intimate images falsely depicting international singer Taylor Swift were widely circulated on the internet. Although the images were entirely fabricated, they appeared highly realistic and attracted millions of views within a short period. The incident reignited global discussions concerning consent, privacy, digital abuse, and the need for stronger legal protections against non-consensual synthetic media.
3. India witnessed a major public discussion on deepfake regulation following the Rashmika Mandana deepfake incident in 2023. A manipulated video circulated online in which the actress’s face was digitally superimposed onto another individual’s body using face-swapping technology. The incident raised concerns regarding privacy, consent, digital safety, and the misuse of artificial intelligence. It also increased pressure on the government and technology platforms to adopt stronger measures against malicious synthetic content.
Case Laws
1. Shreya Singhal v. Union of India (2015)
This landmark judgment is one of the most significant decisions in Indian cyber law jurisprudence. The case challenged the constitutional validity of Section 66A of the Information Technology Act, 2000, which criminalized the transmission of offensive, annoying, or inconvenient messages. The provision came under criticism due to its vague and broad language.The controversy gained national attention after two young women from Maharashtra were arrested for a Facebook post and a related online interaction following the death of a political leader Bal Thackrey . Subsequently, a Public Interest Litigation was filed challenging the constitutionality of the provision.
The Supreme Court struck down Section 66A as unconstitutional, holding that it violated the freedom of speech and expression guaranteed under Article 19(1)(a) of the Constitution. The judgment remains relevant to deepfake regulation because any future legislation addressing AI-generated content must carefully balance the need to combat misinformation with the constitutional protection of free speech.
2. Justice K.S. Puttaswamy (Retd.) v. Union of India (2017)
The Puttaswamy judgment is a landmark decision concerning the right to privacy in India. The case arose from concerns regarding the Aadhaar programme, including issues related to the collection of biometric data, surveillance, and informational privacy.
A nine-judge bench of the Supreme Court unanimously held that the right to privacy is a fundamental right protected under Article 21 of the Constitution. The Court recognized that individuals possess a legitimate expectation of privacy over their personal information and that informational autonomy forms an essential component of human dignity and liberty.
Conclusion
Deepfake technology represents one of the most complex challenges emerging from the rapid advancement of artificial intelligence. While the technology offers legitimate applications in entertainment, education, media production, and communication, its misuse has created serious threats to privacy, dignity, reputation, democracy, financial security, and national security.India currently relies upon a combination of constitutional protections, provisions under the Bharatiya Nyaya Sanhita, the Information Technology Act, data protection legislation, intermediary guidelines, and regulatory advisories to address deepfake-related harms. However, these measures provide only indirect remedies and do not comprehensively regulate the creation and dissemination of AI-generated synthetic media.
FAQs
Q1. What is Deepfake Technology?
Deepfake technology uses artificial intelligence and deep learning techniques to create realistic but fabricated images, videos, or audio recordings that appear genuine.
Q2. Is Deepfake Technology illegal in India?
Deepfake technology itself is not illegal. However, its misuse for fraud, impersonation, defamation, privacy violations, or the circulation of obscene content may attract civil and criminal liability under existing laws.
Q3. Which laws can currently be used against deepfake offences in India?
Relevant provisions may be found in the Bharatiya Nyaya Sanhita, 2023, the Information Technology Act, 2000, the Digital Personal Data Protection Act, 2023, and the Information Technology Rules, 2021.
Q4. How do deepfakes violate privacy rights?
Deepfakes often involve the unauthorized use of a person’s face, voice, image, or personal information without consent, thereby affecting privacy, dignity, and reputation.
