Author: Asma Fareed
College: Sultan-Ul-Uloom College of Law
Abstract
The rapid development of generative artificial intelligence has created new possibilities for creativity, communication and digital innovation, but it has also created a new dimension of online child sexual exploitation. AI systems can generate, manipulate or transform images and videos in ways that may depict children in sexually explicit situations without requiring the creation of conventional photographic material. The emergence of such material raises difficult questions concerning criminal responsibility, intermediary liability, evidence collection, victim protection and the capacity of existing cybercrime laws to respond to synthetic media. India already has a substantial legal framework dealing with child sexual exploitation, including the Protection of Children from Sexual Offences Act, 2012 (POCSO), section 67B of the Information Technology Act, 2000, and intermediary obligations under the Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021. The Supreme Court’s 2024 judgment in Just Rights for Children Alliance v. S. Harish also clarified important aspects of the legal treatment of child sexual abuse material and emphasized the need to interpret existing law in light of contemporary digital realities. The emergence of generative AI, however, creates a further problem: the material may be synthetic even though the harm may be real. A child’s photograph may be manipulated, an entirely artificial image may be generated, or an identifiable child’s face may be placed onto sexually explicit material. These circumstances complicate traditional concepts of victimhood, possession, publication and evidence. This article examines the development of AI-generated child sexual abuse material, the responsibility of technology platforms, limitations in cybercrime investigation, and the adequacy of India’s existing legal framework. It argues for a technology-neutral and child-centred regulatory approach combining criminal law, intermediary responsibility, technical safeguards, international cooperation and effective victim-protection mechanisms
AI-generated Child Sexual Abuse Material (CSAM) refers to sexually explicit or abusive synthetic content involving children, created using generative AI, deepfakes, or image manipulation.The creation and circulation of such material may violate children’s privacy, dignity, and safety, even where no physical abuse occurs during its production. In India, relevant laws include the POCSO Act, 2012, the Information Technology Act, 2000, and the Bharatiya Nyaya Sanhita, 2023.
A major legal challenge is determining the liability of individuals who create, possess, publish, or distribute such content, along with the obligations of digital platforms and intermediaries. Investigations are further complicated by encryption, anonymous accounts, foreign servers, and difficulties in preserving electronic evidence
The legal framework governing AI-generated CSAM in India is shaped by the interplay of constitutional safeguards, statutory provisions, and the evolving regime of intermediary liabilityArticle 21 of the Constitution guarantees the right to life and personal liberty, encompassing the dignity, privacy, and safety of children.
The POCSO Act, 2012, and Section 67B of the Information Technology Act, 2000, address child sexual exploitation and prohibited electronic content. Intermediaries are subject to statutory due diligence obligations, while digital forensics and electronic evidence play a crucial role in investigation and prosecution.
However, anonymity and cross-border jurisdiction pose significant challenges. Effective enforcement requires platform accountability, preservation of digital evidence and a childcentric approach consistent with due process.
The Proof:
The major legal and technological challenge is proving what happened, who created the material, how it was generated, and whether the accused person knowingly possessed, transmitted or distributed it. Digital evidence may include device data, server records, account information, timestamps, network information, metadata, communications and forensic copies. In India, the evidentiary treatment of electronic records has developed significantly through the Evidence Act, Jurisprudence and the Bharatiya Sakshya Adhiniyam, 2023. The Supreme Court’s decisions in Anvar P.V. v. P.K. Basheer and Arjun Panditrao Khotkar v. Kailash Kushanrao Gorantyal are important in understanding electronic evidence and certification requirements under the earlier statutory framework. AI-generated material creates an additional forensic problem: authenticity cannot always be determined merely by looking at an image or video. Investigators may need to examine source devices, generation logs, application records, metadata, hashes, platform records and other corroborating evidence. Another important issue is preservation. Digital material can be deleted, altered or moved between jurisdictions within a very short period. Effective investigation therefore requires timely preservation requests, forensic acquisition, chain of custody procedures and cooperation between investigators and service providers.
Case Laws:
1. Just Rights for Children Alliance v. S. Harish (Supreme Court of India, 2024) The Supreme Court addressed the legal treatment of child sexual abuse material and emphasized that courts should not adopt an overly narrow understanding of the statutory language when dealing with the realities of digital child exploitation. The judgment is particularly relevant to discussions concerning electronic dissemination and the protection of children from sexual exploitation.
2. Shreya Singhal v. Union of India (2015) The Supreme Court considered constitutional questions concerning online speech and intermediary liability. The judgment is relevant when examining the balance between regulation of unlawful online content and constitutional protections.
3. Anvar P.V. v. P.K. Basheer (2014) The Supreme Court established important principles concerning the admissibility of electronic records under the earlier Indian Evidence Act framework.
4. Arjun Panditrao Khotkar v. Kailash Kushanrao Gorantyal (2020) The Supreme Court clarified aspects of the certificate requirement relating to electronic records under the earlier evidentiary framework and reaffirmed the importance of proper electronic-evidence procedure.
Conclusion
AI-generated child sexual abuse material represents a significant challenge for modern cybercrime enforcement because the technology can separate the creation of harmful content from a conventional physical act of abuse. At the same time, synthetic content can exploit the identity of a real child and can produce serious consequences for dignity, privacy and psychological well-being. India’s existing legal framework provides important tools through POCSO, the Information Technology Act and intermediary regulation.
Nevertheless, enforcement agencies must address questions of synthetic content, deepfakes, attribution, evidence preservation, cross-border investigations and rapidly evolving AI systems. The appropriate legal response should not depend entirely upon whether an abusive image is produced by a camera or generated by software. The law must focus on the prohibited conduct, the exploitation of children, the circulation of harmful material and the protection of victims, while maintaining appropriate safeguards for legitimate technological innovation and constitutional rights. Future policy should therefore combine criminal enforcement with platform accountability, stronger technical safeguards, rapid reporting and removal mechanisms, digital-forensic capacity, international cooperation and effective victim-support systems.
FAQs
Q1. Is AI-generated CSAM a cybercrime issue?
Yes. Its creation, possession, transmission, publication or distribution may raise criminal-law questions depending on the content, conduct and applicable statutory provisions.
Q2. Does an AI-generated image necessarily involve a real child?
No. Synthetic material can be generated without directly using a real child’s photograph. However, the use of a real child’s identity or likeness creates additional victim-protection concerns.
Q3. Can an AI platform be automatically treated as criminally liable?
No automatic conclusion should be drawn. Liability depends on the applicable law and facts, including the platform’s conduct, knowledge, statutory duties and response to unlawful content.
Q4. Why is digital evidence important?
Because investigators must establish the origin, possession, transmission, identity of users and authenticity or manipulation of electronic material.
Q5. What is the major legal challenge for India? A central challenge is applying existing child-protection and cybercrime provisions to rapidly changing synthetic-media technologies while preserving effective evidence procedures and victim protection.
Reference
1. Protection of Children from Sexual Offences Act, 2012.
2. Information Technology Act, 2000, particularly section 67B.
3. Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021.
4. Bharatiya Sakshya Adhiniyam, 2023.
5. Just Rights for Children Alliance v. S. Harish, Supreme Court of India, 2024.
6. Shreya Singhal v. Union of India, (2015) 5 SCC 1.
7. Anvar P.V. v. P.K. Basheer, (2014) 10 SCC 473.
8. Arjun Panditrao Khotkar v. Kailash Kushanrao Gorantyal, (2020) 7 SCC 1.
9. UNICEF, materials concerning AI-generated sexualisedcontent involving children.
10. INTERPOL, materials concerning technology-facilitated child sexual exploitation and abuse
