Teen ChatGPT: Safety Moves to Age Verification

Why in the News

OpenAI is rolling out a separate version of ChatGPT for teenagers, with tighter restrictions on conversations about self harm, suicide, eating disorders and sexual content. The move follows cases in which teenagers who died by suicide had interacted extensively with chatbots beforehand, and it arrives while a United States Federal Trade Commission (FTC) inquiry into seven AI companies is under way. The safeguard depends on estimating a user’s age and on parents choosing to switch controls on, which are the two weakest links in the chain.

What is ChatGPT for Teens?

1. About: It is a more restricted version of ChatGPT into which OpenAI places users it identifies as being under 18.
2. Content limits: The teen version avoids romantic or sexual conversations and places stronger limits around self harm related content.
3. Anti anthropomorphism rule: The chatbot is discouraged from presenting itself as conscious or as emotionally attached to the user.
4. Parental layer: Parents can link their accounts, set usage restrictions and receive alerts in certain situations.

How does OpenAI decide who is a teenager?

1. Signal based estimation: OpenAI uses a combination of signals to estimate whether a user could be under 18.
2. The three signals named: How an account is used, the subjects discussed in it, and how long the account has existed.
3. Override of stated age: ChatGPT can automatically place an account under the teen safeguards even if a different age was entered at signing up.
4. The admitted limit: Age detection systems are not foolproof, and several parental controls depend on families opting in.
5. What that makes the product: The teen version is an attempt to reduce some of the risks emerging around AI companionship rather than a complete fix for them.

Why do AI chatbots pose a different risk from social media?

1. Designed agreeability: AI chatbots are programmed to be agreeable companions that validate users’ feelings, which is not how conventional social media platforms operate.
2. The harm pathway: Unchecked validation can intensify suicidal behaviour and self mutilation among vulnerable children confiding their deepest fears.
3. Neurological vulnerability: Children’s developing brains make them particularly vulnerable to AI systems that create dopamine responses.
4. The combination that matters: The technology is highly responsive, anthropomorphic and adept at mimicking empathy, and for adolescents still developing judgement and a sense of self, that combination proves pernicious.
5. Everyday embedding: For a generation of digital natives, AI is already a sounding board for curiosity and a companion shaping how they learn, communicate and seek reassurance.

What do the litigation and the studies show?

1. The Adam Raine suit: The parents of 16 year old Adam Raine sued OpenAI last year, alleging that ChatGPT had validated his suicidal thoughts and discussed methods of self harm before his death in April 2025.
2. OpenAI’s own admission: The company acknowledged that some of its safety protections could become less reliable over the course of long conversations.
3. The Character.AI settlement: Character.AI and Google agreed this year to settle a lawsuit filed by the mother of a 14 year old who died by suicide in 2024 after extensively interacting with a Character.AI chatbot, with the mother alleging he had developed an intense emotional attachment to the bot.
4. The 2025 United States study: It found that ChatGPT provided dangerous responses to teens discussing self harm, substance abuse and eating disorders, including drafting suicide letters.
5. A second study: It found chatbots suggesting violence, self harm and substance use every five minutes during testing.

What are regulators elsewhere doing?

1. United States, Federal Trade Commission: The FTC, the country’s consumer protection and competition regulator, has opened an investigation into seven AI companies, including OpenAI, over the effects of their products on children.
2. United States, the Meta trial: Meta is facing a trial on the ground that it deliberately designed Facebook and Instagram to exploit young users’ vulnerabilities and to make its platforms addictive.
3. China: It has moved to restrict AI systems that encourage emotional dependence, targeting the companionship design itself rather than the content output.
4. India: It relies on a patchwork of laws, regulations and platform led interventions rather than a dedicated instrument for AI and minors.
5. What the set demonstrates: Two jurisdictions are acting through litigation and inquiry after the harm, one is acting on product design in advance, and India has neither route settled.

Why is a safer chatbot not the same as a safe one?

1. Age prediction is an estimate: The safeguard applies only once the system correctly guesses that the user is a minor, and children can misrepresent their age.
2. Enforcement dependent restrictions: Content restrictions are only as effective as their enforcement, which is not independently observable from outside the company.
3. Track record on earlier controls: OpenAI introduced parental controls last year, and critics quickly demonstrated that these could be easily bypassed.
4. Reactive sequencing: The protections arrived only after sustained public and legal pressure, which is a reminder that children’s online safety cannot be left to Big Tech alone.
5. The tension that remains: A company that profits from engagement is being asked to design against the very property, unconditional validation, that generates the engagement.

Challenges to AI Safeguards for Minors

1. Unverifiable age estimation: The safeguard triggers on inference rather than on verified identity. e.g. OpenAI relying on account usage patterns, discussed subjects and account age to guess whether a user is under 18.
2. Opt in dependence: Protections that require a parent to activate them reach only supervised households. e.g. the parental controls introduced last year that critics demonstrated could be easily bypassed.
3. Safety degradation over long sessions: Guardrails hold in short exchanges and weaken in the extended conversations minors actually have. e.g. OpenAI’s acknowledgement that some protections become less reliable over the course of long conversations.
4. Cross platform substitution: A restriction on one service pushes the user to a less restricted one. e.g. Character.AI, whose chatbot featured in the 2024 death that Google and the company settled this year.
5. Absence of independent testing: Only external researchers have surfaced the failure modes, and they have no standing access. e.g. the 2025 United States study that found ChatGPT drafting suicide letters for teens.
6. Divergent national rules: A globally distributed product faces incompatible obligations across markets. e.g. China restricting emotionally dependent AI systems while India relies on a patchwork of laws and platform led interventions.
7. No liability standard for conversational harm: Existing intermediary law was written for hosted content, not for generated responses. e.g. the Adam Raine suit, which turns on whether a chatbot’s own outputs contributed to a death.

Conclusion

The property that makes chatbots compelling for adolescents, unconditional and empathetic sounding validation, is the same property that turned them dangerous in the Raine and Character.AI cases. ChatGPT for Teens restricts content, discourages the bot from claiming emotional attachment and adds parental linkage, which is a welcome and overdue intervention. It nonetheless rests on age estimation that is admittedly not foolproof and on controls that families must opt into, after the previous generation of parental controls was shown to be bypassable. What remains missing is independent testing, transparency and external scrutiny, alongside digital literacy for the parents the safeguards assume will be watching.

Child Online Safety and Artificial Intelligence Governance in India

1. About: Child online safety covers the protection of minors from harmful content, exploitative design, data exploitation and psychological harm arising from digital products.
2. The distinctive AI risk: Generative systems produce responses rather than host content, so harm arises from the model’s own output and not from a third party post an intermediary can be asked to take down.
3. Companionship design: Systems built to maximise engagement through empathy simulation create attachment, which is why regulation is beginning to target design features rather than only content categories.
4. India’s scale: India has one of the world’s largest populations of internet users under 18, with smartphone access typically arriving before any formal digital literacy instruction.
5. Regulatory posture: India has no dedicated artificial intelligence statute, and obligations flow from the Information Technology Act, 2000, data protection law and platform self regulation.
6. Institutional anchor: The National Commission for Protection of Child Rights is the statutory body that issues advisories and takes cognisance of child rights violations, including online ones.

Laws and Rules Governing Children’s Online Safety in India

1. Information Technology Act, 2000: The parent statute for electronic records, intermediary liability and cyber offences.
2. Section 79: Grants intermediaries conditional safe harbour subject to due diligence, which is the hook for content obligations.
3. Section 67B: Penalises the publication and transmission of material depicting children in sexually explicit acts.
4. Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021: Impose due diligence, grievance redress and expeditious removal obligations on intermediaries and significant social media intermediaries.
5. Digital Personal Data Protection Act, 2023: Defines a child as a person below 18 and requires verifiable parental consent before processing a child’s personal data.
6. Design prohibition: Bars tracking, behavioural monitoring and targeted advertising directed at children.
7. Protection of Children from Sexual Offences Act, 2012: Criminalises sexual offences against children, including the use of children for pornographic purposes.
8. Juvenile Justice (Care and Protection of Children) Act, 2015: Provides the care, protection and rehabilitation framework for children in need of care.
9. Commissions for Protection of Child Rights Act, 2005: Establishes the National and State Commissions for Protection of Child Rights with powers of inquiry into violations.
10. Bharatiya Nyaya Sanhita, 2023: Carries the general criminal provisions on abetment of suicide and obscenity that apply where a digital product is alleged to have contributed to harm.

Government Initiatives for Child Online Safety

1. IndiaAI Mission: The national programme for compute, datasets, applications and a safe and trusted artificial intelligence pillar covering risk assessment and governance tools.
2. Cyber Crime Prevention against Women and Children scheme: Funds State capacity for handling online offences against women and children, including forensic and training support.
3. National Cyber Crime Reporting Portal: Provides a dedicated reporting channel for child sexual abuse material and other online offences.
4. Information Security Education and Awareness programme: Runs cyber safety awareness for students, teachers and parents through the Ministry of Electronics and Information Technology.
5. Indian Computer Emergency Response Team advisories: Issues public advisories on online safety practices and coordinates incident response.
6. National Commission for Protection of Child Rights advisories: Issues directions to platforms on age assurance, harmful content and child data practices.
7. Cyber Swachhta Kendra: Operates as the botnet cleaning and malware analysis centre supporting safer end user devices.

Key Facts about Children and the Digital Environment

1. The Digital Personal Data Protection Act, 2023 sets the threshold for a child at below 18 years, which is higher than the 13 year threshold under the United States Children’s Online Privacy Protection Act, 1998.
2. The National Commission for Protection of Child Rights is a statutory body constituted under the Commissions for Protection of Child Rights Act, 2005.
3. Safer Internet Day is observed on the second Tuesday of February.
4. The European Union Artificial Intelligence Act, 2024 is the first comprehensive statute to classify artificial intelligence systems by risk tier and to ban specified manipulative practices.
5. The Convention on the Rights of the Child, 1989, to which India is a party, requires protection of children from all forms of exploitation prejudicial to their welfare.
6. General Comment No. 25 (2021) of the United Nations Committee on the Rights of the Child extends child rights obligations explicitly to the digital environment.

Challenges in Regulating Artificial Intelligence Use by Children

1. Verifiable parental consent at scale: The law demands verification without prescribing a workable method that does not itself collect more child data. e.g. the Digital Personal Data Protection Act, 2023 requiring verifiable parental consent for every under 18 user.
2. Mismatched age thresholds: A global product faces a different definition of a child in each market. e.g. India setting the threshold at 18 while the United States Children’s Online Privacy Protection Act, 1998 sets it at 13.
3. Attributing harm to a model output: Causation is contested when the alleged harm is a conversation. e.g. the Adam Raine suit and the Character.AI settlement, both of which turn on whether chatbot responses contributed to a death.
4. Cross border enforcement: Models hosted and trained abroad serve domestic minors with no local establishment to proceed against. e.g. Indian users accessing chatbots operated entirely from other jurisdictions.
5. Absence of a dedicated statute: Regulation runs on instruments written for hosted content and for data, not for generated responses. e.g. India relying on the Information Technology Act, 2000 and platform led interventions.
6. Parental digital literacy gap: Controls assume a supervising adult who understands the product. e.g. first generation smartphone households where the child is the more capable user.
7. Design based harm outside content rules: Engagement optimisation and empathy simulation are not content categories that a takedown regime can reach. e.g. China moving to restrict AI systems that encourage emotional dependence, a design level rather than content level intervention.

Way Forward

1. Independent safety testing: Require third party red team testing of chatbot behaviour with adolescent personas, with results published rather than held by the developer.
2. Statutory age assurance standards: Prescribe a privacy preserving age assurance method so protection does not depend on a company’s own inference or on a child’s self declaration.
3. Default on, not opt in: Make the safest configuration the default for accounts assessed as belonging to minors, so protection does not depend on a parent activating it.
4. Duty of care by design: Place an explicit obligation on developers to design against engagement maximisation and emotional dependence for minors, following the design level approach rather than a content list.
5. Crisis routing obligations: Mandate that any self harm, suicide or eating disorder cue in a minor’s conversation trigger an immediate handoff to a human helpline, with logged compliance.
6. Transparency reporting: Require periodic public reporting of safety failure rates, bypass incidents and the duration effect on guardrail reliability in long conversations.
7. Digital literacy and sensitisation: Build chatbot specific awareness into school curricula and parent outreach, since the risk is a design property that neither group currently recognises.
8. A dedicated Indian instrument: Move from the present patchwork to a clear framework for artificial intelligence products used by minors, backed by the National Commission for Protection of Child Rights and the data protection regulator.

“[2025, GS2, 15 marks] The National Commission for Protection of Child Rights has to address the challenges faced by children in the digital era. Examine the existing policies and suggest measures the Commission can initiate to tackle the issue.”