OpenAI Introduces New Teen Safety Rules for ChatGPT Amid Growing Concerns
OpenAI has updated its guidelines for how its AI models should behave with users under 18, and published new AI literacy resources for teens and parents.
The updates come as the AI industry faces increased scrutiny from policymakers, educators, and child-safety advocates after several teenagers allegedly died by suicide after prolonged conversations with AI chatbots.
Gen Z, which includes those born between 1997 and 2012, are the most active users of OpenAI’s chatbot, and following OpenAI’s recent deal with Disney, more young people may flock to the platform.
New Model Behavior Guidelines
OpenAI’s updated Model Spec, which lays out behavior guidelines for its large language models, builds on existing specifications that prohibit the models from generating sexual content involving minors, or encouraging self-harm, delusions, or mania.
The specification also calls for extra caution around subjects like body image and disordered eating behaviors, and instructs the models to prioritize communicating about safety over autonomy when harm is involved.
The models are instructed to avoid immersive romantic roleplay, first-person intimacy, and first-person sexual or violent roleplay, even when it’s non-graphic.
Key Safety Principles
OpenAI says the key safety practices for teens are underpinned by four principles that guide the models’ approach: Put teen safety first, promote real-world support, treat teens like teens, and be transparent.
The document also shares several examples of the chatbot explaining why it can’t “roleplay as your girlfriend” or “help with extreme appearance changes or risky shortcuts.”
Lily Li, a privacy and AI lawyer, said it was encouraging to see OpenAI take steps to have its chatbot decline to engage in such behavior.
Concerns and Criticisms
Robbie Torney, senior director of AI programs at Common Sense Media, raised concerns about potential conflicts within the Model Spec’s under-18 guidelines.
He highlighted tensions between safety-focused provisions and the “no topic is off limits” principle, which directs models to address any topic regardless of sensitivity.
In the case of Adam Raine, a teenager who died by suicide after months of dialogue with ChatGPT, the chatbot engaged in mirroring, their conversations show.
Next Steps
OpenAI now uses automated classifiers to flag content in real-time, not just after the fact, to prevent unsafe and harmful interactions.
The company is taking steps to address concerns and criticisms, but questions remain about how consistently such policies will translate into practice.
Source: Link
