Quick Overview
- OpenAI has postponed its controversial “adult mode” feature for ChatGPT designed to enable erotic conversations
- Safety advisers cautioned the functionality could become a “sexy suicide coach” through unhealthy emotional attachments
- Age verification technology incorrectly identifies minors as adults approximately 12% of the time
- Given approximately 100 million weekly users under 18, the failure rate threatens to expose countless teenagers to inappropriate material
- The company maintains plans to eventually launch the feature once proper safeguards are implemented
OpenAI has halted its upcoming “adult mode” feature for ChatGPT following significant objections from internal teams, external safety consultants, and mental health professionals regarding adolescent safety and psychological risks.
The controversial capability, initially proposed by CEO Sam Altman in recent months, would enable users to engage in sexually explicit text exchanges with the AI assistant. Altman defended the initiative as respecting “adult users like adults” and indicated it might drive user engagement and financial performance.
However, the proposal immediately encountered substantial internal resistance.
During a meeting in January, OpenAI‘s wellness advisory board members reportedly expressed unified outrage. The board comprises specialists in mental health and brain science disciplines.
One consultant cautioned the company risked creating what they termed a “sexy suicide coach.” This stark warning referenced documented incidents where ChatGPT users had died by suicide following the development of intense parasocial relationships with the AI.
Consultants additionally expressed concerns about fostering unhealthy psychological dependence on the chatbot and the inevitability that underage users would circumvent age barriers.
A fundamental technical challenge involves OpenAI’s age-detection technology. Testing revealed the system incorrectly classified minors as adults in roughly 12% of cases. With ChatGPT serving approximately 100 million weekly users below age 18, this error margin could potentially grant millions of adolescents access to adult-oriented conversations.
Technical Obstacles in Age Detection
The organization had intended to deploy its age-verification infrastructure prior to releasing adult mode. However, after discovering the significant error rate, OpenAI opted for a gradual implementation to enhance precision.
OpenAI has additionally struggled with filtering prohibited content, including scenarios depicting non-consensual activities or child exploitation material, while permitting legitimate adult interactions. Company insiders indicated the protective systems remain inadequate.
When adult mode eventually debuts, OpenAI intends to restrict it exclusively to text-based interactions. The system will not produce erotic imagery, audio, or video materials.
Competitor Approaches to Adult AI Content
Numerous competing AI platforms currently permit certain adult-themed content. Elon Musk’s xAI introduced a flirtatious persona for its Grok assistant, though Musk subsequently limited access to paying subscribers. Meta permits its AI systems to participate in romantic roleplay scenarios, but prohibits the functionality for accounts belonging to minors.
In the closing months of 2024, a 14-year-old Florida boy tragically took his own life after developing an obsessive attachment to a Character.AI chatbot. His mother pursued legal action, prompting Character.AI to reach a settlement and implement stricter youth protections.
OpenAI affirmed its continued support for the concept of permitting adult content for mature audiences. The organization stated it will temporarily prioritize alternative enhancements, including improvements to ChatGPT’s conversational style and customization capabilities.
The postponement is anticipated to extend for a minimum of one month, based on reports from informed sources.
