OpenAI Introduces 'Trusted Contact' Feature to Prevent Self-Harm

The Launch of Trusted Contact

OpenAI has announced a new feature called Trusted Contact, designed to alert a trusted third party if mentions of self-harm are expressed within a conversation. This feature allows an adult ChatGPT user to designate another person as a trusted contact within their account, such as a friend or family member.

How the Feature Works

In cases where a conversation may turn to self-harm, OpenAI will now encourage the user to reach out to that contact. It also sends an automated alert to the contact, encouraging them to check in with the user. The alert is designed to be brief and to encourage the contact to check in with the person in question, without including detailed information about what was being discussed.

The Data Analysis

• OpenAI has faced a wave of lawsuits from the families of people who have committed suicide after talking with its chatbot.
• In a number of cases, the families say ChatGPT encouraged their loved one to kill themselves — or even helped them plan it out.

The Impact Analysis

The Trusted Contact feature follows the safeguards the company introduced last September that gave parents the power to have some oversight of their teens' accounts, including receiving safety notifications designed to alert the parent if OpenAI's system believes their child is facing a "serious safety risk."

The Prediction

OpenAI's parental controls are also optional, presenting a similar limitation. However, the company claims that every time it receives a safety notification, the incident is reviewed by a human in under one hour. The company will continue to work with clinicians, researchers, and policymakers to improve how AI systems respond when people may be experiencing distress.