OpenAI, the company behind ChatGPT, declared in October that it will be opening the floodgates for “mature apps.”
“We will be able to safely relax the restrictions in most cases now that we have been able to mitigate the serious mental health issues and have new tools,” he tweeted at the time. “We will allow even more, like erotica for verified adults, as part of our ‘treat adult users like adults’ principle,” Altman continued.
Five months later, a “adult mode” chatbot that is willing to discuss issues that have previously been off-limits on ChatGPT — a move described by critics as a tactic to generate revenue in light of some terrible financials — has yet to appear.
According to the Wall Street Journal, the subject continues to send shivers down the spines of company consultants, who are concerned about the numerous possible risks of allowing OpenAI’s already-hooked clients to engage in intimately sensitive chats.
In fact, many employees and executives were allegedly taken aback by Altman’s statement in the first place, ruling out an immediate launch.
Despite several warnings and internal disputes about the consequences, including users becoming overly emotionally hooked to compulsive use, OpenAI is allegedly still moving forward. (Earlier this month, the business admitted that the debut of adult mode would be delayed due to other items being prioritized.)
There are still several obvious security flaws. According to insiders, the company’s new age-prediction technology has been incorrectly categorizing kids as adults 12% of the time. Even while that might not seem like much, millions of minors may be accessing inappropriate discussions due to ChatGPT’s massive user base.
OpenAI is playing it relatively safe by limiting heated interactions to text in an attempt to keep nonconsensual sexual photos off the site, something rival Elon Musk’s xAI has been struggling with.
Additionally, by portraying its new feature as a means of producing something found in romance novels, it is attempting to dominate the narrative. Its erotica conversations are more like “smut rather than pornography,” a spokesperson told.
Also, the spokesperson promised that consumers will be encouraged to pursue relationships in real life.
Although Altman asserts that “serious mental health issues” are no longer an issue for OpenAI, a plethora of evidence indicates otherwise. Therefore, it is unclear how OpenAI’s “adult mode” will perform given the company’s dubious track record of putting in place effective guardrails and censoring explicit content.
If xAI’s Grok is any indication, the risks are significant. Users have been using the chatbot to unclothe actual persons, resulting in a torrent of nonconsensual pornographic photographs on the mostly unmoderated social media platform.
Its persistent issues with child sex abuse material (CSAM) culminated in a lawsuit filed today in the Northern District of California on behalf of three teenagers, two of whom are minors. The plaintiffs accuse xAI of creating an environment that enabled the proliferation of CSAM.
There have also been numerous reports of users developing strong relationships with AI chatbots. Underage users are especially vulnerable, as they frequently form strong ties without their parents’ awareness.
In severe instances, the issue has been connected to a number of tragic teenage suicides, leading to a number of well-publicized lawsuits against OpenAI and its rivals.
To put it briefly, OpenAI is very aware of the hazards involved with implementing its “adult mode” function.
However, the WSJ claims that it intends to begin in about a month.
The business told the publication, “We still believe in the principle of treating adults like adults, but getting the experience right will take more time.”
The Blockgeni Editorial Team tracks the latest developments across artificial intelligence, blockchain, machine learning and data engineering. Our editors monitor hundreds of sources daily to surface the most relevant news, research and tutorials for developers, investors and tech professionals. Blockgeni is part of the SKILL BLOCK Group of Companies.
More articles
