In a Reddit Q&A, OpenAI CEO Sam Altman let slip that he wants the company to be able to generate “NSFW stuff” for users — and he has examples of just what kind of “stuff” he means.
During the exchange, which took place in the r/ChatGPT subreddit over the weekend after OpenAI published its “Model Spec” document outlining its governing rules, another user asked Altman to expound on a curious disclaimer in the document, stipulating that its models “should not serve content” that’s NSFW, including “erotica, extreme gore, slurs, and unsolicited profanity.”
“We believe developers and users should have the flexibility to use our services as they see fit, so long as they comply with our usage policies,” the spec reads. “We’re exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts through the API and ChatGPT. We look forward to better understanding user and societal expectations of model behavior in this area.”
Fascinatingly, Altman was dived right in.
“We really want to get to a place where we can enable NSFW stuff (e.g. text erotica, gore) for your personal use in most cases,” he wrote, “but not do stuff like make deepfakes.”
Unsurprisingly, the comments in that follow-up thread showed Redditors veritably salivating over the concept of OpenAI-produced gore and erotica, with one calling Altman “sam basedman” and another referring to the CEO as the new “king of Reddit.”
I don’t really see the harm in that, if someone wants to erp an ai, they’ll find a way. If I remember correctly, OpenAI already isn’t all that rigorous with banning people who break the ToS in that way.
I don’t get the reactions as well. Are we pretending there is a lot of gore and erotic content in media??? Just because this is choose your own adventure its different. Oh if a writer writes a gory story with T and A to sell to others thats fine but someon asks a computer program to whip up a custom one and now its “creepy”