OpenAI Exploring How ChatGPT Can 'Responsibly' Generate Porn
A document about OpenAI's approach to guiding its AI models suggests it sees an opportunity in building an adults-only mode for ChatGPT and its other AI-related products.
UPDATE: OpenAI says it has "no intention to create AI-generated pornography." Rather, the company is considering more age-appropriate experiences for its products.
"We have no intention to create AI-generated pornography. We have strong safeguards in our products to prevent deepfakes, which are unacceptable, and we prioritize protecting children," a company spokesperson told PCMag. "We also believe in the importance of carefully exploring conversations about sexuality in age-appropriate contexts."
AI-generated porn has made headlines for stealing people's likenesses to create deepfake nudes. But ChatGPT maker OpenAI is still thinking about expanding into adult content.
A new document that explains OpenAI's approach to guiding its AI models, including ChatGPT's behavior, mentions that it’s looking at ways to produce AI-generated porn.
This "Model Spec" document notes that ChatGPT currently blocks Not Safe For Work requests, including "erotica, extreme gore, slurs, and unsolicited profanity." But it looks like OpenAI is considering lifting the ban for older, more mature user groups.
"We're exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts through the API and ChatGPT. We look forward to better understanding user and societal expectations of model behavior in this area,” OpenAI wrote in the document, which was first spotted by Wired.
So far, OpenAI hasn't said much else, including if the AI-generated porn will cover both text and images. Still, the disclosure suggests that the company is developing an adults-only mode for ChatGPT, freeing up the chatbot to respond with a wider array of content. (The paid ChatGPT Plus can generate images and text.)
The news also suggests OpenAI sees a lucrative opportunity to serve the adult entertainment market through its API, which can power generative AI for third-party apps and services. However, producing AI-generated porn responsibly is filled with challenges.
Perhaps the biggest is that people can abuse AI image generators to create porn that looks like real people without their permission, whether it be celebrities or children. The result could expose OpenAI to even more legal action when the company already faces several copyright lawsuits for allegedly training ChatGPT on data it scraped from the web.