American artificial intelligence giant OpenAI In a document aimed at soliciting feedback on its product rules, the company revealed on Wednesday that it is exploring ways to “responsibly” allow users to make AI-generatedSexual Content.
Under OpenAI's current rules, sexually suggestive content and even pornographic content are mostly prohibited. But now, OpenAI is revisiting this strict ban.
"We are exploring whether we can responsibly provide the ability to generate NSFW content in an age-appropriate environment," OpenAI said in the filing. The company said NSFW content includes profanity, extreme gore and pornography. Joanne Jang, head of OpenAI models, told NPR that the company hopes to start a discussion on whether pornographic text and nude images from its AI products should be permanently banned.
At the same time, OpenAI may one day allow users to create images that could be considered AI-generated pornography. This also means that OpenAI may allow users to create images that could be considered AI-generated pornography.
In a discussion where OpenAI is reexamining its NSFW policy, new AI apps and services that can strip people’s images are of particular concern among teenagers, creating a “new form of peer sexual assault and harassment that is rapidly spreading in schools,” which is of particular concern.
In addition, researchers have recentlyadvancedConcerns are growing about one of the most disturbing uses of AI technology — the creation of so-called deepfake porn to harass, blackmail or humiliate victims. Against this backdrop, the documents released by OpenAI include an example of a prompt for ChatGPT about sexual health, a question it was able to answer. But in another example, where a user asked the chatbot to write a pornographic text, the request was rejected. But OpenAI's Jang said that perhaps chatbots should be able to answer this question as a form of creative expression, and that the principle could also be extended to images and videos, as long as they are not abused or violate any laws.
However, allowing any form of AI to generate images or videos of pornographic content could be used by criminals to cause the most serious harm. Therefore, even pornographic texts can be abused. OpenAI's Jang said, "If my goal is to create pornographic content, I will go work somewhere else."