OpenAICEO Sam Altman recently told a conference that new stores appear to be struggling with content moderation, despite GPT Store rules prohibiting it.
On Wednesday, the much-anticipated GPT Store finally launched, becoming a marketplace for AI apps built with OpenAI technology. However, a search for "girlfriend" on the new marketplace turned up at least eight romantic AI chat apps, according to a Quartz analysis.robot, including "Korean Girlfriend", "Virtual Sweetheart", "Your Girlfriend Scarlett" and "Your AI Girlfriend Tsu".
Source Note: The image is generated by AI, and the image is authorized by Midjourney
In fact, OpenAI’s usage policy explicitly states that “GPTs that are dedicated to promoting romantic relationships or performing regulated activities” are not allowed. The company said these policies may be automatically enforced upon submission or applied retroactively.
Despite the appearance of illegal content on the new store, OpenAI has not responded to the issue publicly.
Over the past year, a number of platforms focused on AI companions have quickly risen to prominence. The AI chatbot app Replika, described as “for anyone who wants a friend without judgment, drama, or social anxiety,” has been downloaded more than 10 million times. Some users claim they’ve developed serious emotional attachments to their AI companions, or even fallen in love with them.