GoogleLast week, the Pixel 9 series of smartphones was released, which includes a series of new features centered on artificial intelligence. All Pixel 9 phones support Gemini Artificial intelligence, Google also added AI-based image generation and editing tools. However, after reviewers tested these new features, they found that AI image generation is likely to become a public relations nightmare for Google.
It is understood that Google has launched an AI image generation application called Pixel Studio for Pixel phones, which can create stickers and images through text prompts, and its function is very similar to the Image Playground that Apple plans to launch.Reviewers were able to use Pixel Studio to create a variety of disturbing images, including a Nazi version of SpongeBob and Elmo holding an AK47..
The reviewers from Digital Trends had no trouble getting Pixel Studio to generate images of cartoon characters engaging in questionable activities, guns, drugs, and alcohol, and even offensive scenes like school shootings. Pixel Studio doesn't generate these images on its own, but requires the user to enter a description. However, this is what people are most likely to do, rather than generating images of cute cats and bunnies.
Google said it has taken "safety checks" to prevent Pixel Studio from being "used maliciously," and it's working. For example, Pixel Studio currently can't generate images of people, and Google is adjusting the AI model based on review feedback. After communicating with Google, Digital Trends can no longer use Pixel Studio to generate images of cartoon characters taking cocaine or wearing German soldier costumes.
Even more worrying than Pixel Studio is Google's "Reimagine" tool, which adds objects to photos you've already taken.Reviewers from The Verge used it to add dead bodies, bombs, drugs, and disaster scenes to images., and these additions look so realistic that it’s hard to tell if the image has been edited.Google has done a great job matching the lighting and perspectiveThere are no watermarks or tags visible on social media. While Google does add metadata tags, they are easily removed by taking a screenshot.
The Verge points out that it was previously possible to add a dead body to an image or create an image of Elmo holding a gun, but this required some Photoshop skills and time. Pixel phones,With just a few seconds of thought, anyone can create an image like this, which is worrying.
In a statement to The Verge and Digital Trends, Google said that when they designed their generative AI tools,is "to respect the intent of the user prompt", which could result in the user asking for "objectionable" content. But Google claims that its "Terms of Service" stipulate that the content that is not allowed to be generated, and they will continue to improve relevant safeguards.