According to The New York Times, starting next month,Meta Will be its Ray-Ban Smart glassesIt brings a series of multimodal AI functions, including translation, object recognition, animal and scene recognition, etc., and entered the early testing stage in December last year.
Users can activate the glasses' built-in AI assistant by simply saying "Hey Meta" and saying a prompt word or asking a question, and then respond through the built-in speaker of the frame. The New York Times found that in a variety of scenarios such as in grocery stores, while driving, or in museums and zoos,The glasses can correctly identify pets and works of art, but not 100% correctly., such as difficulty identifying animals at a distance or in a cage.
In terms of translation function, the glasses support translation in English, Spanish, Italian, French and German.
Meta CEO Mark Zuckerberg revealed the feature in an interview with The Verge last September, saying people can "ask the Meta AI assistant all kinds of questions all day long," suggesting it could answer questions the wearer has about what they're seeing or where they are.
Meta CTO Andrew Bosworth also demonstrated this in a video AI Assistant, for example, it can accurately identify and describe a California shape sculpture on a wall. He also explained other features, including having the assistant help add descriptions to photos taken, or translations and summaries, which are also common in other products from companies such as Microsoft and Google.
Currently, the glasses’ AI capabilities are only available to “a small number of opt-in users” in the United States and are still in testing mode.