AliYun announced that the EMO model was successfullyTongyi APPIt is now online and completely open to all users for free.
Now, in the Tongyi Qianwen APP, users only need to follow three simple steps: select a template, upload photos, and generate videos, and they can easily realize the magical effects of the characters in the photos acting and singing.Miraculous Effectfruit.
Tongyi APP launched as many as 80 EMO templates in the first batch, covering a variety of content such as popular songs, Internet memes, etc. Users can choose preset audio to generate videos, but user-defined audio is not currently supported.
The EMO model is carefully developed by Tongyi LaboratoryAI ModelsThe portrait speaking technology behind it is currentlyAIGCA hot topic in the field. Compared with the traditional Talking Head technology, the EMO model adopts an innovative weak control design, which can easily drive the portrait to speak without tedious 3D modeling of the face, head or body parts. This not only greatly reduces the cost of video generation, but also significantly improves the quality of the video.
The EMO model has a strong learning ability and can encode the ability of humans to express emotions. It can accurately match the audio content with the character's facial expressions and mouth shape, and can even delicately reflect the tone characteristics and emotional colors of the audio on the character's micro-expressions, making the generated video more vivid and realistic.
Since Tongyi Lab published a related paper at the end of February, the EMO model has received widespread attention and has become one of the most watched AI models after Sora. In the future, EMO technology is expected to play a huge potential in many fields such as digital humans, digital education, film and television production, virtual companionship, and e-commerce live broadcasting.
Tongyi APP has been committed to providing users with free experience of cutting-edge models. In addition to the EMO model, Tongyi APP has also launched many phenomenal applications, such as "National Dance King", "Terracotta Warriors Dancing Subject 3", "Golden Hair Dancing", etc. The models behind these applications are also from Tongyi Laboratory. In addition, Tongyi APP continues to launch practical functions, such as super-long document parsing, AI coding assistant, AI conference assistant, etc., to provide users with a full range ofsuperAI assistant service.