TencentHunyuan UnionHKUST,Tsinghua UniversityLaunched the portrait animation generation framework "Follow Your Emoji", which can transform a photo into a "lively" facial animation.Capture subtle changes in facial expressions.
Attached paper address:https://arxiv.org/html/2406.01900v1
Project address:https://follow-your-emoji.github.io/
Based on algorithm innovation and data accumulation, "Follow Your Emoji" can supportFine-grained control of the face, including eyebrows, eyeballs, rolling eyes and other details, animal emojis can also be easily "grasped". In addition, Follow Your Emoji not only supports the generation of multiple portraits of a single expression, but also supportsGeneration of multiple expressions from a single portrait.
▲ The leftmost picture is the original picture
“Follow Your Emoji” has the following features:
-
Identity Preservation: Ensure that the identity features of the reference avatar are not lost during the animation generation process.
-
Rich Expressions: Generate a variety of exaggerated and subtle expressions, such as large pupil movements.
-
Various styles: Supports multiple styles of avatar animation, including cartoon, realistic, sculpture or animal styles.
-
Stable and persistent: Use a progressive generation strategy to ensure the stability and consistency of long-term animations.