Lip Sync

Ant Group open-sourced a new project called EchoMimic on the 10th, which can help people "lip-sync" through facial features and audio, and combine facial landmarks and audio content to generate relatively stable and natural videos. The project has high stability and naturalness. By integrating the features of audio and facial landmarks (key facial features and structures, usually located in the eyes, nose, mouth, etc.), it can generate videos that are more in line with real facial movements and expression changes. It supports the use of audio or facial landmarks alone to generate portrait videos, and also supports combining audio and portrait photos to make "lip-syncing...