Lip Sync Tools

Recently, AI photo "resurrection" has caused quite a stir on the Internet. Heygen finally couldn't wait and started to promote the lip-syncing tool. You only need to upload a photo and an audio clip, and the person in the photo can start talking, singing, or even reading according to the audio content. Moreover, it currently supports up to 20 seconds of audio, which means that you can generate a 20-second video. What's more, this tool can also identify the main sound and ensure that the lip shape and expression in the video are perfectly synchronized with the audio. However, there is a small regret that Heygen seems to have set up...

AniPortrait is an innovative project that generates high-quality animations based on audio and a photo of a reference face. The project works in two steps. 1. AniPortrait extracts 3D intermediate data from the audio and converts this data into a sequence of 2D facial contour markers. This process is the initial phase of the project and lays the foundation for subsequent face animation generation. 2. The project utilizes a powerful diffusion model and combines it with a motion module to transform these facial contour markers into both realistic and smooth face animations. This step is the project...