Hallo

Fudan open source project Hallo, a project that generates speaking videos based on audio and pictures, has been adapted to the ComfyUI plug-in. Although the installation process requires many dependencies and the threshold is relatively high, the emergence of this open source ecosystem provides more possibilities and fun for subsequent redrawing and other processes. The Hallo project can make facial photos start talking by inputting audio, accompanied by corresponding expressions, and the effect looks very natural. This project adopts an end-to-end diffusion paradigm and introduces a layered audio-driven visual synthesis module to improve the connection between audio input and visual output...