Sign in

Nodes Browser

ComfyDeploy: How ComfyUI Dreamtalk works in ComfyUI?

What is ComfyUI Dreamtalk?

Unofficial implementation of [a/dreamtalk](https://github.com/ali-vilab/dreamtalk) for ComfyUI

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for ComfyUI Dreamtalk and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

ComfyUI Dreamtalk (Unofficial Support)

Unofficial Dreamtalk support for ComfyUI.

Important Updates

  • 2024/03/29: Added installation from ComfyUI Manager
  • 2024/03/28: Added ComfyUI nodes and workflow examples

Basic Workflow

This workflow shows the basic usage on making an image into a talking face video.

Advanced Workflow

This workflow shows the advanced usage on making the whole image talking, instead of just a cropped face.

Installation

  • Install from ComfyUI Manager (search for dreamtalk, make sure ffmpeg is installed)

  • Download or git clone this repository into the ComfyUI/custom_nodes/ directory and run:

sudo apt install ffmpeg
pip install -r requirements.txt

Download Checkpoints

Put the downloaded denoising_network.pth and renderer.pt into checkpoints folder.

Above two files can be requested from the original author as follows:

In light of the social impact, we have ceased public download access to checkpoints. If you want to obtain the checkpoints, please request it by emailing mayf18@mails.tsinghua.edu.cn . It is important to note that sending this email implies your consent to use the provided method solely for academic research purposes.