Sign in

Nodes Browser

ComfyDeploy: How GKK·Sonic works in ComfyUI?

What is GKK·Sonic?

a plugin of ComfyUI for Long Sonic

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for GKK·Sonic and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

ComfyUI_Sonic

Sonic is a method about ' Shifting Focus to Global Audio Perception in Portrait Animation',
You can produce video as long as you want by text with this comfyUI compentent

Installation

In the ./ComfyUI/custom_node directory, run the following:

git clone https://github.com/benda1989/Sonic_ComfyUI.git
cd Sonic_ComfyUI
pip install -r requirements.txt

Model

Download model same as Sonic, and file tree looks like this:

--  ComfyUI/models/sonic/
    |-- audio2bucket.pth
    |-- audio2token.pth
    |-- unet.pth
    |-- yoloface_v5m.pt
    |-- whisper-tiny/
        |--config.json
        |--model.safetensors
        |--preprocessor_config.json
    |-- RIFE/
        |--flownet.pkl
--  ComfyUI/models/checkpoints
    ├── svd_xt.safetensors  or  svd_xt_1_1.safetensors

Example

1 Base usage, audio to video

2 Adv usage, text to video

example gpu usage

Thanks

Sonic
ComfyUI_Sonic