Sign in

Nodes Browser

ComfyDeploy: How ComfyUI-Diffusers works in ComfyUI?

What is ComfyUI-Diffusers?

This extension enables the use of the diffuser pipeline in ComfyUI.

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for ComfyUI-Diffusers and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

ComfyUI-Diffusers

This repository is a custom node in ComfyUI.

Overview

Workflow 1

This is a program that allows you to use Hugging Face Diffusers module with ComfyUI. Additionally, Stream Diffusion is also available.

Workflow

Workflow 2

In addition, real-time generation is possible by doing the following. When running, please enable Auto Queue in Extra options.

Workflow2

Workflow 3

In combination with VideoHelperSuite, you can also run vid2vid.

Workflow3

The execution looks like this:

Workflow3demo

Usage

Run the following command inside ComfyUI/custom_nodes.

git clone https://github.com/Limitex/ComfyUI-Diffusers.git
cd ComfyUI-Diffusers
pip install -r requirements.txt
git clone https://github.com/cumulo-autumn/StreamDiffusion.git
python -m streamdiffusion.tools.install-tensorrt

Recommended Custom Nodes

https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite.git

Node

Diffusers Pipeline Loader (DiffusersPipelineLoader)

Diffusers Vae Loader (DiffusersVaeLoader)

Diffusers Scheduler Loader (DiffusersSchedulerLoader)

Diffusers Model Makeup (DiffusersModelMakeup)

Diffusers Clip Text Encode (DiffusersClipTextEncode)

Diffusers Sampler (DiffusersSampler)

Create Int List (CreateIntListNode)

LcmLoraLoader (LcmLoraLoader)

StreamDiffusion Create Stream (StreamDiffusionCreateStream)

StreamDiffusion Sampler (StreamDiffusionSampler)

StreamDiffusion Warmup (StreamDiffusionWarmup)

StreamDiffusion Fast Sampler (StreamDiffusionFastSampler)

Reference

https://github.com/cumulo-autumn/StreamDiffusion