Nodes Browser

ComfyDeploy: How demofusion-comfyui works in ComfyUI?

What is demofusion-comfyui?

The Demofusion Custom Node is a wrapper that adapts the work and implementation of the [a/DemoFusion](https://ruoyidu.github.io/demofusion/demofusion.html) technique created and implemented by Ruoyi Du to the Comfyui environment.

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for demofusion-comfyui and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

ComfyUI Demofusion Custom Node

Introduction

The Demofusion Custom Node is a wrapper that adapts the work and implementation of the Demofusion technique created and implemented by Ruoyi Du to the Comfyui environment.

The original paper and official implementations by Ruoyi Du can be found here :

My idea was wrapping Demofusion in a node to be used in ComfyUI, so we could use this amazing tool to experimenting with this technique.

As it it my first ComfyUI custom node, I'm not sure if I'm implementing the best practices, so any comments and/or sugestions are welcome.

Update: Now you can also use local SDXL checkpoints!

If anyone have some ideas about how to do it, again, thank you very much for yor collaboration and tips.

Installing

To install this node, is just like any other one, no special procedures are needed: - Git clone the repository in the ComfyUI/custom_nodes folder - Restart ComfyUI

It's also good to remember that this technique requires a lot of VRAM (plus 18G).

How to use

Here you can see an example of how to use the node example

And here it's the generated image (that can also works as the basic worflow, if you drag and drop it in the Comfyui browser window):

example_2

So far I've only tried to generate square images with 2048x2048 and 3072x3072.

I've also only tried these Huggingface models:

  • stabilityai/stable-diffusion-xl-base-1.0
  • stablediffusionapi/sdxl-unstable-diffusers-y

Being the first one the model used by the author of the technique in his paper and implementation.

Under development

This node is under development, so use it at your own risk. And probably the interface will change a lot, impacting the generated workflows in the future versions.