Sign in

Nodes Browser

ComfyDeploy: How ComfyUI-RefSampling works in ComfyUI?

What is ComfyUI-RefSampling?

Nodes:Apply Ref UNet, Ref Sampler, Ref Sampler Custom

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for ComfyUI-RefSampling and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

ComfyUI-RefSampling

This is a proof-of-concept repo that implements:

  • "Reference CNet" found in popular Image generation applications such as Automatic11
    • Allows image generation that adheres content to a reference image
  • Visual Style Prompting
    • Allows image generation that adheres style to a reference image

Both of these techniques utilize attention injection from reference images into the sampled/generated image.

Examples

Text to Image Generation

Image Prompt: "orange gorilla stripes"

Visual Style Prompt: "black and orange stripes"

ref_sampling

Image to Image Generation

Image Prompt: "an old man"

Visual Style Prompt "blue dragon, flames"

input_image

ref_sampling_img