Sign in

Nodes Browser

ComfyDeploy: How ComfyUI_Patches_ll works in ComfyUI?

What is ComfyUI_Patches_ll?

Some patches for Flux|HunYuanVideo|LTXVideo etc, support TeaCache, PuLID, First Block Cache.

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for ComfyUI_Patches_ll and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

中文文档

Add some hooks method. Such as: TeaCache and First Block Cache for PuLID-Flux Flux HunYuanVideo LTXVideo MochiVideo WanVideo.

Need upgrade ComfyUI Version>=0.3.17

Preview (Image with WorkFlow)

save api extended

Working with PuLID (need my other custom nodes ComfyUI_PuLID_Flux_ll) save api extended

Install

  • Manual
    cd custom_nodes
    git clone https://github.com/lldacing/ComfyUI_Patches_ll.git
    # restart ComfyUI

Nodes

  • FluxForwardOverrider
    • Add some hooks method support to the Flux model
  • VideoForwardOverrider
    • Add some hooks method support to the video model. Support HunYuanVideo, LTXVideo, MochiVideo, WanVideo
  • DitForwardOverrider
    • Auto add some hooks method for model (automatically identify model type). Support Flux, HunYuanVideo, LTXVideo, MochiVideo, WanVideo
  • ApplyTeaCachePatch
    • Use the hooks provided in *ForwardOverrider to support TeaCache acceleration. Support Flux, HunYuanVideo, LTXVideo, MochiVideo, WanVideo
    • In my test results, the video quality is not good after acceleration for MochiVideo
  • ApplyTeaCachePatchAdvanced
    • Support start_at and end_at
  • ApplyFirstBlockCachePatch
    • Use the hooks provided in *ForwardOverrider to support First Block Cache acceleration. Support Flux, HunYuanVideo, LTXVideo, MochiVideo, WanVideo
    • In my test results, the video quality is not good after acceleration for MochiVideo
  • ApplyFirstBlockCachePatchAdvanced
    • Support start_at and end_at

SpeedUp reference

TeaCache (rel_l1_thresh value)

| | Original | 1.5x | 1.8x | 2.0x | |--------------|----------|------|------|------| | Flux | 0 | 0.25 | 0.4 | 0.6 | | HunYuanVideo | 0 | 0.1 | - | 0.15 | | LTXVideo | 0 | 0.03 | - | 0.05 | | MochiVideo | 0 | 0.06 | - | 0.09 | | WanVideo | 0 | - | - | - |

Note: "-" indicates small speedup, low quality or untested. WanVideo's different models have different acceleration effects.

First Block Cache (residual_diff_threshold value)

| | Original | 1.2x | 1.5x | 1.8x | |--------------|----------|------|------|------| | Flux | 0 | - | - | 0.12 | | HunYuanVideo | 0 | - | 0.1 | - | | LTXVideo | 0 | 0.05 | - | - | | MochiVideo | 0 | - | 0.03 | - | | WanVideo | 0 | - | 0.05 | - |

Note: "-" indicates small speedup, low quality or untested.

Thanks

TeaCache
ParaAttention
Comfy-WaveSpeed