Sign in

Nodes Browser

ComfyDeploy: How ComfyUI_StreamingT2V works in ComfyUI?

What is ComfyUI_StreamingT2V?

ComfyUI_StreamingT2V

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for ComfyUI_StreamingT2V and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

ComfyUI-StreamingT2V

Painebenjamin created the VidXTend model, which reduces the size from the original 25.6GB to 5GB. When using the VidXTend process, there is no need to manually download the model, as it will be downloaded automatically.

If you use the original model, please download the StreamingT2V model and place it in folder ComfyUI/model/checkpoints

VidXTend (<10G VRAM) | Original (<15G VRAM)

workflow

Recommended complete Workflow

<img src="workflow/wf_final.png" raw=true>

Recommended STAGE 2 Workflow

<img src="workflow/wf_VidXTend.png" raw=true>

Test prompt travel cyclist Workflow

<img src="workflow/wf_prompttravel.png" raw=true>

Open the Auto Queue option, Stop it when you want to.

<img src="workflow/cyclist.png" raw=true> <details> <summary>More Workflow</summary>

Step 1 (It's not necessary.) Generate short video (16x256x256):

You can freely generate a 16x256x256 video without using the process below. You can even use videos downloaded from the internet.

AnimateDiff Option: https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_short_ad.json

<img src="workflow/wf_short_ad.png" raw=true>

Modelscope Option: https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_short_ms.json

<img src="workflow/wf_short_ms.png" raw=true>

SVD Option: https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_short_svd.json

<img src="workflow/wf_short_svd.png" raw=true>

Step 2 Generate long video (nx256x256):

VidXTend Option: https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_VidXTend.json

<img src="workflow/wf_VidXTend.png" raw=true>

Original Option: https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_long.json

<img src="workflow/wf_long.png" raw=true>

Step 3 Generate long enhanced video (nx512x512):

https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_enhance.json

<img src="workflow/wf_enhance.png" raw=true>

You can generate all by one workflow (MORE VRAM)

ModelscopeT2V (T2V)

https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf.json

<img src="workflow/wf.png" raw=true>

AnimateDiff (T2V)

https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_ad.json

<img src="workflow/wf_ad.png" raw=true>

SVD (I2V)

https://github.com/chaojie/ComfyUI_StreamingT2V/blob/main/workflow/wf_svd.json

<img src="workflow/wf_svd.png" raw=true>

StreamingT2V

</details>