Nodes Browser

ComfyDeploy: How ComfyUI-LaVIT works in ComfyUI?

What is ComfyUI-LaVIT?

Nodes:VideoLaVITLoader, VideoLaVITT2V, VideoLaVITI2V, VideoLaVITI2VLong, VideoLaVITT2VLong, VideoLaVITI2I

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for ComfyUI-LaVIT and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

ComfyUI-LaVIT

workflow

T2V

T2V

<img src="wf_t2v.png" raw=true>

I2V

I2V

<img src="wf_i2v.png" raw=true>

T2V Long Video

T2V Long

<img src="wf_t2v_long.png" raw=true>

Video Reconstruction

Video Reconstruction

<img src="wf_videoreconstruction.png" raw=true>

Model Weights

 huggingface-cli download --resume-download rain1011/Video-LaVIT-v1 --local-dir ~/ComfyUI/models/diffusers/Video-LaVIT-v1 --local-dir-use-symlinks False

Notes

Width and height must be multiples of 64

LaVIT