Sign in

Nodes Browser

ComfyDeploy: How ComfyUI-IPAnimate works in ComfyUI?

What is ComfyUI-IPAnimate?

This is a project that generates videos frame by frame based on IPAdapter+ControlNet. Unlike [a/Steerable-motion](https://github.com/banodoco/Steerable-Motion), we do not rely on AnimateDiff. This decision is primarily due to the fact that the videos generated by AnimateDiff are often blurry. Through frame-by-frame control using IPAdapter+ControlNet, we can produce higher definition and more controllable videos.

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for ComfyUI-IPAnimate and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

ComfyUI-IPAnimate

  • 这是一个基于IPAdapter+ControlNet逐帧生成视频的工作，与Steerable-motion不同，我们不依赖于AnimateDiff，这主要是考虑到当前AnimateDiff生成的视频较为模糊所决定的。通过IPAdapter+ControlNet的逐帧控制，使得我们可以生成更高清和可控的视频。 输入图片 生成视频

使用介绍

  • 与Steerable-motion结构类似，我们提供了线性和动态两种控制方式，并且提供了外置ControlNet图片的输入，以提供更多的可玩性。

模型

  • 主要参数：
    • 变化帧长度
    • 影响强度范围
    • 相对IPA和CN的影响力度
  • 具体工作流请参考：demo

参考来源