Sign in

Nodes Browser

ComfyDeploy: How ComfyUI MiniCPM-V works in ComfyUI?

What is ComfyUI MiniCPM-V?

Unofficial implementation of [a/MiniCPM-V](https://github.com/OpenBMB/MiniCPM-V) for ComfyUI

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for ComfyUI MiniCPM-V and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

ComfyUI MiniCPM-V (Unofficial Support)

Unofficial MiniCPM-V support for ComfyUI.

Important Updates

  • 2024/08/09: Added support for MiniCPM-V 2.6 (16GB+ video memory required)
  • 2024/05/22: Added support for MiniCPM-Llama3-V 2.5 (16GB+ video memory required)
  • 2024/04/18: Added ComfyUI nodes and workflow examples

Basic Workflow

This workflow shows the basic usage on querying an image with Chinese and English.

Version 2.6 Workflow

This workflow shows the Verson 2.6's usage on querying multiple images and a video.

Installation

  • Install from ComfyUI Manager (search for minicpm)

  • Download or git clone this repository into the ComfyUI/custom_nodes/ directory and run:

pip install -r requirements.txt

Download Checkpoints

All the models will be downloaded automatically, no worries.