Sign in

Nodes Browser

ComfyDeploy: How Comfyui_CXH_joy_caption works in ComfyUI?

What is Comfyui_CXH_joy_caption?

Nodes:Joy_caption_load, Joy_caption

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for Comfyui_CXH_joy_caption and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

.2024-9-9 florence2 Add Florence-2-large-PromptGen-v1.5 and MiniCPM3-4B(CXH_MinCP3_4B_Load CXH_MinCP3_4B_Chat) MiniCPM3-4B聊天 翻译，改写都很强

.2024-9-6 florence2 Add Florence-2-base-PromptGen-v1.5

.2024-9-2 更新批量打标案例(Update batch marking cases) 速度：florence2<min2.6<joy

1724901350282

(1).基于comfyui节点图片放推(Recommended based on comfyui node pictures)

1.Joy_caption

2.miniCPMv2_6_prompt_generator

3.florence2

(2).安装(Installation)：

1.（Comfyui evn python.exe） python -m pip install -r requirements.txt or click install_req.bat

注意：transformers 版本不能太低（Note: The version of transformers cannot be too low）

  1. 下载模型或者运行comfyui自动下载模型到合适文件夹(Download the model or run Comfyui to automatically download the model to the appropriate folder)

(3) 模型安装（Install model）

1).Joy_caption

.运行自动下载模型(推荐手动下载) Run automatic download model (manual download recommended)

1.https://huggingface.co/google/siglip-so400m-patch14-384 放到(put in)clip/siglip-so400m-patch14-384

1724901434148

2. https://huggingface.co/unsloth/Meta-Llama-3.1-8B-bnb-4bit 放到(put in)LLM/Meta-Llama-3.1-8B-bnb-4bit

1724901495135

3.必须手动下载(Must be downloaded manually):https://huggingface.co/spaces/fancyfeast/joy-caption-pre-alpha/tree/main/wpkklhc6   (put in)Joy_caption

1724901527482

2).MiniCPMv2_6-prompt-generator + CogFlorence

https://huggingface.co/pzc163/MiniCPMv2_6-prompt-generator

https://huggingface.co/thwri/CogFlorence-2.2-Large

1724902196890

Run with:flux1-dev-Q8_0.gguf

e8ad7fa14f807184a99ea23b31e8a60

1724897220972

1724897584034