Sign in

Nodes Browser

ComfyDeploy: How ComfyUI_Pic2Story works in ComfyUI?

What is ComfyUI_Pic2Story?

you can using pic2story in comfyUI

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for ComfyUI_Pic2Story and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

ComfyUI_Pic2Story

ComfyUI simple node based on BLIP method, with the function of "Image to Txt " .

Original model: link
Using model: link

1.Installation

1.1 In the .\ComfyUI \ custom_node directory, run the following:

git clone https://github.com/smthemex/ComfyUI_Pic2Story.git

1.2 using repo_id or offline

repo_id: abhijit2111/Pic2Story link
repo_id: google/paligemma2-3b-pt-896 link

2.Example

Prompt is not necessary! 提示词不是必须的,可以去掉.

4.Citation

@misc{https://doi.org/10.48550/arxiv.2201.12086,
  doi = {10.48550/ARXIV.2201.12086},
  
  url = {https://arxiv.org/abs/2201.12086},
  
  author = {Li, Junnan and Li, Dongxu and Xiong, Caiming and Hoi, Steven},
  
  keywords = {Computer Vision and Pattern Recognition (cs.CV), FOS: Computer and information sciences, FOS: Computer and information sciences},
  
  title = {BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation},
  
  publisher = {arXiv},
  
  year = {2022},
  
  copyright = {Creative Commons Attribution 4.0 International}
}