Nodes Browser

ComfyDeploy: How ComfyUI PhotoMaker Plus works in ComfyUI?

What is ComfyUI PhotoMaker Plus?

ComfyUI reference implementation for [a/PhotoMaker](https://github.com/TencentARC/PhotoMaker) models. NOTE: PhotoMaker V2 is supported.

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for ComfyUI PhotoMaker Plus and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

ComfyUI PhotoMaker Plus

ComfyUI implementation for PhotoMaker.

PhotoMaker implementation that follows the ComfyUI way of doing things. The code is memory efficient, fast, and shouldn't break with Comfy updates.

<div align="center"> <img width="1261" alt="example workflow" src="https://github.com/user-attachments/assets/0b05d24f-ec3a-4be7-9e93-9169c66c65f5"> </div>

Installation

  1. Install ComfyUI.
  2. Install onnxruntime and insightface.
  3. Install through ComfyUI Manager or clone this repo into custom_nodes by running the following commands in a terminal:
    cd ComfyUI/custom_nodes
    git clone https://github.com/shiimizu/ComfyUI-PhotoMaker-Plus.git
    
  4. Download the model(s) from Hugging Face (V1, V2) and place it in a photomaker folder in your models folder such as ComfyUI/models/photomaker.
  5. Check out the example workflows.

Features of this Plus version

  • Better face resemblance by using CLIPImageProcessor like in the original code.
  • Customizable trigger word
  • Allows multiple trigger words in the prompt
  • Extra nodes such as PhotoMakerStyles and PrepImagesForClipVisionFromPath

Important news

2024-09-01

  • A PhotoMakerLoraLoaderPlus node was added. Use that to load the LoRA.

2024-07-26

  • Support for PhotoMaker V2. This uses InsightFace, so make sure to use the new PhotoMakerLoaderPlus and PhotoMakerInsightFaceLoader nodes.

2024-01-24

  • Official support for PhotoMaker landed in ComfyUI. Therefore, this repo's name has been changed. The PhotoMakerEncode node is also now PhotoMakerEncodePlus.

2024-01-21

  • Due to various node updates and changes, you may have to recreate the node.
  • Removed ref_images_path input. Added a PrepImagesForClipVisionFromPath node.

2024-01-18

  • No need to manually extract the LoRA that's inside the model anymore.

Citation

@article{li2023photomaker,
  title={PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding},
  author={Li, Zhen and Cao, Mingdeng and Wang, Xintao and Qi, Zhongang and Cheng, Ming-Ming and Shan, Ying},
  booktitle={arXiv preprint arxiv:2312.04461},
  year={2023}
}