Sign in

Nodes Browser

ComfyDeploy: How comfyui_face_parsing works in ComfyUI?

What is comfyui_face_parsing?

This is a set of custom nodes for ComfyUI. The nodes utilize the [a/face parsing model](https://huggingface.co/jonathandinu/face-parsing) to provide detailed segmantation of face. To improve face segmantation accuracy, [a/yolov8 face model](https://huggingface.co/Bingsu/adetailer/) is used to first extract face from an image. There are also auxiliary nodes for image and mask processing. A guided filter is also provided for skin smoothing.

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for comfyui_face_parsing and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

Introduction

This is a set of custom nodes for ComfyUI. The nodes utilize the face parsing model to provide detailed segmantation of face. To improve face segmantation accuracy, yolov8 face model is used to first extract face from an image.

There are also auxiliary nodes for image and mask processing. A guided filter is also provided for skin smoothing.

If you encounter any problems, feel free to open an issue. I'll try to fix it when I'm not busy. Besides, if you like the nodes, please give a star, thanks!

Installation

Just clone the repo https://github.com/Ryuukeisyou/comfyui_face_parsing.git into ComfyUI's "custom_nodes" directory.

On first run, some required files will be downloaded to ComfyUI's "models/face_parsing/" folder and "models/ultralytics/bbox" folder. If you have difficulty connecting to Huggingface, you can try mannually:

  1. Download the .json and .safetensors files from the face parsing model repo and save them to the "models/face_parsing/" folder.
  2. Download the face_yolov8m.pt from the Bingsu/adetailer repo and save it to "models/ultralytics/bbox" folder.

Requirements

See requirements.txt. Specially, opencv-contrib-python is needed for guided filter. If you have other versions of opencv e.g. opencv-python-headless installed after open-contrib-python, you may need to uninstall opencv-contrib-python and reinstall it again. Note: If you don't need guided filter, you can just forget about opencv-contrib-python, as it is often conflicted by other opencv versions.

Workflow

a demo work flow is shown below.

<img src="demo/workflow.png"> <table> <tr> <th>Original</th> <th>Processed</th> </tr> <!-- Line 1: Compare --> <tr> <td><img src="demo/original.jpg" height="256" width="256"></td> <td><img src="demo/processed.png" height="256" width="256"></td> </tr> </table>

This image contains the workflow which can be loaded into ComfyUI.

<img src="demo/processed.png" height="256" width="256">