Nodes Browser

ComfyDeploy: How ComfyUI-Transformers-Pipeline works in ComfyUI?

What is ComfyUI-Transformers-Pipeline?

Additional ComfyUI nodes to utilise the Transformers pipeline in a simple and modular way.

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for ComfyUI-Transformers-Pipeline and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

ComfyUI Transformers Pipeline

Overview

A collection of additional ComfyUI nodes for utilizing the Hugging Face Transformers pipeline in a modular and efficient manner.

Installation

Can be installed through the ComfyUI manager or ComfyUI cli

Nodes

Primary Nodes

  • Model Loader: Loads transformer models.
  • Caption Generator: Generates image captions.
  • Batch Processor: Simple node to specify and handle lists to batch processing.
  • Export Captions: Simple node to save text output to files based on original file input names.

Utility Nodes

  • Debug Node: Allows connecting list nodes to a text output to view node outputs
  • Debug Model Node: Allows connecting the model loader node to a text output to view node outputs and check configuration
  • EXIF Metadata Extractor: Extracts camera metadata from images.
  • Task List Node: Provides preset transformer tasks.

TODO

Short Term

  • ⬜ Add tooltips nodes.
  • ⬜ Move pipeline nodes into its own folders (that’s our primary focus really) with non-pipeline tasks separated.
  • ⬜ fix logging to possibly Python’s logging module.
  • ⬜ Add additional example nodes

Long Term

  • ✅ Register in ComfyUI registry
  • ⬜ look into multi-pass captions or outputs
  • ⬜ add additional pipeline tasks
  • ⬜ add multimodal tasks to the mix
  • ⬜ Add additional output nodes
  • ⬜ Allow setting different file extensions for output

Contributing

Pull requests are welcome. As well as Ideas, suggestions, anything at all. What works, what doesn’t, etc.

License

Please see license file.