ComfyDeploy: How NodeGPT works in ComfyUI?

What is NodeGPT?

Implementation of AutoGen inside ComfyUI. This repository is under development, and not everything is functioning correctly yet.

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for NodeGPT and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

NodeGPT

Implementation of AutoGen inside ComfyUI.

This repository is under development, and not everything is functioning correctly yet.

Dont share your workflow with any API keys inside!!!

Example of Agents

Screenshot 2023-10-16 171331

Screenshot 2023-10-16 165601 The example above should work mostly after installation. The output is displayed in the terminal, and the workflow can be found in the repository (Task_Solving_with_Code_Generation.json).

Screenshot 2023-10-16 165434

Features

  • autogen: Automated Multi Agent Chat

  • Automated Task Solving with Code Generation, Execution & Debugging

  • Automated Complex Task Solving by Group Chat

  • New: llama-cpp (slow), llava

To Do

  • Functions

  • MemGPT (NotWorkingFolder)

Installing

please let me now if you have any issus installing.

Install: https://github.com/comfyanonymous/ComfyUI

I would recomend using LM Studio: https://lmstudio.ai/

Git clone the repository: git clone https://github.com/xXAdonesXx/NodeGPT into the "custom nodes" folder inside ComfyUI

Upon starting, ComfyUI should install the requirements.

Troubleshooting

Try running the Update.bat inside ComfyUI\custom_nodes\NodeGPT

Usage

Start the LM Studio Server

Start ComfUI and place nodes.

For llava:

https://huggingface.co/mys/ggml_llava-v1.5-7b

Contributing

Pull requests, suggestions, and issue reports are welcome.

Credits

LM Studio

ComfyUI: https://github.com/comfyanonymous/ComfyUI

oobabooga: https://github.com/oobabooga/text-generation-webui

chatGPT: https://chat.openai.com/chat

autogen: https://github.com/microsoft/autogen