Sign in

Nodes Browser

ComfyDeploy: How ComfyUI-Hangover-Moondream works in ComfyUI?

What is ComfyUI-Hangover-Moondream?

Moondream is a lightweight multimodal large language model. [w/WARN:Additional python code will be downloaded from huggingface and executed. You have to trust this creator if you want to use this node!]

How to install it in ComfyDeploy?

Head over to the machine page

  1. Click on the "Create a new machine" button
  2. Select the Edit build steps
  3. Add a new step -> Custom Node
  4. Search for ComfyUI-Hangover-Moondream and select it
  5. Close the build step dialig and then click on the "Save" button to rebuild the machine

ConfyUI-Hangover-Moondream

Moondream is a lightweight multimodal large languge model.

⚠️ WARNING: Additional python code will be downloaded from huggingface and executed. You have to trust this creator if you want to use this node!

Alt text

👍 For testing, research and fun.

Updates

  • Now passing proper prompt to the model 🐞
  • Model/code update moondream2. This should resolve issues with the 'Tensor size mismatch' error when using newer versions of transformers.Make sure that you select the moondream2 model within the node to receive the updated files from huggingface. If moondream2 works fine, you can remove the old model files, usually located in the user\.cache\huggingface folder: hub\models--vikhyatk--moondream1 and modules\transformers_modules\vikhyatk\moondream1 to save disk space.🔄
  • End support for moondream1 in order to change the license for this repository to Apache 2.0.
  • New multi prompt feature: Ask several questions at once. Just place each prompt on a new line. 🔄
  • Added model revision selector. 🔄
  • Added model temperature selector. Set this value to 0 to use the models default temperature. 🔄
  • Now supporting custom model folder location for manually downloaded models 🔄.
    alt text
    The following files are expected in ComfyUI/models/moondream2:
    • model.safetensors
    • config.json
    • tokenizer.json
    • tokenizer_config.json
    • generation_config.json
    • configuration_moondream.py
    • modeling_phi.py
    • moondream.py
    • vision_encoder.py

To do