Nodes Browser
ComfyDeploy: How ComfyUI-FluxRegionAttention works in ComfyUI?
What is ComfyUI-FluxRegionAttention?
Implement Region Attention for Flux model. Add node RegionAttention that takes a regions - mask + condition, mask could be set from comfyui masks or bbox in FluxRegionBBOX node. This code is not optimized and has a memory leak. If you caught a OOM just try run a query againg - works on my RTX3080. For generation it uses a usual prompt that have influence to all picture and a regions that have their own prompts. Base prompt good for setup background and style of image. This is train-free technique and results not always stable - sometimes need to try several seeds or change prompt.
How to install it in ComfyDeploy?
Head over to the machine page
- Click on the "Create a new machine" button
- Select the
Editbuild steps - Add a new step -> Custom Node
- Search for
ComfyUI-FluxRegionAttentionand select it - Close the build step dialig and then click on the "Save" button to rebuild the machine
ComfyUI-FluxRegionAttention
Implement Region Attention for Flux model. Add node RegionAttention that takes a regions - mask + condition, mask could be set from comfyui masks or bbox in FluxRegionBBOX node. This code is not optimized and has a memory leak. If you caught a OOM just try run a query againg - works on my RTX3080.
For generation it uses a usual prompt that have influence to all picture and a regions that have their own prompts. Base prompt good for setup background and style of image.
This is train-free technique and results not always stable - sometimes need to try several seeds or change prompt.
Examples
Workflows in the metadata
Nodes screenshot
- Region attention influence only to t5_xxl embeddings, for clip_l embeddings we can use concatinated prompt (stronger regional conditioning) or only common prompg (weaker conditioning).
- Pipeline
Aknowledgements
This repository is base on next repositories:
@Misc{omost, author = {Omost Team}, title = {Omost GitHub Page}, year = {2024}, }