ComfyDeploy: How ComfyUI-JakeUpgrade works in ComfyUI?

ComfyUI Jake Upgrade

A ComfyUI workflow customization by Jake.

If you like what I share, please support me with PayPal.

Changelog

<details> <summary><b>Previous Version</b></summary>

- 2024-06-23 - v1.0.0	released.  
- 2024-07-11 - v1.0.6	Noise Injection for Upscale Workflow.  
- 2024-07-16 - v1.0.7	Single Image to Mesh Workflow updated.  
- 2024-07-21 - v1.0.8	Orbit Poses Constant nodes added. 3 Image to Mesh Workflows updated.  
- 2024-07-22 - v1.0.9	3DGS workflow added.  
- 2024-07-24 - v1.1.0	img2mesh workflow updated. Craftsman Mesh added. 
			Three OrbitPoses nodes been added to 3D-Pack.  
- 2024-07-31 - v1.1.1	Prompt Combine node added.  
- 2024-08-03 - v1.1.2	Resize to Focus added to image2mesh workflow.  
- 2024-08-21 - v1.1.3	Random Beats node added (not for AIGC).  
- 2024-09-01 - v1.2.0	SD3 workflow added. Noise Injection (Inspire) added. 
			Refine, Upscale, and Detailer process major updated. 
			SD15 Hand Fix supports SDXL and SD3 workflow. 
			SDXL IPAdapter supports SD3 workflow. 
			NoiseInjection Component and workflow added.  
- 2024-09-04 - v1.2.1	In/Out Paint ControlNet Component added. 
			Inpaint Module Workflow updated. 
			SD15|SDXL|SD3 Workflow updated. 
			Image Remove Alpha JK node added.  
- 2024-09-05 - v1.2.2	Black Pixel switch added for Inpaint ControlNet Component following ControlNet Preprocessor AUX Custom Node's update.  
- 2024-09-06 - v1.2.3	Refinement Noise Injection added. 
			txt2prompt and img2prompt workflow added. 
			img2prompt component added.  
- 2024-09-07 - v1.2.4	img2mesh workflow doesn't need _JK.pack, so that doesn't need to install segment anything, VLM nodes, and IF AI tools.  
- 2024-09-09 - v1.2.5	Clip l, clip g, t5xxl texture encode logic upgrade. 
			Clip l & g switch added. 
			Negative g switch added. 
			SDXL Clip Text Encode Target Resolution Scale added.  
- 2024-09-10 - v1.2.6	detailer: add detail lora.  
- 2024-09-11 - v1.2.7	Magic Photo Prompter added.  
- 2024-09-13 - v1.2.8	Use Comfy UI default set union controlnet type to load xinsir sdxl controlnet union.  
			Remove Inspire Pack and WAS Nodes Suite in img2mesh workflows. 
			Group Node Image RemBG added, using InSPYReNet TransparentBG from Essentials to remove background and Image Composite Masked to add grayscale background.  
- 2024-09-15 - v1.2.9	Inpaint Simple updated. Outpaint Simple added. 
			txt2img | img2img | inpaint workflow updated. 
			In/Out Paint to Refinement process added. 
			Upscale to Refinment process added.  
- 2024-09-21 - v1.3.0	Inpaint/Outpaint Latent | Checkpoint | ControlNet group nodes updated. 
			Inpaint and txt2img/img2img workflows updated. 
			SD3/Flux Inpaint ControlNet added.  
- 2024-09-24 - v1.3.1	Hand Fix Detailer upgrades, supports SD15 | SDXL | Flux. 
			SD3 Hand Fix need to choose SDXL models for the InstantX Depth ControlNet does not work properly. 
			Replace SD3 ControlNet Apply with new ControlNet Apply Node.  
- 2024-09-25 - v1.3.2	AIO Preprocessor added for txt2img | img2img workflow.  
			Detailer, Upscale workflows updated. Refine workflow added.  
- 2024-09-26 - v1.3.3	Latent Noise Mask switch added for Inpaint/Outpaint ControlNet. 
			Specified Dual Clip switch added for sdxl workflow.  
- 2024-09-28 - v1.3.4	Hand Fix supports SD3 and Flux. Hand Fix module workflow added.
- 2024-09-29 - v1.3.5	Inpaint Group Nodes upgrade, add more Image | Mask | Latent control.
- 2024-10-01 - v1.3.6	Inpaint Group Nodes upgrade, change color grading method.
- 2024-10-03 - v1.3.7	Remove Outpaint Pad Feathering.
- 2024-10-06 - v1.4.0	Replace Base Ipadapter simple with IPAdapter Style and Composition Transfer in SD15 and SDXL workflow.
			SD3 Aspect Ratio node and SD3 Base Model Parameter node added. 
			SD3 Api workflow added to make up the shorcomings of SD3 local deployment using Stability SD3 control and inpaint nodes.
- 2024-10-10 - v1.5.0	Flux KSampler and Flux Ksampler Adv group nodes added.
			Flux txt2img and img2img workflow added. Flux KSampler workflow added.
			Inpaint/Outpaint ControlNet and Checkpoint method order changed.
			Enchance and Resize Input Image added for img2img workflow.
			Noise | Guider | Sampler | Sigmas switch added.
- 2024-10-10 - v1.5.1	Fal LLM and VLM API added for prompt generation workflow and SAI API workfkow.
- 2024-10-11 - v1.5.2	Flux KSampler Adv updated, use SplitSigmas instead of SplitSigmasDenoise.

</details>

• 2024-10-19 - v1.6.0 Image Generation group node and module workflow added. Switch Model and CLIP JK🐉 node removed. Rename Apply ControlNet Stack SD3 to Applly ControlNet VAE. Tiling Mode and Empty Latent Color nodes added.
• 2024-11-08 - v1.7.0 Normal | Input version of Image Gen and Image Gen Adv group nodes added. Krita workflow added using Input version of Image Gen group nodes. Remove Comfyroll Custom Nodes from the must-have-node list. ControlNet Apply and ControlNet Stack nodes upgraded, supports Union, Alimama Inpaint. ControlNet Stack Input Switch node added. Add Blend with Original Mask option to Inpaint, Image Gen Adv and Image Gen Input group nodes. IsMaskEmpty Node and Image Crop by Mask Group Node added.

Installation

1. git clone https://github.com/jakechai/ComfyUI-JakeUpgrade into the custom_nodes folder
   • e.g. custom_nodes\ComfyUI-JakeUpgrade
   OR: Install using ComfyUI Manager.
2. Open a Command Prompt/Terminal/etc.
3. Change to the custom_nodes\ComfyUI-JakeUpgrade folder you just created
   • e.g. cd C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-JakeUpgrade
4. Install python packages

   • Windows Standalone installation (embedded python):

     ../../../python_embeded/python.exe -s -m pip install -r requirements.txt

     OR: run install.bat.

   • Manual/non-Windows installation pip install -r requirements.txt

Video Introduction

• txt2img&img2img workflow: Youtube Bilibili
• txt2img&img2img SD3 workflow: Youtube Bilibili
• txt2img&img2img API workflow: Youtube Bilibili
• Group Nodes - Image Generation and Krita workflow: WIP
• prompt generation workflow: Youtube Bilibili
• inpaint workflow: Youtube Bilibili
• img2mesh workflow: Youtube Bilibili
• 3D-Pack Installation Tips： Youtube Bilibili
• 3D-Pack Algorithm Comparison： Youtube Bilibili

JakeUpgrade Workflow

Main

• JK_workflow_txt2img_img2img_SD15
• JK_workflow_txt2img_img2img_SDXL
• JK_workflow_txt2img_img2img_SD3
• JK_workflow_txt2img_img2img_Flux
• JK_workflow_txt2img_img2img_API
• JK_workflow_txt2prompt_img2prompt
• JK_workflow_img2mesh_CRM&Zero123plus&MVDream&CharacterGen
• JK_workflow_img2mesh_Unique3D&Wonder3D&Era3D
• JK_workflow_img2mesh_Zero123&SV3D
• JK_workflow_img2mesh_3DGS

[!NOTE]

• ComfyUI-3D-Pack needs pytorch 2.4.0+cu121 and xformers, but the latest ComfyUI_windows_portable version uses pytorch 2.4.1+cu124 (or higher), you should separate those two ComfyUI.
• ComfyUI-3D-Pack 3DMesh | 3DGS Preview works with the new frontend of ComfyUI with a restriction.
• CXH joy caption conflicts with VLM Nodes and is not included in the prompt generation workflow.

Module

• JK_workflow_Image Generation
• JK_workflow_Image Generation Adv
• JK_workflow_Refine
• JK_workflow_Upscale 1st
• JK_workflow_Upscale 2nd
• JK_workflow_Detailer
• JK_workflow_HandFix
• JK_workflow_Inpaint
• JK_workflow_NoiseInjectionVariation
• JK_workflow_Concept
• JK_workflow_Seamless Texture
• JK_workflow_txt2img_Simple
• JK_workflow_Flux_KSampler
• JK_Workflow_Mesh-ReMesh_Projection

Krita (sync)

• JK_workflow-Krita Common
• JK_workflow-Krita Common Adv
• JK_workflow-Krita SD15
• JK_workflow-Krita SD15 Adv
• JK_workflow-Krita SDXL
• JK_workflow-Krita SDXL Adv
• JK_workflow-Krita SD3
• JK_workflow-Krita SD3 Adv
• JK_workflow-Krita Flux
• JK_workflow-Krita Flux Adv

Krita (dev)

• JK Krita Common
• JK Krita Common Adv
• JK Krita SD15
• JK Krita SD15 Adv
• JK Krita SDXL
• JK Krita SDXL Adv
• JK Krita SD3
• JK Krita SD3 Adv
• JK Krita Flux
• JK Krita Flux Adv

[!NOTE]

• Installing a separate version of ComfyUI to work with Krita is recommended.
• Krita AI Plugin - ComyUI Custom Workflows
• Krita workflows are used for Krita + Krita AI Diffusion + Krita AI Tools
• A synchronous version of Krita workflows can be opened by ComyUI and synchronous with Krita AI Diffusion.
• A dev version of Krita workflows can only loaded by Krita AI Diffusion and should be moved to ...\AppData\Roaming\krita\ai_diffusion\workflows.

Required Custom Nodes

Common

• rgthree
• pythongosssss
• ControlNet AUX
• Impact Pack
• IP Adapter Plus
• KJ Nodes
• Essentials
• JakeUpgrade

txt2img_img2img workflow

• Inspire Pack
• WAS Node Suite
• Layer Style
• Segment Anything
• NNLatentUpscale
• Ultimate SD Upscale
• Seamless tiling
• ComfyUI Noise
• Face Analysis
• StyleAligned
• ComfyUI ELLA
• Dynamic Prompts
• One Button Prompt
• Portrait Master
• Flux Prompt Generator
• Merlin Magic Photo Prompter
• WD14 Tagger
• VLM Nodes
• IF AI Tools
• ComfyUI SAI API
• ComfyUI Fal API

img2mesh workflow

• ComfyUI 3D Pack

Krita workflow

• Inpaint Nodes
• Tooling Nodes
• ComfyUI ELLA
• Seamless tiling
• Inspire Pack

Install and copy | replace files (optional)

• ComfyUI Manager : Copy _JK.pack in the replacement folder to custom_nodes\ComfyUI-Manager\component.
• Prompt Stylers : Copy new styles.
• ComfyUI SAI API : (Workaround before ComfyUI SAI API approves my pull request)Copy and replace files in custom_nodes\ComfyUI-SAI_API

[!NOTE]

• Group Nodes can be copied and pasted between workflows in the latest ComfyUI.

JK_workflow : txt2img_img2img

<details> <summary><b>Introduction</b></summary>

Hotkey:
	0: usage guide
	\`: overall workflow
	1: base, image selection, & noise injection
	2: embedding, fine tune string, auto prompts, & adv conditioning parameters
	3: lora, controlnet parameters, & adv model parameters
	4: refine parameters
	5: detailer parameters
	6: upscale parameters
	7: In/Out Paint parameters

Workflow Control:
	All switches in any Workflow panel take effect in realtime.
	All switches in any Select panel also affect sub workflow, but don't take effect in realtime, which needs preprocessing.
	All switches in Parameters panel that affect sub workflow don't take effect in realtime, which needs preprocessing.

Suggested method:
	Preprocessing needs to be executed before actural generation for switches in Select or Parameters panels to control the sub workflow. 
	Pre-Queue Prompt: It's recommended to disable all processes in the Overall Workflow panel and adjust all sub-workflow-related switches before running Queue Prompt. The state of corresponding switches in Pre-process panels will be changed automatically after the preprocessing.
	Pre-process Pannel: Alternatively, you can preprocess manually by setting the corresponding switches in the Pre-process Pannel to the same state as in the Parameters Pannel, which does not need a Pre-Queue Prompt.

Metadata:
	All parameters including sub-workflow-related switches will affect the generation result and also the content of Metadata saved with the image.
	In Refine image saving, remove noise_jinection_metadata link if not refining any noise injection process.
	In Upscale image saving, remove noise_jinection_metadata or refine_metadata link if not using Noise Injection or refine process.
	In Detailer image saving, remove noise_jinection_metadata, refine_metadata or upscale_metadata link if not using Noise Injection or refine process.

SDXL switches:
	Image Resolution | AIO resolution
	Load SDXL Ckpt | Vae for Base | Refine | Upscale | Detailer | In/Out Paint
	FreeU SDXL settings
	Auto Variation SDXL settings
	Disable SD15 ELLA Text Encode (in Base Model Sub Workflow JK🐉)
	Enable SDXL Text Ecode (in Base Model Sub Workflow JK🐉) (Optional)
	Enable SDXL Dual Clip (in Base Model Sub Workflow JK🐉) (Optional)
	Enable SDXL Refine Text Encode (in Refine Sub Workflow JK🐉) (optional)
	Switch plus, plus-face, and faceid ipadapter to sdxl_vit-h version
	Switch faceid lora to sdxl version
	Switch Image Upscale ControlNet Depth|Tile to sdxl version (in Upscale Sub Workflow JK🐉)
	Switch NNLatentUpscale version to SDXL
	Set Ultimate SD Upscale Tile size to 1024
	Switch Detailer's Add Detail Lora to SDXL version
	Switch Hand Fix Depth ControlNet version to SDXL
	Hand Fix MeshGraphhormer Hand Refiner resolution
	Use Load ControNet Model and set Union ControlNet type to load xinsir controlnet union in I/O Paint process
	Enable Black Pixel switch for Inpaint/Outpaint ControlNet in I/O Paint process
	(If it is SD15, choose the opposite)

Other:
	1. Nodes State JK🐉 uses target nodes' id to control their active | mute | bypass mode. Need to update node_id_list if you make a copy.
	2. The order of Detailer Progress and Upscale Progress can be swapped. Please avoid to form loops. 

</details> <details> <summary><b>Explanation</b></summary>

• Overall Workflow

• Image Comparer

• Project Setting

• Base Model Parameters

• TI Parameters

• Fine Tune String Parameters

• Auto Variation Prompt Parameters

• Advanced Conditioning Parameters

• Lora Parameters

• Control Net Parameters

• Advanced Model Parameters

• Refine Process Parameters

• Upscale Process Parameters

• Detailer Process Parameters

• In/Out Paint Process Parameters

</details>

JK_workflow : img2mesh

<details> <summary><b>Introduction</b></summary>

Hotkey:
	\`: Main Workflow Control Pannels

Workflow Control:
	Each img2mesh workflow contains several sub-workflows as the filename indicates.
	Each sub-workflow consists of one or more sub-steps.
	Each sub-step saves the result as images or meshes when it finishes generation.
	Each sub-step can switch from generation mode to loading mode.
	It's recommended to enable sub-step step by step and switch to loading mode after the generation.

Other:
	TripoSR workflow is not included because it is straightforward.
	Triplane workflow is not included because it is straightforward.

</details> <details> <summary><b>Explanation</b></summary>

• Workflow breakdown: img2mesh types

• Workflow breakdown: CRM&Zero123plus&MVDream&CharacterGen

• Workflow breakdown: JUnique3D&Wonder3D&Era3D

• Workflow breakdown: Zero123&SV3D

• Workflow breakdown: 3DGS

• Workflow Control Panels: CRM&Zero123plus&MVDream&CharacterGen

• Workflow Control Panels: Unique3D&Wonder3D&Era3D

• Workflow Control Panels: Zero123&SV3D

• Workflow Control Panels: 3DGS

</details>

JakeUpgrade Nodes

<details> <summary><b>Custom Nodes</b></summary>

Misc Nodes
	SD1.5 Aspect Ratio JK🐉
	SDXL Aspect Ratio JK🐉
	SD3 Aspect Ratio JK🐉
	Aspect Ratio JK🐉
	Tiling Mode JK🐉
	Empty Latent Color JK🐉
Reroute Nodes
	Reroute List JK🐉
	Reroute Ckpt JK🐉
	Reroute Vae JK🐉
	Reroute Sampler JK🐉
	Reroute Upscale JK🐉
	Reroute Resize JK🐉
	Reroute String JK🐉
	String To Combo JK🐉
ControlNet Nodes
	Apply ControlNet JK🐉
	Multi-ControlNet Stack JK🐉
	Apply Multi-ControlNet JK🐉
	Apply Multi-ControlNet VAE JK🐉
LoRA Nodes
	Load LoRA JK🐉
	LoRA Stack JK🐉
	Apply LoRA Stack JK🐉
Embedding Nodes
	Embedding Picker JK🐉
	Embedding Picker Multi JK🐉
Loader Nodes
	Ckpt Loader JK🐉
	Vae Loader JK🐉
	Sampler Loader JK🐉
	Upscale Model Loader JK🐉
Pipe Nodes
	Nodes State JK🐉
	Ksampler Parameters JK🐉
	Project Setting JK🐉
	Base Model Parameters JK🐉
	Base Model Parameters Extract JK🐉
	Base Image Parameters Extract JK🐉
	Base Model Pipe JK🐉
	Base Model Pipe Extract JK🐉
	Base Model Parameters SD3 JK🐉
	Refine Pipe JK🐉
	Refine Pipe Extract JK🐉
	Noise Injection Parameters JK🐉
	Noise Injection Pipe Extract JK🐉
	Refine Model Parameters JK🐉
	Refine 1 Parameters Extract JK🐉
	Refine 2 Parameters Extract JK🐉
	Upscale Model Parameters JK🐉
	Image Upscale Parameters Extract JK🐉
	Latent Upscale Parameters Extract JK🐉
	Upscale Model Parameters Extract JK🐉
	Detailer Parameters JK🐉
	Pipe End JK🐉
	Metadata Pipe JK🐉
	Metadata Pipe Extract JK🐉
Image Nodes
	Save Image With Metadata JK🐉
	Save Image With Metadata Flow JK🐉
	Load Image With Metadata JK🐉
	Enchance And Resize Hint Images JK🐉
	Remove Image Alpha JK🐉
Mask Nodes
	Is Mask Empty JK🐉
Animation Nodes
	Animation Prompt JK🐉
	Animation Value JK🐉
Logic switches Nodes
	Boolean JK🐉
	Image Input Switch JK🐉
	Mask Input Switch JK🐉
	Int Input Switch JK🐉
	Float Input Switch JK🐉
	Latent Input Switch JK🐉
	Conditioning Input Switch JK🐉
	Clip Input Switch JK🐉
	Model Input Switch JK🐉
	ControlNet Input Switch JK🐉
	ControlNet Stack Input Switch JK🐉
	Text Input Switch JK🐉
	VAE Input Switch JK🐉
	Pipe Input Switch JK🐉
	Impact Pipe Input Switch JK🐉
	Noise Input Switch JK🐉
	Guider Input Switch JK🐉
	Sampler Input Switch JK🐉
	Sigmas Input Switch JK🐉
	Mesh Input Switch JK🐉
	Ply Input Switch JK🐉
	Orbit Pose Input Switch JK🐉
ComfyMath Fix Nodes
	BoolToInt JK🐉
	IntToBool JK🐉
	BoolUnaryOp JK🐉
	BoolBinaryOp JK🐉
	StringBinaryCon JK🐉
	Prompt Combine JK🐉
	FloatUnaryCon JK🐉
	FloatBinaryCon JK🐉
	IntUnaryCon JK🐉
	IntBinaryCon JK🐉
	NumberUnaryCon JK🐉
	NumberBinaryCon JK🐉
	Vec2UnaryCon JK🐉
	Vec2BinaryCon JK🐉
	Vec2ToFloatUnaryOp JK🐉
	Vec2ToFloatBinaryOp JK🐉
	Vec2FloatOp JK🐉
	Vec3UnaryCon JK🐉
	Vec3BinaryCon JK🐉
	Vec3ToFloatUnaryOp JK🐉
	Vec3ToFloatBinaryOp JK🐉
	Vec3FloatOp JK🐉
	Vec4UnaryCon JK🐉
	Vec4BinaryCon JK🐉
	Vec4ToFloatUnaryOp JK🐉
	Vec4ToFloatBinaryOp JK🐉
	Vec4FloatOp JK🐉
ComfyMath Nodes
	FloatToInt JK🐉
	IntToFloat JK🐉
	IntToNumber JK🐉
	NumberToInt JK🐉
	FloatToNumber JK🐉
	NumberToFloat JK🐉
	ComposeVec2 JK🐉
	ComposeVec3 JK🐉
	ComposeVec4 JK🐉
	BreakoutVec2 JK🐉
	BreakoutVec3 JK🐉
	BreakoutVec4 JK🐉
	FloatUnaryOp JK🐉
	FloatBinaryOp JK🐉
	IntUnaryOp JK🐉
	IntBinaryOp JK🐉
	NumberUnaryOp JK🐉
	NumberBinaryOp JK🐉
	Vec2UnaryOp JK🐉
	Vec2BinaryOp JK🐉
	Vec3UnaryOp JK🐉
	Vec3BinaryOp JK🐉
	Vec4UnaryOp JK🐉
	Vec4BinaryOp JK🐉
Simple Evaluate Nodes
	Evaluate Ints JK🐉
	Evaluate Floats JK🐉
	Evaluate String JK🐉
	Evaluate Examples JK🐉
3D Nodes
	Orbit Poses JK🐉
	OrbitLists to OrbitPoses JK🐉
	OrbitPoses to OrbitLists JK🐉

</details> <details> <summary><b>Group Nodes</b></summary>

Tools
	JK🐉::CLIPSegMask
	JK🐉::Image Crop by Mask
	JK🐉::Image RemBG
	JK🐉::Image to Prompt (LLava Local)
	JK🐉::Image to Prompt Advanced (LLava Local)
	JK🐉::Pad Image for Outpainting
	JK🐉::SegAnythingMask		
Workflow
	JK🐉::Concept
	JK🐉::Flux KSampler
	JK🐉::Flux KSampler Adv
	JK🐉::Image Gen Common
	JK🐉::Image Gen Common (Input)
	JK🐉::Image Gen Common Adv
	JK🐉::Image Gen Common Adv (Input)
	JK🐉::Image Gen Flux
	JK🐉::Image Gen Flux (Input)
	JK🐉::Image Gen Flux Adv
	JK🐉::Image Gen Flux Adv (Input)
	JK🐉::Image Gen SD15
	JK🐉::Image Gen SD15 (Input)
	JK🐉::Image Gen SD15 Adv
	JK🐉::Image Gen SD15 Adv (Input)
	JK🐉::Image Gen SD3
	JK🐉::Image Gen SD3 (Input)
	JK🐉::Image Gen SD3 Adv
	JK🐉::Image Gen SD3 Adv (Input)
	JK🐉::Image Gen SDXL
	JK🐉::Image Gen SDXL (Input)
	JK🐉::Image Gen SDXL Adv
	JK🐉::Image Gen SDXL Adv (Input)
	JK🐉::Inpaint Latent
	JK🐉::Inpaint Checkpoint
	JK🐉::Inpaint ControlNet			
	JK🐉::Outpaint Latent
	JK🐉::Outpaint Checkpoint
	JK🐉::Outpaint ControlNet
	JK🐉::txt2img

</details>

Reference Custom Nodes

• rgthree
• Comfyroll
• Efficiency Nodes
• ControlNet AUX
• Impact Pack
• Image Saver
• Prompt Reader
• ComfyMath
• Embedding Picker
• Layer Style