ComfyDeploy: How ComfyUI-JakeUpgrade works in ComfyUI?

ComfyUI Jake Upgrade

A ComfyUI workflow customization by Jake.

If you like what I share, please support me with PayPal.

Installation

1. git clone https://github.com/jakechai/ComfyUI-JakeUpgrade into the custom_nodes folder
   • e.g. custom_nodes\ComfyUI-JakeUpgrade
   OR: Install using ComfyUI Manager.
2. Open a Command Prompt/Terminal/etc.
3. Change to the custom_nodes\ComfyUI-JakeUpgrade folder you just created
   • e.g. cd C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-JakeUpgrade
4. Install python packages

   • Windows Standalone installation (embedded python):

     ../../../python_embeded/python.exe -s -m pip install -r requirements.txt

     OR: run install.bat.

   • Manual/non-Windows installation pip install -r requirements.txt

Video Introduction

• txt2img&img2img workflow: Youtube Bilibili
• txt2img&img2img SD3 workflow: Youtube Bilibili
• prompt generation workflow: Youtube Bilibili
• img2mesh workflow: Youtube Bilibili
• 3D-Pack Installation Tips： Youtube Bilibili
• 3D-Pack Algorithm Comparison： Youtube Bilibili

JakeUpgrade Workflow

Main

• JK_workflow_txt2img_img2img_SD3
• JK_workflow_txt2img_img2img_SDXL
• JK_workflow_txt2img_img2img_SD15
• JK_workflow_txt2prompt_img2prompt
• JK_workflow_img2mesh_CRM&Zero123plus&MVDream&CharacterGen
• JK_workflow_img2mesh_Unique3D&Wonder3D&Era3D
• JK_workflow_img2mesh_Zero123&SV3D
• JK_workflow_img2mesh_3DGS

[!NOTE]

• ComfyUI-3D-Pack needs pytorch 2.3.0+cu121 and xformers, but the latest ComfyUI_windows_portable version uses pytorch 2.3.1+cu121 or higher, you should separate those two ComfyUI.
• ComfyUI-3D-Pack 3DMesh | 3DGS Preview not working seems to be related to the frontend change of ComfyUI. Fall back to the legacy frontend by adding --front-end-version Comfy-Org/ComfyUI_legacy_frontend@latest to the command line argument. ComfyUI/pull/4379.
• CXH joy caption conflicts with VLM Nodes and is not included in the prompt generation workflow.

Module

• JK_workflow_NoiseInjectionVariation
• JK_workflow_Concept
• JK_workflow_Seamless Texture
• JK_workflow_Detailer
• JK_workflow_Inpaint
• JK_workflow_txt2img_Simple
• JK_workflow_Upscale
• JK_Workflow_Mesh-ReMesh_Projection

Required Custom Nodes

Common

• rgthree
• pythongosssss
• ControlNet AUX
• Impact Pack
• IP Adapter Plus
• KJ Nodes
• Essentials
• JakeUpgrade

txt2img_img2img workflow

• Inspire Pack
• WAS Node Suite
• Comfyroll
• Segment Anything
• NNLatentUpscale
• Ultimate SD Upscale
• Seamless tiling
• ComfyUI Noise
• Face Analysis
• StyleAligned
• ComfyUI ELLA
• Dynamic Prompts
• One Button Prompt
• Portrait Master
• Flux Prompt Generator
• Merlin Magic Photo Prompter
• WD14 Tagger
• VLM Nodes
• IF AI Tools

img2mesh workflow

• ComfyUI 3D Pack

Install and copy | replace files

• ComfyUI Manager : Copy _JK.pack in the replacement folder to `custom_nodes\ComfyUI-Manager\component'.
• Prompt Stylers : Copy new styles (optional).

[!NOTE]

• Make sure to replace _JK.pack again if it's updated.
• img2mesh workflow doesn't need to copy _JK.pack or prompt styles.

JK_workflow : txt2img_img2img

<details> <summary><b>Introduction</b></summary>

Hotkey:
	0: usage guide
	\`: overall workflow
	1: base, image selection, & noise injection
	2: embedding, fine tune string, auto prompts, & adv conditioning parameters
	3: lora, controlnet parameters, & adv model parameters
	4: refine parameters
	5: detailer parameters
	6: upscale parameters
	7: In/Out Paint parameters

Workflow Control:
	All switches in any Workflow panel take effect in realtime.
	All switches in any Select panel also affect sub workflow, but don't take effect in realtime, which needs preprocessing.
	All switches in Parameters panel that affect sub workflow don't take effect in realtime, which needs preprocessing.

Suggested method:
	Preprocessing needs to be executed before actural generation for switches in Select or Parameters panels to control the sub workflow. 
	Pre-Queue Prompt: It's recommended to disable all processes in the Overall Workflow panel and adjust all sub-workflow-related switches before running Queue Prompt. The state of corresponding switches in Pre-process panels will be changed automatically after the preprocessing.
	Pre-process Pannel: Alternatively, you can preprocess manually by setting the corresponding switches in the Pre-process Pannel to the same state as in the Parameters Pannel, which does not need a Pre-Queue Prompt.

Metadata:
	All parameters including sub-workflow-related switches will affect the generation result and also the content of Metadata saved with the image.
	In Refine image saving, remove noise_jinection_metadata link if not refining any noise injection process.
	In Upscale image saving, remove noise_jinection_metadata or refine_metadata link if not using Noise Injection or refine process.
	In Detailer image saving, remove noise_jinection_metadata, refine_metadata or upscale_metadata link if not using Noise Injection or refine process.

SDXL switches:
	Image Resolution
	Load SDXL Ckpt | Vae for Base | Refine | Upscale | Detailer | In/Out Paint
	FreeU SDXL settings
	Auto Variation SDXL settings
	Disable SD15 ELLA Text Encode (in Base Model Sub Workflow JK🐉)
	Enable SDXL Text Ecode (in Base Model Sub Workflow JK🐉)     (Optional)
	Enable SDXL Refine Text Encode (in Refine Sub Workflow JK🐉) (optional)
	Switch plus, plus-face, and faceid ipadapter to sdxl_vit-h version
	Switch faceid lora to sdxl version
	Switch Image Upscale ControlNet Depth|Tile to sdxl version (in Upscale Sub Workflow JK🐉)
	Switch NNLatentUpscale version to SDXL
	Set Ultimate SD Upscale Tile size to 1024
	Switch Detailer's Add Detail Lora to SDXL version
	Use Load ControNet Model and set Union ControlNet type to load xinsir controlnet union in I/O Paint process
	Enable Black Pixel switch for Inpaint/Outpaint ControlNet in I/O Paint process
	(If it is SD15, choose the opposite)

Other:
	1. Nodes State JK🐉 uses target nodes' id to control their active | mute | bypass mode. Need to update node_id_list if you make a copy.
	2. The order of Detailer Progress and Upscale Progress can be swapped. Please avoid to form loops. 

</details> <details> <summary><b>Explanation</b></summary>

• Overall Workflow

• Image Comparer

• Project Setting

• Base Model Parameters

• TI Parameters

• Fine Tune String Parameters

• Auto Variation Prompt Parameters

• Advanced Conditioning Parameters

• Lora Parameters

• Control Net Parameters

• Advanced Model Parameters

• Refine Process Parameters

• Upscale Process Parameters

• Detailer Process Parameters

• In/Out Paint Process Parameters

</details>

JK_workflow : img2mesh

<details> <summary><b>Introduction</b></summary>

Hotkey:
	\`: Main Workflow Control Pannels

Workflow Control:
	Each img2mesh workflow contains several sub-workflows as the filename indicates.
	Each sub-workflow consists of one or more sub-steps.
	Each sub-step saves the result as images or meshes when it finishes generation.
	Each sub-step can switch from generation mode to loading mode.
	It's recommended to enable sub-step step by step and switch to loading mode after the generation.

Other:
	TripoSR workflow is not included because it is straightforward.
	Triplane workflow is not included because it is straightforward.

</details> <details> <summary><b>Explanation</b></summary>

• Workflow breakdown: img2mesh types

• Workflow breakdown: CRM&Zero123plus&MVDream&CharacterGen

• Workflow breakdown: JUnique3D&Wonder3D&Era3D

• Workflow breakdown: Zero123&SV3D

• Workflow breakdown: 3DGS

• Workflow Control Panels: CRM&Zero123plus&MVDream&CharacterGen

• Workflow Control Panels: Unique3D&Wonder3D&Era3D

• Workflow Control Panels: Zero123&SV3D

• Workflow Control Panels: 3DGS

</details>

JakeUpgrade Nodes

<details> <summary><b>Custom Nodes</b></summary>

Misc Nodes
	SD1.5 Aspect Ratio JK🐉
	SDXL Aspect Ratio JK🐉
Reroute Nodes
	Reroute List JK🐉
	Reroute Ckpt JK🐉
	Reroute Vae JK🐉
	Reroute Sampler JK🐉
	Reroute Upscale JK🐉
	Reroute Resize JK🐉
	Reroute String JK🐉
ControlNet Nodes
	Apply ControlNet JK🐉
	Multi-ControlNet Stack JK🐉
	Apply Multi-ControlNet JK🐉
	Apply Multi-ControlNet SD3 JK🐉
LoRA Nodes
	Load LoRA JK🐉
	LoRA Stack JK🐉
Embedding Nodes
	Embedding Picker JK🐉
	Embedding Picker Multi JK🐉
Loader Nodes
	Ckpt Loader JK🐉
	Vae Loader JK🐉
	Sampler Loader JK🐉
	Upscale Model Loader JK🐉
Pipe Nodes
	Nodes State JK🐉
	Ksampler Parameters JK🐉
	Project Setting JK🐉
	Base Model Parameters JK🐉
	Base Model Parameters Extract JK🐉
	Base Image Parameters Extract JK🐉
	Base Model Pipe JK🐉
	Base Model Pipe Extract JK🐉
	Refine Pipe JK🐉
	Refine Pipe Extract JK🐉
	Noise Injection Parameters JK🐉
	Noise Injection Pipe Extract JK🐉
	Refine Model Parameters JK🐉
	Refine 1 Parameters Extract JK🐉
	Refine 2 Parameters Extract JK🐉
	Upscale Model Parameters JK🐉
	Image Upscale Parameters Extract JK🐉
	Latent Upscale Parameters Extract JK🐉
	Upscale Model Parameters Extract JK🐉
	Detailer Parameters JK🐉
	Pipe End JK🐉
	Metadata Pipe JK🐉
	Metadata Pipe Extract JK🐉
Image Nodes
	Save Image With Metadata JK🐉
	Save Image With Metadata Flow JK🐉
	Load Image With Metadata JK🐉
	Enchance And Resize Hint Images JK🐉
	Remove Image Alpha JK🐉
Animation Nodes
	Animation Prompt JK🐉
	Animation Value JK🐉
Logic switches Nodes
	Boolean JK🐉
	Image Input Switch JK🐉
	Mask Input Switch JK🐉
	Int Input Switch JK🐉
	Float Input Switch JK🐉
	Latent Input Switch JK🐉
	Conditioning Input Switch JK🐉
	Clip Input Switch JK🐉
	Model Input Switch JK🐉
	ControlNet Input Switch JK🐉
	Text Input Switch JK🐉
	VAE Input Switch JK🐉
	Switch Model and CLIP JK🐉
	Pipe Input Switch JK🐉
	Impact Pipe Input Switch JK🐉
	Mesh Input Switch JK🐉
	Ply Input Switch JK🐉
	Orbit Pose Input Switch JK🐉
ComfyMath Fix Nodes
	BoolToInt JK🐉
	IntToBool JK🐉
	BoolUnaryOp JK🐉
	BoolBinaryOp JK🐉
	StringBinaryCon JK🐉
	Prompt Combine JK🐉
	FloatUnaryCon JK🐉
	FloatBinaryCon JK🐉
	IntUnaryCon JK🐉
	IntBinaryCon JK🐉
	NumberUnaryCon JK🐉
	NumberBinaryCon JK🐉
	Vec2UnaryCon JK🐉
	Vec2BinaryCon JK🐉
	Vec2ToFloatUnaryOp JK🐉
	Vec2ToFloatBinaryOp JK🐉
	Vec2FloatOp JK🐉
	Vec3UnaryCon JK🐉
	Vec3BinaryCon JK🐉
	Vec3ToFloatUnaryOp JK🐉
	Vec3ToFloatBinaryOp JK🐉
	Vec3FloatOp JK🐉
	Vec4UnaryCon JK🐉
	Vec4BinaryCon JK🐉
	Vec4ToFloatUnaryOp JK🐉
	Vec4ToFloatBinaryOp JK🐉
	Vec4FloatOp JK🐉
ComfyMath Nodes
	FloatToInt JK🐉
	IntToFloat JK🐉
	IntToNumber JK🐉
	NumberToInt JK🐉
	FloatToNumber JK🐉
	NumberToFloat JK🐉
	ComposeVec2 JK🐉
	ComposeVec3 JK🐉
	ComposeVec4 JK🐉
	BreakoutVec2 JK🐉
	BreakoutVec3 JK🐉
	BreakoutVec4 JK🐉
	FloatUnaryOp JK🐉
	FloatBinaryOp JK🐉
	IntUnaryOp JK🐉
	IntBinaryOp JK🐉
	NumberUnaryOp JK🐉
	NumberBinaryOp JK🐉
	Vec2UnaryOp JK🐉
	Vec2BinaryOp JK🐉
	Vec3UnaryOp JK🐉
	Vec3BinaryOp JK🐉
	Vec4UnaryOp JK🐉
	Vec4BinaryOp JK🐉
Simple Evaluate Nodes
	Evaluate Ints JK🐉
	Evaluate Floats JK🐉
	Evaluate String JK🐉
	Evaluate Examples JK🐉
3D Nodes
	Orbit Poses JK🐉
	OrbitLists to OrbitPoses JK🐉
	OrbitPoses to OrbitLists JK🐉

</details> <details> <summary><b>Group Nodes</b></summary>

Tools
	JK🐉::CLIPSegMask
	JK🐉::Image RemBG
	JK🐉::Image to Prompt (LLava Local)
	JK🐉::Image to Prompt Advanced (LLava Local)
	JK🐉::Pad Image for Outpainting
	JK🐉::SegAnythingMask		
Workflow
	JK🐉::Concept
	JK🐉::Inpaint Simple
	JK🐉::Inpaint Checkpoint
	JK🐉::Inpaint ControlNet			
	JK🐉::Outpaint Simple
	JK🐉::Outpaint Checkpoint
	JK🐉::Outpaint ControlNet
	JK🐉::txt2img

</details>

Reference Custom Nodes

• rgthree
• Comfyroll
• Efficiency Nodes
• ControlNet AUX
• Impact Pack
• Image Saver
• Prompt Reader
• ComfyMath
• Embedding Picker
• Layer Style

Changelog

• 2024-06-23 - v1.0.0 released.
• 2024-07-11 - v1.0.6 Noise Injection for Upscale Workflow.
• 2024-07-16 - v1.0.7 Single Image to Mesh Workflow updated.
• 2024-07-21 - v1.0.8 Orbit Poses Constant nodes added. 3 Image to Mesh Workflows updated.
• 2024-07-22 - v1.0.9 3DGS workflow added.
• 2024-07-24 - v1.1.0 img2mesh workflow updated. Craftsman Mesh added. Three OrbitPoses nodes been added to 3D-Pack.
• 2024-07-31 - v1.1.1 Prompt Combine node added.
• 2024-08-03 - v1.1.2 Resize to Focus added to image2mesh workflow.
• 2024-08-21 - v1.1.3 Random Beats node added (not for AIGC).
• 2024-09-01 - v1.2.0 SD3 workflow added. Noise Injection (Inspire) added. Refine, Upscale, and Detailer process major updated. SD15 Hand Fix supports SDXL and SD3 workflow. SDXL IPAdapter supports SD3 workflow. NoiseInjection Component and workflow added.
• 2024-09-04 - v1.2.1 In/Out Paint ControlNet Component added. Inpaint Module Workflow updated. SD15|SDXL|SD3 Workflow updated. Image Remove Alpha JK node added.
• 2024-09-05 - v1.2.2 Black Pixel switch added for Inpaint ControlNet Component following ControlNet Preprocessor AUX Custom Node's update.
• 2024-09-06 - v1.2.3 Refinement Noise Injection added. txt2prompt and img2prompt workflow added. img2prompt component added.
• 2024-09-07 - v1.2.4 img2mesh workflow doesn't need _JK.pack, so that doesn't need to install segment anything, VLM nodes, and IF AI tools.
• 2024-09-09 - v1.2.5 Clip l, clip g, t5xxl texture encode logic upgrade. Clip l & g switch added. Negative g switch added. SDXL Clip Text Encode Target Resolution Scale added.
• 2024-09-10 - v1.2.6 detailer: add detail lora.
• 2024-09-11 - v1.2.7 Magic Photo Prompter added.
• 2024-09-13 - v1.2.8 Use Comfy UI default set union controlnet type to load xinsir sdxl controlnet union. Remove Inspire Pack and WAS Nodes Suite in img2mesh workflows. Group Node Image RemBG added, using InSPYReNet TransparentBG from Essentials to remove background and Image Composite Masked to add grayscale background.
• 2024-09-13 - v1.2.9 Inpaint Simple updated. Outpaint Simple added. txt2img | img2img | inpaint workflow updated. In/Out Paint to Refinement process added. Upscale to Refinment process added.