Nodes Browser
ComfyDeploy: How CosyVoice-ComfyUI works in ComfyUI?
What is CosyVoice-ComfyUI?
a comfyui custom node for [a/CosyVoice](https://github.com/FunAudioLLM/CosyVoice)
How to install it in ComfyDeploy?
Head over to the machine page
- Click on the "Create a new machine" button
- Select the
Edit
build steps - Add a new step -> Custom Node
- Search for
CosyVoice-ComfyUI
and select it - Close the build step dialig and then click on the "Save" button to rebuild the machine
CosyVoice-ComfyUI
a comfyui custom node for CosyVoice,you can find workflow in workflows
new Feature
suport srt
file to single voice or mutiple voice clone
input
- tts_srt
- prompt_wav
- prompt_srt(optional)
output
Example
test on 2080ti 11GB torch==2.3.0+cu121 python 3.10.8
use case | tts_text | prompt_text | prompt_wav | instruct_text | output
----- | ---- | ---- | ---- | ---- | ----
base tts
| 你好,我是通义生成式语音大模型,请问有什么可以帮您的吗
| | | | <video src="https://github.com/AIFSH/CosyVoice-ComfyUI/assets/149982694/03dcca8b-3ea5-41ac-9cbb-279dffaf6122" />
3s clone tts
| 收到好友从远方寄来的生日礼物,那份意外的惊喜与深深的祝福让我心中充满了甜蜜的快乐,笑容如花儿般绽放。
| 希望你以后能够做的比我还好呦。
| <video src="https://github.com/AIFSH/CosyVoice-ComfyUI/assets/149982694/1055a5e4-676c-486e-abdb-d2b76c08878b" /> | | <video src="https://github.com/AIFSH/CosyVoice-ComfyUI/assets/149982694/fd2c42df-35c9-4ad8-934d-7b0e9e29e7cf"/>
cross lingual
| "And then later on, fully acquiring that company. So keeping management in line, interest in line with the asset that\'s coming into the family is a reason why sometimes we don\'t buy the whole thing." | | <video src="https://github.com/AIFSH/CosyVoice-ComfyUI/assets/149982694/751b0ed0-3c49-463e-ab9f-6dd7f30fa74c"/> | | <video src="https://github.com/AIFSH/CosyVoice-ComfyUI/assets/149982694/ab375378-ab1c-411a-99bf-6d445d12cb2f"/>
instruct
| 在面对挑战时,他展现了非凡的<strong>勇气</strong>与<strong>智慧</strong>。
| | | Theo \\'Crimson\\', is a fiery, passionate rebel leader. Fights with fervor for justice, but struggles with impulsiveness.
| <video src="https://github.com/AIFSH/CosyVoice-ComfyUI/assets/149982694/646ff534-fd50-4c63-ad7e-9402c1457993"/>
How to use
test on py3.10,2080ti 11gb,torch==2.3.0+cu121
make sure ffmpeg
is worked in your commandline
for Linux
apt update
apt install ffmpeg
for Windows,you can install ffmpeg
by WingetUI automatically
then!
## in ComfyUI/custom_nodes
git clone https://github.com/AIFSH/CosyVoice-ComfyUI.git
cd CosyVoice-ComfyUI
pip install -r requirements.txt
weights will be downloaded from modelscope