Add sync audio to video generation with MMAudio: Installation and workflow included.

  Рет қаралды 2,509

Code Crafters Corner

Code Crafters Corner

Күн бұрын

Пікірлер: 41
@fizababar4508
@fizababar4508 Ай бұрын
you elaborate this whole in a very simple way. I explored a lot of other youtubers videos for comfyUI but the basic details they always missed or if they tell but in a tricky way that for beginner who is new in comfyUI like me always messed up the things. Thanks alot for this great value.
@CodeCraftersCorner
@CodeCraftersCorner Ай бұрын
Thank You! Glad you found it helpful!
@MrRandomPlays_1987
@MrRandomPlays_1987 Ай бұрын
Thank you, Im a noob with this whole ComfyUI stuff so it's exactly the video I was looking for and after a quick search in YT I found your video, thanks.
@CodeCraftersCorner
@CodeCraftersCorner Ай бұрын
Awesome! I'm glad you found it helpful.
@CalladsEssence
@CalladsEssence Ай бұрын
Hi Sharvin! Works like dream! Thanks again for your tutorial!
@CodeCraftersCorner
@CodeCraftersCorner Ай бұрын
Thank you! Glad it helped!
@AINMEisONE
@AINMEisONE Ай бұрын
Thank you! This is so amazing! I am checking your workflow!
@CodeCraftersCorner
@CodeCraftersCorner Ай бұрын
Thank you. Be sure to have the correct Torch version install for it to work.
@CamiloAguilar-nr6wj
@CamiloAguilar-nr6wj Ай бұрын
Thank you!!!!!!
@CodeCraftersCorner
@CodeCraftersCorner Ай бұрын
Glad you found it helpful!
@Winale
@Winale Ай бұрын
I have a ComfyUI installation with AMD and miniconda When I launch comfyUI it tells me an error: ModuleNotFoundError: No module named 'torchdiffeq' Cannot import C:\Software\ComfyUI\custom_nodes\ComfyUI-MMAudio module for custom nodes: No module named 'torchdiffeq' But actually, torchdiffec is installed in the miniconda folder This is very specific, but maybe you have an idea what to do? Thank you so much!
@CodeCraftersCorner
@CodeCraftersCorner Ай бұрын
Since you have an AMD card, it's possible the version required is different. the official GitHub says that Torch version should be 2.5.1. You may have to upgrade yours. It might be worth a try. Sorry, not sure since I cannot test without an AMD card.
@aivideos322
@aivideos322 Ай бұрын
Go into comfy ui dir, update folder, use the update comfy and python dependencies.
@CodeCraftersCorner
@CodeCraftersCorner Ай бұрын
@@aivideos322 It does not seem like @Winale have the ComfyUI portable version from the folder path and the mentioned of miniconda. Updating the torch version manually from the terminal might help.
@sudabadri7051
@sudabadri7051 Ай бұрын
Thanks very nice
@CodeCraftersCorner
@CodeCraftersCorner Ай бұрын
Thank you! Happy to hear!
@Ashabarala
@Ashabarala 9 күн бұрын
Hello and thank you very much for this informative video. I have ComfyUI on Stability Matrix. Could you please tell me, How do I install the dependencies?
@CodeCraftersCorner
@CodeCraftersCorner 7 күн бұрын
Hello, I do not have Stability Matrix. The steps will be same since it is still ComfyUI. You will have to replace the python_embeded/python.exe part with stability matrix python executable file. I am not sure where that it since I cannot test it.
@mohamedmed4639
@mohamedmed4639 25 күн бұрын
When uploading the video, is there a watermark? And my second question is, are these videos available for commercial use on KZbin? Thank you.
@CodeCraftersCorner
@CodeCraftersCorner 25 күн бұрын
No watermark and yes for commercial use. The project is under MIT.
@mohamedmed4639
@mohamedmed4639 24 күн бұрын
@CodeCraftersCorner What do you mean by MIT?
@CodeCraftersCorner
@CodeCraftersCorner 23 күн бұрын
@@mohamedmed4639 I meant the MIT License. Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
@tridhe
@tridhe Ай бұрын
Do I need to install any custom nodes other than the video helper suite? Because I am getting missing nodes when I load the workflow. I have already cloned and installed form the github repo. What could be the issue? Error: Missing Node Types When loading the graph, the following node types were not found MMAudioSampler MMAudioFeatureUtilsLoader MMAudioModelLoader
@CodeCraftersCorner
@CodeCraftersCorner Ай бұрын
Hello, you will need to install the mmaudio custom node. In the video, I showed how to install it manually since it was not available in the ComfyUI Manager. Check if you have done all the steps at 7:31 (Chapter Installation) and that there are no errors in the terminal when you restart ComfyUI.
@kxdproductions2375
@kxdproductions2375 Ай бұрын
it didn't automatically install nvidia folder in the mmaudio folder you created after opening up the workflow, says the nodes are still missing on my comfyui
@CodeCraftersCorner
@CodeCraftersCorner Ай бұрын
Did you install the MMAudio Custom Nodes, properly? Like I said, it required torch 2.5.1 which is present in the latest ComfyUI installation. The missing nodes are because you don't have the mmaudio install properly. I explained how to do this at 07:31
@mohamedmed4639
@mohamedmed4639 24 күн бұрын
I am not skilled in using computers. Can you guide me how to install comfy ui for the initial procedure and then complete the rest of the steps to install mmaudio?
@CodeCraftersCorner
@CodeCraftersCorner 24 күн бұрын
There is a video title: Installing ComfyUI & ComfyUI Manager made easy! Here is the link: kzbin.info/www/bejne/p3yyZ6OQdttjoK8
@eoprodn-palmier2944
@eoprodn-palmier2944 9 күн бұрын
Hi, can you help me ? i have this issue : MMAudioSampler mat1 and mat2 must have the same dtype, but got Half and Float
@CodeCraftersCorner
@CodeCraftersCorner 7 күн бұрын
Can you check if you are using the fp16 or fp32 version. The workflow included is set up for fp16 version.
@mohamedmed4639
@mohamedmed4639 25 күн бұрын
Do I have to use a specific version of Windows to download the file?
@CodeCraftersCorner
@CodeCraftersCorner 25 күн бұрын
You will need the latest version of ComfyUI. Since you are on Windows, you can download the latest portable version. It has the necessary dependencies for this project to work.
@mohamedmed4639
@mohamedmed4639 24 күн бұрын
Is there a specific number of videos I can produce daily with MMoudio?
@CodeCraftersCorner
@CodeCraftersCorner 24 күн бұрын
No, you can generate all day, locally.
@mohamedmed4639
@mohamedmed4639 25 күн бұрын
Can I download the file from a Windows 7 device?
@CodeCraftersCorner
@CodeCraftersCorner 25 күн бұрын
You should be able to. As long as you have a GPU for the audio generation, you should be good. You will need ComfyUI to run it.
@bestof467
@bestof467 Ай бұрын
Its pronounced 🔊"AW-DIO"😂
@pwknai
@pwknai Ай бұрын
Do you think this generator can make a sound effect for KumgFu action fight?
@CodeCraftersCorner
@CodeCraftersCorner Ай бұрын
I tried it, it does not generate the sound, "yeeehh, haaahhh" stuff but maybe with some better prompting. I got it to do a broken window effect (sort of). I think it is best if you can isolate the action to a single clip and generate the sound effect, one at a time.
@pwknai
@pwknai Ай бұрын
@@CodeCraftersCorner just in my guess... I think the generator doesn't recognize or imagine human' voice sound not like natural sound wind.. dropping... crashing... etc. either I didn't expect that could make Bruce Lee shouting hahaha.
Improve your Prompting with ConDelta in SD1.5, SDXL and Flux
16:25
Code Crafters Corner
Рет қаралды 3,8 М.
Cat mode and a glass of water #family #humor #fun
00:22
Kotiki_Z
Рет қаралды 42 МЛН
This AI agent swarm AUTOMATES my schedule! (n8n agents)
18:44
AI Foundations
Рет қаралды 4,3 М.
Audio Reactive Playhead - ComfyUI Tutorial
9:09
Ryanontheinside
Рет қаралды 3,9 М.
ComfyUI Adds Native HunYuan Video Generation Support: Is It Worth Trying?
9:37
Code Crafters Corner
Рет қаралды 4,2 М.
CREATE Unlimited Music on Your Computer in Minutes for FREE!
8:57
mhfx_ai_creative
Рет қаралды 1,8 М.
Generate Consistent Multiview Characters with MV Adapter
17:23
Code Crafters Corner
Рет қаралды 4,4 М.
Cat mode and a glass of water #family #humor #fun
00:22
Kotiki_Z
Рет қаралды 42 МЛН