Stable Diffusion Full Tutorial: Text To Video Animation

[@iratewatcher]

2:01 author forgot to mention that you should actually run "A1111 WebUI (Pin to Taskbar)" file, so it'll proceed with instalation of SD, otherwise you won't have that folder, that author is talking about. We see that you already have run this tool on the background, but still I guess in sake of the tut video such detail is important for a viewer.

[@Thisisitboys]

Thanks for this

[@meshuggih700]

chatgpt helped me install everything on mac M1, now it shows me your video to get me started XD

[@ParvathyKapoor]

Can i get that prompt?

[@hellfrozen3678]

wow such a good and easy tutorial,I watched some other youtuber's tutorial and got so annoyed by it because the guy did not leave any text in the description,yet he made a patreon asking for money for us to get the text(which he did not make)

[@HustleMillennial]

Happy to help! Honestly if you’re wanting to push the limits, check out my depth map tutorial. Will blow your mind guaranteed!

[@muggle_world]

Thankyou brother for this video...30 days ago i started my channel with your tutorial ...improving everyday and got 211 subs in that periods... thankyou for this😌

[@HustleMillennial]

Keep going!

[@tuaninhcong6954]

hey when i download the webui, there are only launcher and pin to task bar, there's no stable-diffusion-webui

[@story_mode]

After i installed the A1111 webui , there is no stable difusion folder inside, only launcher and shortcut, what can i do?

[@VishalSingh-kt2gv]

I have the same issue. Please let me know if you found any solution to the same

[@HustleMillennial]

Trying to find a solution for you but I can’t seem to replicate the issue. I did notice I have two separate a1111 files. One in C drive and one in D. Only one contains the SD files

[@Evans_Lab]

Error: ''DepthModel' object has no attribute 'should_delete''. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of \. Full error message is in your terminal/ cli.？？？？

[@aldisalmaa9005]

Same

[@jerzipendleton6443]

Go to the depth and click it off it takes forever to export tho!

[@enmodevrai2vrai91]

Same problem

[@jerzipendleton6443]

@@enmodevrai2vrai91 I’ve been just doing it in 2d and doing it in smaller size

[@COGjedi117]

I downloaded the A111 web UI installer but it didn't seem to include the stable diffusion folder.

[@Arjun-tw4qh]

Same problem reply has

[@vikyjack6590]

Error: 'CUDA out of memory. Tried to allocate 450.00 MiB (GPU 0; 4.00 GiB total capacity; 2.91 GiB already allocated; 0 bytes free; 3.13 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF'. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of \. Full error message is in your terminal/ cli

[@imbarinderkumar]

Finally I'm found Superb Tutorial, easy to understand. Thank you

[@HustleMillennial]

Thank you for the kind words!

[@juancamilomartinezdiaz7482]

Error: ''types.SimpleNamespace' object has no attribute 'cn_1_weight''. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of \. Full error message is in your terminal/ cli.

[@kavishshakdwipee2097]

+1

[@jhonycruz421]

Thank you so much brother . I’ve being going mad trying to find out how to do these effects

[@randymonteith1660]

The init image does NOT have to come from a video any still image will work. Great video!

[@HustleMillennial]

Very true! I mentioned near the end the only reason I did that was for the intro flow 🤗 Suppose I should have mentioned it sooner!

[@makinebeast3322]

You are the best i would really watch ur guides CZ I JUST started having fun with A.I art, u earned my sub

[@HustleMillennial]

Create something amazing! 😃

[@dnvman]

what the formula does detaily described in "math in deforum" doc which you can find in help tab. there's a few other interesting formulas you can combine to get fire results 🔥

[@ItsAixs]

Is the A1111 Webui Launcher Safe? I tested it on VirusTotal and says the file is Malicious.

[@HustleMillennial]

I use it daily so I sure hope it is haha. Tens of thousands of github users and developers trust the code as well so I don’t think there’s an issue.

[@ItsAixs]

@@HustleMillennial Ok

[@undef1n3d_]

I followed all the step and somehow still had this error message: "Error: 'unsupported expression type: '. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of \. Full error message is in your terminal/ cli." I've checked the orientation of the dashes and it still pops up. I believe the error has something to do with the first part of the error message, which is more vague. Does anyone know how to fix that? It's very frustrating.🤬

[@amerykaautopl]

I don't have "v122" folder !! 2:34'' . Could you help ?

[@aishajamila]

Great tutorial. Thanks. Can you please make a tutorial where you explain all about the keyframes? I get really confused about how exactly they work and it often becomes a mess

[@HustleMillennial]

I definitely can! We have a looong line of tutorials coming but I’ll get to it.

[@aishajamila]

@@HustleMillennial fantastic. Thanks 🙂

[@CosplayCornerYT]

hello, i use i7 10gen rtx 2060 , when i followed this process it says 20hrs left. do u have any idea to speeden up the process

[@ronaldbruneau1980]

Honestly I don't think the 2060 is going to cut it.....

[@omoneogie3577]

thank you so much for the brilliant tutorial. I am new to this and I absolutely loved every step of this. Is it possible for you to copy the 'prompts' on this tutorial? i am trying to use the same parameters to finish up my tutorial and it is giving me some errors. highly appreciated! thank you spect

[@yuvickvlogs]

Error: ''int' object is not callable'. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of \. Full error message is in your terminal/ cli.

[@ronaldbruneau1980]

Does any model work or is it only the one in your tutorial?

[@lady_5xl]

13:19 prompts can you give me the codes there? please

[@goran-mp-kamenovic6293]

Collecting torch==2.1.2 it gets here when I start and nothing happens. what could be the problem.

[@Lw24_AI]

Why does stretching and streaking come out in the opening frames?

[@HustleMillennial]

I mistakenly used an AR 16:9 when I should have used a 9:16

[@godzilla927]

Hi. I'm a first time patient at this art form. I'm well versed with midjourney and want to go to the next level and I can't thank you enough for being so well versed with your explanations. Chefs kiss. One question..regarding the image snapshop.. what if you don't have that particular app, can you use the photoshop timeline and if so does it have a snap shot? Thanks

[@HustleMillennial]

You can use any photo to start the prompt. 😊 I used a snapshot as I wanted it to pick up a frame on the video as shown in video intro.

[@ronaldbruneau1980]

So it can be any old pict on your computer and not part of a video?

[@99SapiBisaPintu]

I have a problem with installing the torch and Tourchvision

[@GomezBro]

Bro, that Wallpaper? Where? Please tell me...

[@HustleMillennial]

On my desktop?

[@fabiotgarcia2]

I can not run it. Got this error: Cannot convert a MPS Tensor to float64 dtype as the MPS framework doesn't support float64. Please use float32 instead Could you please tell me what to do?

[@niru7206]

I have done everything you suggested but ended up with this error >>> Error: 'argument of type 'NoneType' is not iterable'. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of \. Full error message is in your terminal/ cli. Time taken: 17.61s Torch active/reserved: 1/2 MiB, Sys VRAM: 1003/6144 MiB (16.32%)

[@naiyoupeigen]

Hello, I use defforum to make videos, and sometimes I get the following error, which interrupts the video being produced Error: 'maximum recursion depth exceeded while calling a Python object'. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of \. Full error message is in your terminal/cli. what is the reason? Is there a solution, thanks! !

[@maratmavlihanov]

Please tell me how to install deform stable diffusion on mac OS?

[@aantole3470]

sir, why mine is keep failing when downloading torch and torchvision? after 2.5gb it suddenly stopped and long red errors appear

[@BeetjeVreemd]

Hi, thanks for the tutorial, I have this problem where generally speaking things looks like they're working as intended, except for when the camera starts moving, then you see a vertical line/not smooth transition to the next frame(s)/images. I checked all the settings, but i think i really did get it right with copying your settings correctly. Any idea where to look for the solution?

[@NomadicJurassic]

Same here. seems to only generate the first prompt and then rolls the movement animation. Try selecting. 'use image as video' in the Hybrid Video tab.

[@KambeShow]

JSONDecodeError: Expecting ',' delimiter: line 6 column 5 (char 279) What is this problem can someone explain that to me pleas and how fixed ?!!

[@semangat9673]

How do I change the prompts sir? where did you get that prompt?

[@NotThatTallAtAll]

Hey thanks for the video! I was having some diffuculty loading settings I had for a previous project. Im using rundiffusion. Could you explain to me how to do that?

[@desishala]

how can we speed up the rendering ? it took me 2 hours 😢please make a video on how to reduce rendering times

[@HustleMillennial]

Unfortunately render time is heavily dependent on GPU power. When loading A1111 you can select the Low VRAM option to assist. Alternatively you can use Disco Diffusion (tutorial is up) which allows you to outsource the GPU processing to googles servers.

[@dnvman]

if you use 8gb or lower gpu then 2 hours for render 600 frames is pretty nice result 😅

[@ibrahimalsherief2690]

Also send Question ? is there any way to put the setting so it downloags it to 9:16 format ? Than you !

[@ibrahimalsherief2690]

is it the with 720 and hight 1280? for the 9:16 format?

[@HustleMillennial]

@@ibrahimalsherief2690 correct! If you want to change the format / layout, you would change those dimensions.

[@stashboxband]

See my models > Stable-Diffusion folder is missing the reAnimated_122 file ? thats not in models how come that isn't showing up did I do something wrong with the installs?

[@HustleMillennial]

There’s two “models” folders. Make sure it’s in the right one :) There is a base models where your checkpoints go, then another where your processor models are placed.

[@stashboxband]

@@HustleMillennial I'm going to the models folder you go to but that file you alter isn't there?

[@AKS_Oman]

thank alot ihave this problem can you tel me the answer Error: ''types.SimpleNamespace' object has no attribute 'cn_1_weight''. Before reporting, please check your schedules/ init values. Full error message is in your terminal/ cli. Time taken: 0.4 sec. A: 2.03 GB, R: 2.04 GB, Sys: 4.3/24 GB (18.1%)

[@ciriloZking]

Is it possible to download all of this for Mac as well?

[@Smartearningswaida]

i did what you did but do you know why I get this error: Error: 'invalid syntax (, line 0)'. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of \. Full error message is in your terminal/ cli.

[@HustleMillennial]

Do you have quotations around your init? This messed with me when I first started.

[@phillipboyer4190]

@@HustleMillennial yes but so do you in the video. I have this same error and cant figure it out so please let me know if you can

[@hdgaming7390]

same error

[@OneBravoFour]

I got a very similar error. Fixed it by not turning on the Depth Warping. Hopefully that'll fix it for you?

[@Smartearningswaida]

@@phillipboyer4190 I found a way I wanted to share with you I hope it helps, instead of using the link pathname of the picture in your computer, drive… turn that picture to a link in the browser then use that URL in the init. I did it worked and I didn’t get any errors anymore.

[@BamcBamc]

FOr some reason i cannot do step with Depth Warping & FOV. Please switch to 3D animation mode to view this section but 3D animation mode is enabled

[@HustleMillennial]

Are you set to Karras as well??

[@BamcBamc]

@@HustleMillennial Yes, just reseted all settings, and looks better

[@idlemind4086]

Jump to 8:00

[@jamiemarshall763]

ControlNet not found. Please install it :) -Any ideas?

[@oblogames]

idk man how that stable diffusion web ui folder came into ur folder it doesnt come inside mine pls make a crystal clear tutorial thanks

[@batuwoodart]

Error: 'Init image path or mask image path is not valid'. Check your schedules/ init values please =((

[@idlemind4086]

0:(-0.06*(cos(3.141*t/15)**100)+0.06) this kept causing me to run into errors.. not sure why.. are you sure it should be -0.06?

[@dentaorp2451]

mine is having this error '' Error: 'Invalid control character at: line 7 column 25 (char 657)'. Check your prompts with a JSON validator please. Full error message is in your terminal/ cli.'' do you know how i solve it

[@AbdullahSamirAbood]

Amazing, can you make a tutorial that works for Mac?

[@HustleMillennial]

When I get my hands on a Mac I will crank out the tutorials for it!

[@rifqinaufal6]

My windows need installed pytorch, i canceled because i don't have internet data. Just wondering how much the size pytorch after i installed?

[@ujangpineapple]

sir, sorry I have a problem, how to overcome "AssertionError: Torch is not able to use GPU; add --skip-torch-cuda-test to COMMANDLINE_ARGS variable to disable this check"

[@JoeColasuono]

will this be the same workflow or would it be different if you were to try to do this on a macbook pro with a m1max chip?

[@HustleMillennial]

I wish I knew >.< I’ve never experimented with a mac

[@JoeColasuono]

@@HustleMillennial damn :/ I’ve been tryna find help on why I keep getting certain errors by no one does it on macs so I’m kinda loosing hope on it 😂😂😂

[@bdnwfantaziedreams]

amazing and I used Clone AI which is preset and that is fast but you cant adapt to what you want. Thanks for sharing

[@bigbull5975]

Idk why its cloning taming transformer repo.. and after that its getting runtime error! How to fix this?

[@MarioAymanTX]

A lot of thanks bro, Now I have a problem, After installing and opening it saying "Access is denied. Couldn't launch python". How can I fix that ?

[@SouthbayCreations]

Can you use the “webUI Launcher” if you already have A1111 installed? I would like to give that a try but don’t want to mess up my current installation. Great video! Thanks!

[@SouthbayCreations]

If anyone else was wondering. Yes you can.

[@jessecool561]

Do these steps work wih SDXL?

[@OneBravoFour]

Awesome, thank you. Been struggling so much to try and figure this part on my own. All in that motion I guess. it was all crashing on my end repeatedly, turns out it was the Depth Warping, which I've never ever tried before. Mind you, I'm missing Depth Algorithm on my end. So no clue about that. Will look into that further. If you've any hints then it'd be highly appreciated. Again, thanks for this video. You've a new sub.

[@HustleMillennial]

I’ve never messed with the depth warping O.o I almost want to now so I can break things and find a fix lol. Appreciate you watching! If you’re really into messing around with this stuff check out my DepthMap tutorial. My new addiction right now 100%

[@OneBravoFour]

​@@HustleMillennial Looking at it now. 🙂

[@vbhacker]

can you please share those prompt or where we can find customized once, it will take hours to keep testing diffrent ones, it would be helpful to find users who already tested and had good results

[@BrandonMitchell84]

agree

[@HustleMillennial]

Heya! Which prompts were you talking about? Happy to share anything

[@BrandonMitchell84]

@@HustleMillennial the ones used in the video

[@freiwildgiraffe9849]

Does this work for Mac too?

[@CRIMELAB357]

I have no graphics card, will it work on my laptop? 😬😬😬

[@ia_technojnoun]

Merci à toi pour le tuto ! j'ai pu enfin faire une bonne vidéo après des semaines de recherche :D

[@HustleMillennial]

C'est bon à entendre! Continuez à créer!

[@sonsofgaiafestival3729]

AssertionError: extension access disabled because of command line flags on deforum install

[@jepagunos7454]

Bro i use different model but the PROMPTS not changing is the same PROMPTS with the first one that i used. Even check point already changed. THANKs IN ADVANCE.

[@danielthissen]

Hi, thanks for the video, can I use rundiffusion with deforum and all your settings ? I have a Mac :(

[@HustleMillennial]

I’m honestly not sure. Briefly looking at rundiffusion though I don’t see why it would be a problem. 🤗

[@shortsbartu]

?????? Error: 'list index out of range'. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of \. Full error message is in your terminal/ cli.

[@LawsOnJoystick]

same :( no fix tried so much

[@KoKoShIoYouTuber]

I just copy my JSON code to chat gpt for saveing it for later and gpt said wow u have error here and he repair code for me. Try same :)

[@aaryaweddingfilmsrajkot.8187]

Error: 'Expecting property name enclosed in double quotes: line 8 column 8 (char 767)'. Check your prompts with a JSON validator please. Full error message is in your terminal/ cli. Time taken: 0.00sTorch active/reserved: 2069/2082 MiB, Sys VRAM: 3393/8192 MiB (41.42%) please give me a proper prompt

[@HustleMillennial]

Error message is saying your prompt or part of your prompt is not in double quotes like: “prompt”

[@piximilie]

Can i use the software on low PC?

[@HustleMillennial]

You can! In the original A1111 window, select the low vram option.

[@csabarista3499]

the 3rd link brings up a different package from the video

[@ibrahimalsherief2690]

i loved you vedio easy to understand. I would like to increase the frame but i am scared that everything will become out of order. Is there somewhere where I can learn for about this and the setting in particular.

[@HustleMillennial]

I will do some digging!

[@NevermoreAcademy-hk6qd]

bro iam wanna ask to you if on low divece i have crush and error. this not suport on low drvice right

[@HustleMillennial]

You may need to launch A1111 with the Low VRAM option box checked!

[@NevermoreAcademy-hk6qd]

@@HustleMillennial i try and i checklist with low vram and my laptop only 2vram with nvdia mx230 so i cant do that

[@TheAiDiver1994]

Thank u for ur video!!! Really appreciate, just wonder how to check if the deforum is using CPU or GPU ? Or it will automatically using GPU ?

[@HustleMillennial]

It defaults to the GPU :)

[@TheAiDiver1994]

@@HustleMillennial that's great , thank you for ur replying , have a good day !!

[@daemon_labs]

Is it possible to do this with the video instead of an image?

[@HustleMillennial]

Yes! Check out my disco diffusion tutorial :)

[@daemon_labs]

@@HustleMillennial I tried that one but my output video looks the same as the input video.

[@sonoraai]

i keep getting this error: Error: 'CUDA out of memory. Tried to allocate 450.00 MiB (GPU 0; 6.00 GiB total capacity; 4.35 GiB already allocated; 0 bytes free; 5.01 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF'. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of \. Full error message is in your terminal/ cli. help !!

[@darynp9025]

You don't have enough memory on your graphics card. Make sure you're not using any other programs that take up your vram and that you have xformers installed and enabled on stable diffusion.

[@gumvue.studio]

hi, good tutorial , question, deforum stop working on google colab free acounts? I cant run mine . I have another pro account works fine. but on my free one , no.. anybody can confirme this??

[@HustleMillennial]

I believe colab now allows only a small alotment of GPU usage for free accounts.

[@Tas3677]

Lunch and error" torch not able to use gpu"

[@sarath4797]

work on AMD graphics card?

[@catworld808]

How to check the generating video progress mine is processing | 6086.1/0.8s and after 2 hrs also nothing happens 😢

[@HustleMillennial]

Check your output folder. It may appear stuck but have already finished

[@vampires4hire57]

tourch is not able to use gpu?

[@HustleMillennial]

Try reinstalling python and be sure that "Add Python To PATH" is checked during install.

[@vampires4hire57]

@@HustleMillennial definitely tried that, might it be because my amd gpu

[@Ezel_Bey]

great tut bro thanks

[@HustleMillennial]

Thank you for watching and taking the time to comment!

[@nehasts5686]

I have no graphic card, will it work on laptop...plz reply

[@HustleMillennial]

Try using my Disco Diffusion tutorial. That lets you use outsourced VRAM.

[@Draqee4]

can you give me your promt or anyother way from i can get promts ?

[@LaCatalina]

Огромное спасибо за такой наглядный туториал, особенно за параметры в описании видео! ❤ У меня все получилось по этому уроку. Правда лицо вдалеке немного пострадало, когда камера начала двигаться, но restore face делал только хуже всю детализацию картинки. Но мне все нравится)

[@Pathfinder_tua]

Hi Hustle, would you be willing to provide a 1 to 1 private one hour session as a lesson to teach me this? Your videos are great but I have so many questions and Im a complete beginner. Thank you

[@NeelamS-dv4pc]

Hey Thanks for the video Can 2060 super run this?

[@HustleMillennial]

Should be just fine! There’s a low VRAM option as well which may be better.

[@sathien9158]

is this impossible for a 3060ti 8gb?

[@HustleMillennial]

That’s what I’m running! :)

[@sathien9158]

@@HustleMillennial great!!!!

[@letohailong6793]

Bro thank you so much

[@HustleMillennial]

Happy to help!

[@NatachaW-d8i]

need colab version

[@Geo_6214]

my last problems fixed but it says it gonna take 132 hours or days to finish so theres definitely something wrong if I entered the same settings as yours

[@haroldyabutsantander]

thank you boss

[@creativeshape]

Merci!

[@ChrisWoodsViolin]

Strange that the screenshot is stretched width

[@HustleMillennial]

I definitely should have fixed the input aspect ratio haha.

[@MREDZ]

God damn it, why does every single tutorial I see like this skip the video init tab. What do I put in the video init url box? 😭 When I link the path for the initial video I just get a generation that looks exactly like the initial video just with an animated kind of style. Someone help me please.

[@BrandonMitchell84]

i had lots of issues getting it to work , i thought my machine would be ok for it but i only have a 3060ti dual 8g total vram so i think thats my bottleneck

[@HustleMillennial]

This is just a base 3060. Not even overclocked. You shouldn’t be having any bottleneck with a ti O.o

[@Berbagiinformasiii]

i have error with launcher :(

[@HustleMillennial]

What’s the error??

[@bigbull5975]

The 3rd link is of protogen model and not of rev animated

[@HustleMillennial]

I updated it as protogen is much more advanced. The link takes you to Civit models however so you can choose from all their models.

[@bigbull5975]

@@HustleMillennial yeah i went with then with rev animated there 😁