EASILY Create Renders From A Sketch With AI - Stable Diffusion and Controlnet Tutorial

[@MauroMan_]

acaso no hay una ia que lo haga en tres pasos máximo ??.. qué manera de complicar todo... !

[@RBDesignWorks]

This is a really cool video. I want to try it on bathroom designs. Thanks!

[@ddm0147]

What if Im not using scribbles and instead using a sketchup screenshot of a 3d angle of a project? has a bit of color but is unrendered. Does the scribble effect still apply, and are there any changes in the steps?

[@id104335409]

Every single one of these "simple" methods is like this: You want to know if its going to rain? Here's what you need to do: take a shovel, raincoat and a fishingpole! Place an alarm clock in your fridge! Now take the next bus to the second city nearby and wait in the woods till friday... BRUH, I JUST WANT TO KNOW IF ITS GONNA RAIN OR NOT!!!

[@altArchitecture]

Hah! Right there with ya

[@whynopotatos]

As someone who understands very little about this topic, this video was an amazing tutorial. Thank you! It should be said though that if your computer doesn't have a Nvidia branded GPU, your computer will not generate images from sketches within a decent amount of time. After following this tutorial and spending about 10 solid hours playing with stable diffusion and researching how to get SD to generate one image in less than 45 minutes, the only solution I can find is that you either have to pay for Google Collab, or update the computer's GPU. If anyone can provide me with information proving this research wrong - I'd love that and be sincerely grateful. As of now I believe: if you're like me and wanted to use stable diffusion to create architectural renders for free with a basic intel GPU laptop - it won't happen. More likely you'll have to spend your money on Midjourney.

[@preranawankhade-v4t]

What gpu you have

[@rafael_tg]

Hello. Thanks for the video. Which models would be good for image to image, e.g. input=empty room -> output=same room with furniture and decoration or input=photo of my living room -> output=redesign of my living room with new furniture and decoration?

[@altArchitecture]

I’d have to go with empty room > room with furniture. The input with just bare walls, floors, windows, etc will make a better canvas to be populated.

[@baljitkaur2973]

Does stable diffusion with control net only work with nvidia?

[@mustafakuvel7674]

are you still using ? i succesfuly downloaded but not able to generate any image yet

[@jacobmekari2932]

Hello, thank you first of all for sharing this. I’m having trouble when in stable diffusion, next to preprocessor the (model) area doesn’t have any options it just says none. Can you help me resolve this

[@altArchitecture]

Try the section titled "Download Realistic Vision" @4:46 again and let me know if you missed a step!

[@jacobmekari2932]

Thank you!

[@ilankava]

hi there! i need some help here, around minute 6, i did all the process of the windows batch file, it downloaded all, then i clicked the space bar and now i get this ( and can not find the running on local url address) : venv "C:\AI\stable-diffusion-webui\venv\Scripts\Python.exe" Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)] Version: v1.6.0-2-g4afaaf8a Commit hash: 4afaaf8a020c1df457bcf7250cb1c7f609699fa7 Traceback (most recent call last): File "C:\AI\stable-diffusion-webui\launch.py", line 48, in main() File "C:\AI\stable-diffusion-webui\launch.py", line 39, in main prepare_environment() File "C:\AI\stable-diffusion-webui\modules\launch_utils.py", line 356, in prepare_environment raise RuntimeError( RuntimeError: Torch is not able to use GPU; add --skip-torch-cuda-test to COMMANDLINE_ARGS variable to disable this check Press any key to continue . . . can you please help? i'm almost there!

[@rogercls]

Good video, but this grid background is absolutely terrible to look at.

[@altArchitecture]

Thanks for your feedback! Do you think making it larger would be better?

[@williasafitri5905]

Paid?

[@danieljohn4014]

just wondering when would you use this in practice?

[@ykaanozyurt]

It says "RuntimeError: Not enough memory, use lower resolution (max approx. 640x640). Need: 0.4GB free, Have:0.1GB free" when i tried to generate the prompt. Could you tell me what should i do to increase memory?

[@altArchitecture]

I found a possible fix online. Please report back if it doesnt fix your problem. Its a lesser known bug with SD. Right click the web.ui-user file and select edit. Change the line from "set COMMANDLINE_ARGS=" to be "set COMMANDLINE_ARGS=--medvram"

[@ykaanozyurt]

Thank you for your attention; when i open the file with wordpad, there is no exact line that you mentioned. Could "export COMMANDLINE_ARGS="--medvram" need to be change at this situation? Or do i need to add the exact line to the file?@@altArchitecture

[@raquelgregorio8310]

Could I do the same test but for a buildings facade instead of its interior? Or Is midjourney better for it?

[@ma__ku]

i am wondering the same thing can you guide us about that

[@Dehancer]

Hey, we're loving what you do here!! we'd like to collaborate with you. Please let us know how we can get in touch.

[@kaiserchopp8892]

Best tutorial I ve watched in a long time and i watch a lot of them. Thanks alot. Great work!

[@jsrender1]

Super well explained and organized thank you so much. More architecture related vids would be great

[@altArchitecture]

Thank you! 😄

[@Anna-LenaBuhler]

Hello thanks for the video, i downloaded the sd-webui-controlnet extension but it won't show up on my stable diffusen. Is there anything I could have missed? tanks.

[@DanielThiele]

Do you have a workflow tutorial, or are you interested in making one, that also generates orthogonal views / model sheets from the initial sketch? I know there is things like char turner but so far it alsways works based on text input only.

[@alexandravoitenko232]

Unfortunately there is a problem, when I run webui-user it gives an error: Couldn't launch python. exit code: 9009. Could you please help with it?

[@AleQcMx-LD]

Not working. NansException: A tensor with all NaNs was produced in Unet. This could be either because there's not enough precision to represent the picture, or because your video card does not support half type. Try setting the "Upcast cross attention layer to float32" option in Settings > Stable Diffusion or using the --no-half commandline argument to fix this. Use --disable-nan-check commandline argument to disable this check.

[@johnbell1809]

Super awesome tutorial. Easy to follow. I pasted the Scribble Model into the model's folder, but I don't seem to have any files in there whereas you have a ton of files in there. Also, have it processing an image but it's taking about 20 minutes for one image. Is this correct?

[@altArchitecture]

It's okay. I have more models to use in SD. Remember when you downloaded the scribble model? on that same page are a long list of other models you can try out. There's a lot of tuts online for them but in my opinion the scribble model is the most useful for arch at the moment. My computer is decently fast so that could be why its processing quickly.

[@fotoGR3at]

Awesome - I tried it and it works . Now what's the easiest way to go back to it after I logged off ? Thank you

[@altArchitecture]

Check out the bonus tip at the end! @10:00

[@el_me3margy]

hello, can you please help me? i get this message at the end.. Stable diffusion model failed to load Applying attention optimization: Doggettx... done. what should i do?

[@altArchitecture]

Ay the end of running webui-user.bat for the first time when it takes a long time to install? If not give me a time stamp from the video so I know what step you are on or when you are getting the error

[@gunnersen1337]

Error when tying to run the webui-user. getting this message: Couldn't launch python exit code: 9009 stderr: 'python' is not recognized as an internal or external command, operable program or batch file. Anyone know what to do?

[@kstrix]

great tutorial, can't wait to use it! having trouble getting past the Stable Diffusion "install from URL" at 7:08. you said it might take a lot of time - i've been processing for 8 hours or so - should i keep waiting?

[@altArchitecture]

Were you able to resolve your issue?

[@kaanbekaroglu3225]

can you also make a lumion + mid journey/stable diffusion workflow video?

[@altArchitecture]

This is a great idea. If you render out a Lumion scene in all white/studio then import into stable diffusion you can practically create a render from your own 3D model.

[@baljitkaur2973]

I got through all the steps but unfortunatly when I went to generate some images I got this error message. FileNotFoundError: [WinError 3] The system cannot find the path specified: ''

[@homagebackup6404]

love ur intro and branding

[@altArchitecture]

Thank you very much!

[@barbadaalpha]

THIS... is EXCELLENT !!!! And I mean it 👍👍👍🙂🙂🙂

[@altArchitecture]

Thank you!!! 👍👍

[@PlanetMariart]

Hey! I followed all the steps but there's no scribble model option for the model when I upload the sketch. It just says none. Any idea what the issue could be? Thanks for the video

[@PlanetMariart]

I hit the refresh button next to it and it worked👍

[@altArchitecture]

Great I’m happy it worked out!

[@Helena-vv6rz]

Hi, thanks for the video, I watched this and your Midjourney one. So is the essential difference between stable diffusion and midjourney, that when starting from a 3d sketch, stable diffusion will retain the original geometry, spatial parameters and contents (eg. furniture) and render it, where as if you upload the same 3d sketch to midjourney it will use the image as guide and reimagine the spatial parameters and contents? or is there a midjourney prompt that will ask it to retain the spatial parameters of the sketch? thanks

[@altArchitecture]

Hi Helena, that’s a really good analysis and your pretty correct. At the moment Midjourney isn’t as precise as stable diffusion in getting exactly what you want, but in my opinion it can produce very inspiring images quickly and easily.

[@Helena21165]

Ok thanks. Guess I need to dive into stable diffusion then! Midjourney looked easier so I started there 😂

[@Range_Development_Services]

@altarch when I click batch, I get a runtime error not able to use GPU...thoughts?

[@SantiagoPeraza-nu6gm]

Is it possible to do this with midjourney? thanks!

[@dalalalobaidan3461]

Hello, thanks for the great tutorial, I was wondering if I could download it on my MacBook?

[@aryandhani]

Thanks for the tutorial sir 🙏

[@altArchitecture]

Of course! Thanks for watching

[@liamryan2870]

Amazing Video, thanks man

[@altArchitecture]

I'm happy you liked it!

[@NYCgoblue]

May I ask why you chose 1.5 over 2 and XL?

[@tylerhowell3111]

Correction: I fixed the first error. Now I'm receiving the following: 'NansException: A tensor with all NaNs was produced in Unet. This could be either because there's not enough precision to represent the picture, or because your video card does not support half type. Try setting the "Upcast cross attention layer to float32" option in Settings > Stable Diffusion or using the --no-half commandline argument to fix this. Use --disable-nan-check commandline argument to disable this check." I changed the setting to "upcast cross attention layer to float32" but no luck

[@hussainziyath1799]

I am having the same problem. let me know if you have any luck please!

[@BrianMarais-x4y]

RealisticVisionV20 Doesn't show available at the checkpoint (time stamp 8:10) how do I fix this?

[@altArchitecture]

It’s possible you may have skipped this step 4:46 download realistic vision (and move it into the checkpoints folder)

[@ziyi1420]

Thank you

[@altArchitecture]

You welcome! 👍👍

[@JS-zd4yp]

Exactly what i was looking for thanks so much

[@altArchitecture]

Glad I could help!

[@JS-zd4yp]

@@altArchitecture i was stuck on realistic vision, there are not too many tutorials that go all the way through the process like this.

[@altArchitecture]

@@JS-zd4yp thank you. Yeah I noticed they all assumed you know stable diffusion already. I mean 90% of people don’t have the time to learn it…I hope I made it easy and clear

[@rodrigoArch]

Wow! really cool. Thanks!

[@thelittletitanx3608]

🌹

[@altArchitecture]

Why thank you very much 🕺🏻 🌹

[@faisalabdi6350]

Can you do the opposite, turn image into outline sketch?

[@altArchitecture]

Great question! I’ll look into that.

[@contatoMyHouse]

I was able to do the downloading steps but got this Error. Can anyone help? OutOfMemoryError: CUDA out of memory. Tried to allocate 64.00 MiB (GPU 0; 4.00 GiB total capacity; 2.85 GiB already allocated; 0 bytes free; 2.89 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF Time taken: 9.34sTorch active/reserved: 2935/2968 MiB, Sys VRAM: 4096/4096 MiB (100.0%)

[@altArchitecture]

Try decreasing your batch size to around 15. It's an option in stable diffusion.

[@stafescritorio394]

@@altArchitecture, Thank you. I tried it already and didn't work.

[@altArchitecture]

@@stafescritorio394what happened?

[@darkB2266]

Thank you for your time and effort.

[@Davesivak]

Man this was one of the best I have seen!

[@a.miroshin]

It helped!

[@alwayspositivealways]

possible with MJ?

[@altArchitecture]

Midjourney isn’t able to do it as well as stable diffusion

[@RajaRouf-q6i]

I am facing an issue please tell me what to do "venv "C:\Ai\stable-diffusion-webui\venv\Scripts\Python.exe" Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)] Version: v1.4.0 Commit hash: 394ffa7b0a7fff3ec484bcd084e673a8b301ccc8 Traceback (most recent call last): File "C:\Ai\stable-diffusion-webui\launch.py", line 38, in main() File "C:\Ai\stable-diffusion-webui\launch.py", line 29, in main prepare_environment() File "C:\Ai\stable-diffusion-webui\modules\launch_utils.py", line 268, in prepare_environment raise RuntimeError( RuntimeError: Torch is not able to use GPU; add --skip-torch-cuda-test to COMMANDLINE_ARGS variable to disable this check Press any key to continue . . ."

[@altArchitecture]

This is an error I received while trying to use SD on my 10-year-old laptop. This fix did not help me but it helped others. Are you running this on a slow/old computer? Try this fix listed in the video description: Error message "Torch is not able to use GPU; add --skip-torch-cuda-test to COMMANDLINE_ARGS variable to disable this check". Open the notepad program, click file, click open, click file type and change it to all files, navigate to the AI folder where webui-user.bat is located, and open it, in the line that says COMMANDLINE_ARGS= type it so it says this "COMMANDLINE_ARGS= --lowvram --precision full --no-half --skip-torch-cuda-test". Save the file then try to reopen webui-user.bat.

[@RajaRouf-q6i]

@@altArchitecture This command work "--skip-torch-cuda-test" Thank You i am not aspecting a reply thank You very much for your reply

[@altArchitecture]

@@RajaRouf-q6i Thats great! Im happy it worked out. Thanks for letting me know.

[@RajaRouf-q6i]

@@altArchitecture Now i am facing this issue. RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'

[@altArchitecture]

@@RajaRouf-q6i Try this command instead "--skip-torch-cuda-test --precision full --no-half"

[@merk1love]

Hello there, i tried all the steps one by one and when i lunch the webui-user.bat i get the following message: Couldn't launch python exit code: 9009 stderr: Python konnte nicht gefunden werden. Fⁿhren Sie die Verknⁿpfung ohne Argumente aus, um sie ⁿber den Microsoft Store zu installieren, oder deaktivieren Sie diese Verknⁿpfung unter Launch unsuccessful. Exiting. I installed as recomended python 3.10.6 any recomendations? thanks in advance!

[@altArchitecture]

When installing Python you were asked if you wanted to add it to your system PATH (The first question when installing Python on your computer) Try to uninstall and reinstall and see if that helps