Use AI to create amazing 3D Animations! [Blender + Stable Diffusion]

I’ll show you how to speedrun from a rough 3D Layout scene in blender to a final textured rendering in no time with the help of AI!
If you like my work, please consider supporting me on Patreon: / mickmumpitz
And follow me on Twitter: / mickmumpitz
The combination of Blender, a classic 3D animation tool, with AI tools like Stable Diffusion is one of my absolute favorite AI workflows because you can use it to create consistent environments for short films, games, or just start learning Blender. And it's just so much fun and super easy!
TOOLS USED IN THIS VIDEO [ALL FREE, YAY!]
blender - www.blender.org/download/
Stable Diffusion WebUI - github.com/AUTOMATIC1111/stab...
CHAPTERS
00:00 Intro
00:25 Layout
03:21 Exporting the Depth Map
05:07 Generating the image
07:22 Putting everything together
09:11 Animate the Camera + Effects
10:56 Final Results
Mickmumpitz is a channel that is all about understanding new technologies from the worlds of AI, digital art, film and games in a playful and project-oriented way.

[@mickmumpitz]

If you liked this video, check out my latest video on this topic! I show you how you can render any 3D scene with AI, whether video or image. Amazing for creating assets, concept art, animatics or trippy Ai animations! kzbin.info/www/bejne/o6aWe3icrZiDfq8

[@CockmageLVL99]

AI Workflows. It's fun. It's easy. It's never exactly producing what I want.

[@dawoodmadaki9503]

Can u please explain what you mean?

[@poipoi300]

skill issue

[@chadibaytamouni3503]

Pretty well put into words!

[@FuZZbaLLbee]

But that is also the case if I do it myself 😂 But yeah if you’re a good 3D artist it is better to do it yourself.

[@Devduttsharma.]

Hahha 😂 bruh this is bitter truth but , after lots of struggle and lots of knowing a specific tool . You can create what u want if u r master in written prompt

[@nelyrions1838]

This could actually be THE animatic method i will be using moving forward. Cause you get the actual scene with basic props, but able to visualize the final product in a way you couldn't before. I mean, as a final renders, it's hot garbage, but i see huge potential in this technique. Really awesome, thank you.

[@mickmumpitz]

Check out my new video! I made an updated version of the workflow and it works really well for animatics now!

[@anthony_leckie]

Your combination of 3D and AI is very clever and forward thinking. I’ve been wanting to do something like this but haven’t figured it out. Thank you!

[@aegisgfx]

Oh course the real issue with this approach is that the shadows are all baked into the material, so lighting become problematic. But for a fast scene with little camera movement and lighting, this will work. Its a great approach for scene prototyping.

[@nangld]

I don't get why people think AI will steal jobs, it is just another brush in the artist's toolkit.

[@aegisgfx]

@@nangld because it's very very fast, one artist now can do the same amount of work that it used to take 10 or 20

[@anthony_leckie]

I'm far more excited about it than I am afraid.@@nangld

[@culsud]

its not a brush it makes a whole advanced art in matter of seconds@@nangld

[@igor_timofeev]

It's pleasure to see how you master AI+3D in conjunction

[@geldstern]

really nice ! I am a programmer and not an artist, so these are valuable methods to leverage my games ...

[@mottentotten]

Amazing work dude!

[@RobinBeechey]

So clever! awesome video thanks!

[@user-oj5so6qe7q]

Man,this is the coolest tutorial I've seen.thanks and blessings.

[@shoutout3d550]

Brilliant Mick! Presented with great positive vibes!💯

[@Blaxpoon]

Very nice workflow !

[@dimamitlenko1830]

Awesome tutorial ! Thanks

[@digital_magic]

awesome video Mick, i loved watching it 🙂

[@AnsonSavage]

Very neat workflow!

[@Nrek_AI]

your tutorials always provide the most innovative workflows ... thanks dude!!!!

[@juanfernandojimenezbuitrag2434]

amazing Workflow, as you said, amazing to sketch things

[@pixel325]

Really nice and insperational video, thanks for sharing all this! :)

[@swannschilling474]

Very nice! Thanks for sharing!

[@StevenDiLeo]

Sick technique. Exactly what I was looking for!❤

[@DhaoistAzazel]

this is so cool! I'm gonna try this out tomorrow

[@brandonjacksoon]

Thanks man, that's awesome! Always interesting and informative video! The best!

[@RGBJD]

Great video. Thanks. Pls bring more of this

[@PSA04]

Nice work! Love this.

[@samwalker4442]

PEREFCT!! Great tutorial and have filled in so many blanks for me....Thank you

[@dailyStewie504]

You are good, cant wait to learn more. I subbed

[@pn4960]

This is THE tutorial I needed

[@TeluguNarrativeHub]

thanks bro. waiting for more detailed tutorial

[@da_Atheist]

Just awesome

[@marcus.guitarist]

Bro this is so cool

[@giorgossynetos9723]

One of the best informative videos I have seen recently!

[@CogniClipsCentral]

Great man! Good explanation!

[@FrudTV]

Thanks man!

[@benjamindeblanzy]

Great trick!

[@DailyComedi]

its really Amazing and helpful

[@maciejgarlicki742]

this is a game changer for 3d world design, thanks for the nice tutorial

[@creeper_films]

Great work

[@GachokiStudios]

This is amazing.

[@daan3898]

interesting workflow.

[@surfkid1111]

This is amazing and left me with my mouth open! ;)

[@deekay5487]

superthanks for sharing your knowledge! looking forward to see this method as a Blender-Addon ...

[@swamihuman9395]

- Great job! Well presented. Very clever, too. And, I love the results

[@lennoyl]

Very nice idea to use camera projection and animate in Blender !

[@user-ux9zx1xw3j]

great video!

[@I.play.Anno.2070]

Amazing! Good job 🇧🇷👍

[@johntnguyen1976]

Fantastic 🔥

[@user-vn3kg1px9r]

thank you Mick

[@DARKHUDS]

Amazing video man!

[@mickmumpitz]

Thank you! :)

[@darrennew8211]

Crazy cool!

[@CONCEPTSJRS]

Honestly, I think you're brilliant. I love creating stories and I have been looking for a way to start creating my own from scratch. This just opened so many opportunities

[@tright6]

Ian Hubert is literally one dude working in blender and he makes entire movies without ai. It’s not that the door was closed, you’re just lazy

[@piotrek7633]

you know, millions of people thought the same, you think you'll stand a chance in this market?

[@CONCEPTSJRS]

@@tright6 you nothing about me clown

[@AscendantStoic]

Fantastic workflow, I have to try that, time to brush my Blender skills yet again (haven't touched it in years) 😅

[@Silberschweifer]

i love it!

[@nathfx7081]

Thanks a lot Sir😍

[@kodda4un]

Mate this is litteraly mind blowing! Thank you so much for such detailed tutorial!!!

[@HelvioAvelar]

Very nice.

[@Everything3dAnimation]

Amazing!

[@qwe8476]

future is here! Nice job!

[@dinisdesigncorner332]

crazy stuff

[@MAzurekkk1]

Amazing concept, I'm a layman, I wouldn't have come up with this and I can definitely say that it will come in handy

[@kareldaulatram]

Very very good 👍👏

[@Gabriel.lassov]

Nice Perfect Broh youre Helping so much this community , gracias 🙏🖤💯

[@AIAnimationStudio]

Really really cool. I've been playing around with controlnets for characters and ComfyUI. Loving this approach for environments. 👏👏👏

[@maiabuljeta5749]

Awesome!

[@chetanchetanrana]

you make it look easy

[@ZuoYu]

真的很棒！！！你的教程让我的生活更有趣！ ！我爱你！！！

[@georgematsos4416]

This is opening so many doors ! Amazing !

[@pushREC]

Love it - had my head spinning when this was first announced a few months ago but damn dude your video really shows the insane potential of Video > Video AI workflows 👀 Keep it up man, just shared this with my private community 💪

[@rainh_music]

You genius ! I wish I could make my next music video that way.

[@Yash_Sahare]

Its is amazing

[@vapinavideo]

Thanks for sharing! Been thinking about similar ideas... generative AI & Blender, specially after TripoSR was published just recently. Now there start to be so much tools with AI image making that it is more question of discovering the workflows. I'm myself visual artist working with gen AI.

[@someoneontheweb4303]

Sick!

[@AraKimmy]

Nice makes me want to go back to blender lol

[@zhawmedia]

omg this is so good, take my Like sir

[@mustafamohamud5212]

You are onto something here, fantastic work my guy 💯

[@timmygilbert4102]

Just do it for each visual plane instead, then combined at the end to avoid doubling effect and have more camera freedom. Heck projecting, then masking part at another angle, port back to ai, infill the masked part, project the masked area, merge all angles using the mask of each.

[@masy_mezzetino]

By generating the whole scene, you get more stylistic consistency. But you could seperate the foreground and background elements before projecting first. Although trying projection without seperating could end up saving a bunch of time if it works for what you want to do (i.e. very small camera movement)

[@Perry-wy2fc]

very cool and very smart. The only problem is the limitation of the camera movements ...

[@Visual-Synthesizer]

Rad! Makes me want to learn blender. Ive just been buying or paying other to make the 3d…

[@aseem1708]

thanks

[@forestlong1]

WoooooooooooooooooooooooooooooooooooooooooooooooooooooW! So usefull!

[@khadyndiaye1515]

3:06 that geometrie in the back looks like something else 🧐

[@iborov]

An example of "blending" and "diffusing" the 3D and the AI Worlds together!

[@umeshtamang5236]

besssssssssssst, saved my time for , youtube thumbnail

[@kitbashedcreative]

I LOVE YOU.

[@daveinpublic]

I feel like we’re about a year away from someone putting this entire workflow into one plugin, complete with random primitive placement, camera placement w animations, scene changes, and character generation. Then you just use your phone camera to film yourself acting and watch the entire movie come to life! With random prompt presets to help try new layouts and styles.

[@jenkem4464]

This is exactly how games are going to be down the road. Blocked in proxy models driving AI filters. Realtime will be a bit longer but way sooner than we think and VFX stuff...like shown here...is already a gamechanger.

[@nerdyPixel-oo6dn]

Brilliant video, thanks for sharing your knowledge! :D I have a question tho : when doing a camera-projection like that, the foreground elements' textures are bleeching on the background elements. The more you move the camera, the more you'll see those texture "errors" Do you have any trick to fix that? Beside some manual texture rework I can't come with a clever and nice way

[@Shalfatk01]

nice.

[@ronioclarenzo6137]

Awesome work! The revolution has begun!

[@FuZZbaLLbee]

Do you also make walking animations in blender and use controlnet to make an ai character walk in the scene?

[@DanielPartzsch]

Really cool. Just out of interest, did you maybe try it the other way around? Meaning export a depth map animation (eg with the camera movement) out of blender and then batch process them in SD? Would be curious to see how consistent this is? Maybe in combination with Animate diff in comfyui.. Thank you

[@hackerlife6310]

Wow!

[@redvoiddd]

Dude, there is no model in the model section, where can I download it?

[@creeper_films]

this is awesome.... but can i use midjourneyAi for generating image? becuase i have some issues with stable diffusion image genertating.

[@zerorusher]

This is a 10/10 genius take on integrating blender and AI, and is also very light on the GPU!

[@climatechangeanswer]

Dream Textures automates so much of this.

[@DarkNoggin]

Excellent video! I'm a career filmmaker trying to future proof my job with AI and 3D and this was a great addition to my knowledge. More of this content please!

[@toshchakfox]

ffs, thank you. i was like 'how he's going to use a depth map if he isn't even on img2img tab?' control nets, that's it!

[@mohali4338]

@Mickmumpitz Where to download the final file?

[@bettlebug5988]

Hello Mickmumpitz, 1st thank you for this tutorial. I went to Automatic 1111 but there were a bunch of names with folders. I don't want to download a virus. What should I do and how will I do it?

[@sedehpictures]

wow

[@theadventureseries6739]

You are so good! I’m gonna have to look at your videos. I’ve been trying to find a way to use AI to create 3D images of my drawings to create characters. Can it be done?

[@belgianfootball4529]

whenever i click on the UV mapping the image i have seems to be scaled way bigger than the models i have, idk how to solve that