Use AI to create amazing 3D Animations! [Blender + Stable Diffusion]

I’ll show you how to speedrun from a rough 3D Layout scene in blender to a final textured rendering in no time with the help of AI!
If you like my work, please consider supporting me on Patreon: / mickmumpitz
And follow me on Twitter: / mickmumpitz
The combination of Blender, a classic 3D animation tool, with AI tools like Stable Diffusion is one of my absolute favorite AI workflows because you can use it to create consistent environments for short films, games, or just start learning Blender. And it's just so much fun and super easy!
TOOLS USED IN THIS VIDEO [ALL FREE, YAY!]
blender - www.blender.org/download/
Stable Diffusion WebUI - github.com/AUTOMATIC1111/stab...
CHAPTERS
00:00 Intro
00:25 Layout
03:21 Exporting the Depth Map
05:07 Generating the image
07:22 Putting everything together
09:11 Animate the Camera + Effects
10:56 Final Results
Mickmumpitz is a channel that is all about understanding new technologies from the worlds of AI, digital art, film and games in a playful and project-oriented way.

[@mickmumpitz]

If you liked this video, check out my latest video on this topic! I show you how you can render any 3D scene with AI, whether video or image. Amazing for creating assets, concept art, animatics or trippy Ai animations! kzbin.info/www/bejne/o6aWe3icrZiDfq8

[@CockmageLVL99]

AI Workflows. It's fun. It's easy. It's never exactly producing what I want.

[@dawoodmadaki9503]

Can u please explain what you mean?

[@poipoi300]

skill issue

[@chadibaytamouni3503]

Pretty well put into words!

[@FuZZbaLLbee]

But that is also the case if I do it myself 😂 But yeah if you’re a good 3D artist it is better to do it yourself.

[@Devduttsharma.]

Hahha 😂 bruh this is bitter truth but , after lots of struggle and lots of knowing a specific tool . You can create what u want if u r master in written prompt

[@nelyrions1838]

This could actually be THE animatic method i will be using moving forward. Cause you get the actual scene with basic props, but able to visualize the final product in a way you couldn't before. I mean, as a final renders, it's hot garbage, but i see huge potential in this technique. Really awesome, thank you.

[@mickmumpitz]

Check out my new video! I made an updated version of the workflow and it works really well for animatics now!

[@igor_timofeev]

It's pleasure to see how you master AI+3D in conjunction

[@shoutout3d550]

Brilliant Mick! Presented with great positive vibes!💯

[@digital_magic]

awesome video Mick, i loved watching it 🙂

[@geldstern]

really nice ! I am a programmer and not an artist, so these are valuable methods to leverage my games ...

[@Nrek_AI]

your tutorials always provide the most innovative workflows ... thanks dude!!!!

[@user-oj5so6qe7q]

Man,this is the coolest tutorial I've seen.thanks and blessings.

[@pixel325]

Really nice and insperational video, thanks for sharing all this! :)

[@mottentotten]

Amazing work dude!

[@RobinBeechey]

So clever! awesome video thanks!

[@AnsonSavage]

Very neat workflow!

[@dimamitlenko1830]

Awesome tutorial ! Thanks

[@StevenDiLeo]

Sick technique. Exactly what I was looking for!❤

[@brandonjacksoon]

Thanks man, that's awesome! Always interesting and informative video! The best!

[@juanfernandojimenezbuitrag2434]

amazing Workflow, as you said, amazing to sketch things

[@Blaxpoon]

Very nice workflow !

[@PSA04]

Nice work! Love this.

[@anthony_leckie]

Your combination of 3D and AI is very clever and forward thinking. I’ve been wanting to do something like this but haven’t figured it out. Thank you!

[@aegisgfx]

Oh course the real issue with this approach is that the shadows are all baked into the material, so lighting become problematic. But for a fast scene with little camera movement and lighting, this will work. Its a great approach for scene prototyping.

[@nangld]

I don't get why people think AI will steal jobs, it is just another brush in the artist's toolkit.

[@aegisgfx]

@@nangld because it's very very fast, one artist now can do the same amount of work that it used to take 10 or 20

[@anthony_leckie]

I'm far more excited about it than I am afraid.@@nangld

[@culsud]

its not a brush it makes a whole advanced art in matter of seconds@@nangld

[@swannschilling474]

Very nice! Thanks for sharing!

[@TeluguNarrativeHub]

thanks bro. waiting for more detailed tutorial

[@RGBJD]

Great video. Thanks. Pls bring more of this

[@samwalker4442]

PEREFCT!! Great tutorial and have filled in so many blanks for me....Thank you

[@swamihuman9395]

- Great job! Well presented. Very clever, too. And, I love the results

[@dailyStewie504]

You are good, cant wait to learn more. I subbed

[@DhaoistAzazel]

this is so cool! I'm gonna try this out tomorrow

[@surfkid1111]

This is amazing and left me with my mouth open! ;)

[@giorgossynetos9723]

One of the best informative videos I have seen recently!

[@pn4960]

This is THE tutorial I needed

[@maciejgarlicki742]

this is a game changer for 3d world design, thanks for the nice tutorial

[@marcus.guitarist]

Bro this is so cool

[@DailyComedi]

its really Amazing and helpful

[@CogniClipsCentral]

Great man! Good explanation!

[@lennoyl]

Very nice idea to use camera projection and animate in Blender !

[@AscendantStoic]

Fantastic workflow, I have to try that, time to brush my Blender skills yet again (haven't touched it in years) 😅

[@deekay5487]

superthanks for sharing your knowledge! looking forward to see this method as a Blender-Addon ...

[@benjamindeblanzy]

Great trick!

[@da_Atheist]

Just awesome

[@daan3898]

interesting workflow.

[@FrudTV]

Thanks man!

[@creeper_films]

Great work

[@CONCEPTSJRS]

Honestly, I think you're brilliant. I love creating stories and I have been looking for a way to start creating my own from scratch. This just opened so many opportunities

[@tright6]

Ian Hubert is literally one dude working in blender and he makes entire movies without ai. It’s not that the door was closed, you’re just lazy

[@piotrek7633]

you know, millions of people thought the same, you think you'll stand a chance in this market?

[@CONCEPTSJRS]

@@tright6 you nothing about me clown

[@GachokiStudios]

This is amazing.

[@MAzurekkk1]

Amazing concept, I'm a layman, I wouldn't have come up with this and I can definitely say that it will come in handy

[@DARKHUDS]

Amazing video man!

[@mickmumpitz]

Thank you! :)

[@user-ux9zx1xw3j]

great video!

[@darrennew8211]

Crazy cool!

[@I.play.Anno.2070]

Amazing! Good job 🇧🇷👍

[@johntnguyen1976]

Fantastic 🔥

[@kodda4un]

Mate this is litteraly mind blowing! Thank you so much for such detailed tutorial!!!

[@Gabriel.lassov]

Nice Perfect Broh youre Helping so much this community , gracias 🙏🖤💯

[@rainh_music]

You genius ! I wish I could make my next music video that way.

[@AIAnimationStudio]

Really really cool. I've been playing around with controlnets for characters and ComfyUI. Loving this approach for environments. 👏👏👏

[@pushREC]

Love it - had my head spinning when this was first announced a few months ago but damn dude your video really shows the insane potential of Video > Video AI workflows 👀 Keep it up man, just shared this with my private community 💪

[@Everything3dAnimation]

Amazing!

[@user-vn3kg1px9r]

thank you Mick

[@HelvioAvelar]

Very nice.

[@nathfx7081]

Thanks a lot Sir😍

[@Silberschweifer]

i love it!

[@maiabuljeta5749]

Awesome!

[@kareldaulatram]

Very very good 👍👏

[@qwe8476]

future is here! Nice job!

[@dinisdesigncorner332]

crazy stuff

[@georgematsos4416]

This is opening so many doors ! Amazing !

[@chetanchetanrana]

you make it look easy

[@ZuoYu]

真的很棒！！！你的教程让我的生活更有趣！ ！我爱你！！！

[@Perry-wy2fc]

very cool and very smart. The only problem is the limitation of the camera movements ...

[@Visual-Synthesizer]

Rad! Makes me want to learn blender. Ive just been buying or paying other to make the 3d…

[@vapinavideo]

Thanks for sharing! Been thinking about similar ideas... generative AI & Blender, specially after TripoSR was published just recently. Now there start to be so much tools with AI image making that it is more question of discovering the workflows. I'm myself visual artist working with gen AI.

[@AraKimmy]

Nice makes me want to go back to blender lol

[@someoneontheweb4303]

Sick!

[@mustafamohamud5212]

You are onto something here, fantastic work my guy 💯

[@zhawmedia]

omg this is so good, take my Like sir

[@Yash_Sahare]

Its is amazing

[@timmygilbert4102]

Just do it for each visual plane instead, then combined at the end to avoid doubling effect and have more camera freedom. Heck projecting, then masking part at another angle, port back to ai, infill the masked part, project the masked area, merge all angles using the mask of each.

[@masy_mezzetino]

By generating the whole scene, you get more stylistic consistency. But you could seperate the foreground and background elements before projecting first. Although trying projection without seperating could end up saving a bunch of time if it works for what you want to do (i.e. very small camera movement)

[@forestlong1]

WoooooooooooooooooooooooooooooooooooooooooooooooooooooW! So usefull!

[@daveinpublic]

I feel like we’re about a year away from someone putting this entire workflow into one plugin, complete with random primitive placement, camera placement w animations, scene changes, and character generation. Then you just use your phone camera to film yourself acting and watch the entire movie come to life! With random prompt presets to help try new layouts and styles.

[@khadyndiaye1515]

3:06 that geometrie in the back looks like something else 🧐

[@aseem1708]

thanks

[@iborov]

An example of "blending" and "diffusing" the 3D and the AI Worlds together!

[@jenkem4464]

This is exactly how games are going to be down the road. Blocked in proxy models driving AI filters. Realtime will be a bit longer but way sooner than we think and VFX stuff...like shown here...is already a gamechanger.

[@umeshtamang5236]

besssssssssssst, saved my time for , youtube thumbnail

[@DanielPartzsch]

Really cool. Just out of interest, did you maybe try it the other way around? Meaning export a depth map animation (eg with the camera movement) out of blender and then batch process them in SD? Would be curious to see how consistent this is? Maybe in combination with Animate diff in comfyui.. Thank you

[@hackerlife6310]

Wow!

[@kitbashedcreative]

I LOVE YOU.

[@nerdyPixel-oo6dn]

Brilliant video, thanks for sharing your knowledge! :D I have a question tho : when doing a camera-projection like that, the foreground elements' textures are bleeching on the background elements. The more you move the camera, the more you'll see those texture "errors" Do you have any trick to fix that? Beside some manual texture rework I can't come with a clever and nice way

[@toshchakfox]

ffs, thank you. i was like 'how he's going to use a depth map if he isn't even on img2img tab?' control nets, that's it!

[@creeper_films]

this is awesome.... but can i use midjourneyAi for generating image? becuase i have some issues with stable diffusion image genertating.

[@climatechangeanswer]

Dream Textures automates so much of this.

[@redvoiddd]

Dude, there is no model in the model section, where can I download it?

[@Shalfatk01]

nice.

[@theadventureseries6739]

You are so good! I’m gonna have to look at your videos. I’ve been trying to find a way to use AI to create 3D images of my drawings to create characters. Can it be done?

[@FuZZbaLLbee]

Do you also make walking animations in blender and use controlnet to make an ai character walk in the scene?

[@mohali4338]

@Mickmumpitz Where to download the final file?

[@zerorusher]

This is a 10/10 genius take on integrating blender and AI, and is also very light on the GPU!

[@ronioclarenzo6137]

Awesome work! The revolution has begun!

[@cut-no-one4082]

supercool

[@williamminnaar6311]

Hello there - How do you install Stable Diffusion and make it work please? If you have a tutorial on this? :)

[@JunieJu]

omg this is so amazing !!!!also you are so handsome btw

[@codymoore1765]

how would you start out learning blender? I am pretty good with fusion and Davinci resolve