Turn any Image into 3D using AI! (ZoeDepth + After Effects)

[@gregory7927]

wow. In the world of online tutorials there should be a prize for teachers who communicate so well. No fluff with a zillion extra nonsense chit chat to make the video longer for ad revenue nor too fast not to be able to follow your instructions. Just perfect. And such a cool lesson.

[@SunshineMediaEdge]

Thank you for providing such incredible tools and tutorials. I’ve been using the 2D environments you provide and have learned so much from your lessons. However, I’m facing some challenges that I hope you can address in a tutorial or guide: 1. Reverse Shot Challenges: - How can I create reverse shots when using a 2D environment that primarily shows the front view? - Are there any techniques to simulate the environment from the opposite perspective, such as showing where the actor is coming from? 2. Dynamic Angles: - When shooting my actor from multiple angles (front, side, over-the-shoulder), how do I match these angles with the 3D environment to maintain realism? 3. Interacting with Objects: - If my actor needs to interact with elements like a door in the 3D environment (e.g., opening it, going inside, and coming out), how can I animate or mask these interactions effectively? I believe a tutorial on these advanced techniques would greatly benefit creators like me who are exploring these environments for storytelling. Thank you for your excellent work and for making these tools accessible. I look forward to your response! Best regards, Sunshine MediaEdge

[@tomo6716]

3D model support is available in the After Effects 24.1 official release (no longer Beta)!

[@blaylock1978]

This was just a few days ago, right? I did the update but didn’t check k it out.

[@demiloca]

thank you! That explains - or hopefully explains - why BETA isn't showing my GLB. Update: didn't work but some boxes that identify it as 3D are now populated.

[@AndyCochrane]

Came here to add this - it's in the official release now. There are a LOT of limitations to it, but it works now

[@WHOSBROKEBOIPROD]

This is the wisest AI tutorial. Honestly the only one that finally makes sense in the cross with AI & creating visuals

[@00chaka]

You blew my mind right open😮 This is so incredible thank you for showing how to think outside the box. Very simple but effective technique.

[@novelafilmacademy]

Fantastic tutorial on turning images into 3D using ZoeDepth and After Effects! Your clear explanations and visual examples made the process easy to follow.

[@that1guy111987]

The ZoeDepth thing is cool, and there are some great techniques and ideas behind this. Ultimately what is lacking is the lighting of the subject on green screen and matching to the scene. This is a prime example why VFX should never be an after thought and always planned ahead of your shoot.

[@PopoRamos]

I Agree! Also the 3D parallax here introduces crazy artifacts! I would use as a cheap background element out of focus. Pretty much as Ian Hubert Does it.

[@EthanCrB]

Dude this is Mind-blowing 🤯 Thank you so much for showing this to us 🔥

[@IronReel]

This tutorial was fantastic. Excited to do this! Thanks for your hard work, man!

[@robfernandez5234]

Thanks for spotlighting this solution. In the Environments KZbin there were a lot of questions about this. My challenge now, as a Resolve user, is dropping the processed images into Fusion! Which is a whole other thing! Much appreciated!

[@AndrewPetersGospel]

you are the greatest sensei........i understand your tutorials so easily...you're a great teacher, thanks

[@Willi456]

Love your programs. I have 6 of your packs and use them all in my time travel sit coms. Looking forward to anything new that you add to your shopping cart.

[@andrewgil2850]

One thing that will bring this together better is comping smoke(and other effects into it to hide any seams and you can do multiple to create a whole set, also you can add lights to this and it’ll affect everything

[@simonkennedy6116]

Thanks for introducing me to Zoedepth, it's really going to speed up my 3d creation

[@bhargavkalita2207]

how can u import it into blender? when i do it my textures are missing

[@TRNRILY]

Just started playing with this, having a 3d program to take the file and then edit out things like the sky to then replace and comp in AE is kinda needed for any shots with excessive open sky, because the AI doesn't know what to make of that. Other than that tho and minor texture issues which are to be expected its making my life really easy. Was very intimidated to learn 3d modeling when I know all the other aspects of comping and just wanna make some videos using 3d environments, so this workaround combined with cutting out and adding additional assets + smoke and lights really sells it. A little bit of noise and a semi dramatic color correction goes far in the compositing. Hopefully the site is able to support PNGs soon and create mesh maps without the background issue.

[@mybfsasha4803]

This has really really helped my content creating thank you!!! im not really good at blender so this tech saved me lots of time creating backdrops. I had to show support so I grabbed the packs as well and yea the environments packs look great thank you!

[@ferraravfx]

That’s the best tutorial ever! Thank you for helping us that works with vfx! 🔥

[@iamandycozzens]

I probably would've bought the pack when it was discounted if this tutorial came out with it.

[@iljabuinitski9745]

Wow, that tutorial is so cool, thanks for sharing this!

[@Secretfilms1]

I need more tutorial please I purchase this pack I needed more tutorial please 🥺

[@sino1449]

Hi, i am a great fan , but please could you tell the process with davinci resolve? Thank you

[@apdirectedit]

BRO YOU THE REAL MVP!!!

[@Danny_Suede]

dude this is a BANGER!

[@machieldaniel]

THANKS FOR TEACHING HOW TO DO THINGS IN AFTER EFFECTS IT HELPED ME A LOT

[@beinpeacetoday]

The latest Ae has this technology, don't need the Beta anymore, but man... great tutorial! I love everything!

[@rgarlinyc]

Great stuff - can't believe you and your channel were unknown to me until about 15 minutes ago!

[@adsertheblade]

Aw, you beauty. I used to do this in Resolve, but forgot that I did... I thing I still have some presets I made to mae all this happen in a few mins with some drag and drop. I will use it again. Thanks, bro

[@skabarflix]

Some of the backgrounds on the site are fantastic, but others could really use a tune up. For example, a neon city isn't very good if the lights arent flickering or changing. At that point, you might as well just make your own backgrounds. Other than that, this and the backgrounds are great!

[@heveycreations4197]

Your tutorial is really good !

[@chadiwack]

Fantastic tut. I subbed. Thanks for getting straight to the point and killing it.

[@artemus80j.4]

Using this along side with Element 3D would be a great combo.

[@mufasa2079]

convert your glb into an obj file

[@peffken8834]

Thx 4 sharing Zoedeph, your experience how to handle it in AE. In your workflow to integrate greenscreen footage, I would make a copy of the scene, make a mask of the keyed one (or a duplicate with mask output setting in Keylight) and feathering the boundries (perhaps you need another copy to fence the feathering - there are a also some other, sometimes simplier ways to get to it...), use it as a mask for the backround, so that you you get an inner outline of the backround in the siloulette, precomposing it and adjust and blend it for your needs to get a nice spill of the environment. So here too, a pretty good result is achieved and explained, but what surprises me is that the shadows are mostly neglected, overlooked or ignored. Which, among other things, perfect the illusion of a composition.

[@j.i.7146]

This seems important for an even more seemless integration of the keyed out footage. Since I am not that comfortable in AE yet, can you please explain it simpler, so I can understand the steps you suggested?

[@robfernandez5234]

Hey Collin - we don’t use AE (or want to buy it!). Can we do the same thing in Resolve? Thanks much!

[@ΥπερδιαγαλαξιακόςΑστροπολεμιστ]

Bruh this is nuts!

[@PhucThinh1505]

thanks for this, helped me save tons of time and money!

[@Kyle-jm4cn]

The model is great! It seems like the material is compressed? It looks like the resolution is much lower.

[@AVISIONMUSICTV]

This is OK for story boarding or even comic book creation graphic novel. That's about it.

[@imvisuals215]

Ok. Now I have a use for these. Dope tut.

[@viperstudiosinc.]

It’s still a great skill set to have using UE. Zoedepth looks cool, it’s just another tool to add to your workflow!

[@mariorodriguez8627]

Great work!!! Got all the packs over black friday deals :)

[@WizardVal]

It looks like this Zoedepth is directly creating a depth map and displeis the regular plane accordingly. Following that logic you should be able to add light sources into your AE scene to illuminate or enhance this scene.

[@yojacq]

how can you send a tutorial

[@WizardVal]

@@yojacq It is easy mate- use the same technique as in this tutorial when creating camera. Create a plane, subdivide it to a good number to have enough geometry then add the displeis modifier. Add lights to the scene and place them where required. Search for : camera projection in after effects

[@mnumrqz]

great tut man! thanks a lot for sharing 🙌

[@dr3w_h]

Omg, this video is just GOLD! Thank you so much!

[@violentpixelation5486]

That's a PACKED video! #Gold 💯🔥

[@SpectrumReviews]

You effects packs and tutorials are amazing. I appreciate your work you put into this. I'm learning from this and already have a project in the works for my stream.

[@falfieri3167]

Their effects packs are scams.

[@SpectrumReviews]

@@falfieri3167 please explain

[@SKNayak2024]

Y​@@falfieri3167

[@mfundoh8148]

I'm so stoked. 😂❤

[@TheSatzy6699]

Great content and explanation ❤

[@yojacq]

this is sick

[@dannybee88]

So Awesome!!!!! Thank you ! One Question my mind went blank haha When I move the null cam position my character is not locked on the stairs like yours it moves.... I know I have fixed before but like I said my mind went blank haha Can you help !!?? Thank you!!!!

[@jason.martin]

Wow, this is brilliant!

[@Nohoes-]

This is amazing man ❤ thanks

[@gulraizbhutta]

so much to learn in one video cool...

[@TheLillid]

thanks for sharing- awesome.

[@cgxlv]

Pretty cool dude. FYI, This seems to work ok in the latest version of AE I am running which is 24.1 so I doubt people will need the Beta

[@benpedro80]

thank you , I have learned something today !!

[@slickslimyfilm]

Idk about GLB file in Davinci but I would keyframe the background to give it some movement

[@FilmRigz]

Very good on explaining everything, very simple and straightforward, 🔥🔥🔥🔥

[@starfieldcommand]

Thank you ! you are an amazing creator!

[@AllanGildea]

Insanity. Thanks for this amazing tutorial. Think of the old school matte painters, painting straight to glass in camera! If they could see this.

[@KeithDaviesMusic]

Colin is a clever guy!

[@LancerXShare]

i doesn't know 3D & AE, but that some superb job!

[@starlitguide]

Zoedepth seems to not be working anymore. Is there anything else we can use?

[@FEARFANATICS]

Great for an establishing shot. Where you going from there? These are one off shots that look cool but you haven’t shown them used in any context or scene.

[@_Soul_Hacker]

Nice work broh🔥👍🏻

[@hossienrahimianmajd]

amazing points i needed in my after effects skills thanks for that

[@Flugamefilm]

So you telling me i just spent 5 months learning unreal engine just to not even have to use it anymore to achieve this visual effect? 😂

[@AMVDon]

Post 2020 is crazy

[@Instant_Nerf]

Unreal ? Nah more like blender into unreal. You gotta 3D model these first. And with nerfs and Gaussian splats .. what’s the point anymore to 3D model.

[@Flugamefilm]

My point exactly, I get my 3d models from the marketplace. And now gaussian splatting is gonna take over. We're moving pretty fast @@Instant_Nerf

[@AtrusDesign]

Of course it’s very limited to this kind of shots… so no UE is again needed.

[@RetzyWilliams]

No game could use this technique. UE is a game engine first and foremost. These limited shots is all it can do.

[@matthallett4126]

Nice work!

[@chrisgallagher85]

This is bada$$!! Thanks for sharing.

[@smaug-tv]

Thank you, please keep going.

[@patrikmedia]

amazing tutorial

[@scrizofficial9281]

Incredible, thank you very much !

[@john2510]

Interesting and informative. However, I don't think it's going to work nearly this well with most backgrounds. The one you've chosen is ideal for this. Even so, the rotation in your video is probably the max that could be used effectively. With the other backgrounds I tried, even the slightest rotation reveals the flattened side of objects extending out to infinity.

[@darkvador6432]

Hey , thx for your video ;) However, as a HC compositing artist, there's no way I'll use AE, I think you may understand that (Nuke or Fusion inside), and thereby it would have been great to show what formats are proposed at the download step in addition to glb (alembic ? fbx ? obj ? USD ?) Well ok, I guess I just have to go there right ? :) Thank you again anyway 👍

[@jaydez_]

ahhhhmanzing, thank you so much!

[@JustSomeRandomStuff_fr]

hey bigfilms, i know you already have tornadoes in the apocalypse pack, but can you make a pack called tornado pack?

[@drumSick66]

That's really cool, thanks!

[@renata-sw1li]

wow! loved it! thanks!

[@doodlve]

Nice. It was pretty cool

[@aSoloVision]

FINALLY 😂

[@HeroHiFi]

Excellent tut! Nice, clear steps. Thanks

[@MusicFlowDaily]

Wow! A game changer! Thank you! ❤

[@Loony_BeLuna]

I'm a 3D artist and this is pretty much what I was looking for, but it's not quite finished yet. I work with DAZ3D, but I've never learned to model anything myself and with a tool like this I could finally model things for myself. AI can convert images into .Obj files, that would be amazing!

[@WizardVal]

It is not converting 2D into 3d objects. It is distorting the simple plane according to the depth map it has created. Lots of artifacts and the movement is REALLY limited. Doesn't work actually with the complex images having objects and people. For the environment as background it could work. It is something like Camera mapping in 3d max or Maya or any other modeling software. The depth map is really not as perfect as it is based on black and white 2d image. If you manage to convert this into space data in Fusion or nuke then you can improve your results. otherwise for a good result you need to build a more or less detailed 3d scene and then to map camera with your image. Hope it does make sense

[@Loony_BeLuna]

@@WizardVal Hi, yeah I had the same experience while watching the video. I hope to see that AI can make .obj files from images in the future. Especially environments. Like I would love to use a "filled" children's room or playing room, but adding many toys needs to have all those toys in your lib and that takes a LOT time to add and position. Or a room full of toys. Also filled classrooms with static objects as students would be great, at least with daz3d you struggle heavily to render with more than 4 people.

[@WizardVal]

@@Loony_BeLuna Exactly! It’s too early to expect ai to solve complex tasks. People don’t understand that this ai hype is created by ai developers to get more money. It’s obvious that when it come to something more complex than to put together some images it falls. I remember 10 years ago when I started to create VR imagery and everybody was excited and thinking that AR VR or MR is just around the corner and will change the industry. 10 years later people still use shitty images to promote and marketing products. If you can imagine the amount of money wasted.because of outdated business structures where thousands of incompetent people just show up that they are capable of something. Unfortunately our reality had turned into virtual absurdity.

[@Loony_BeLuna]

@@WizardVal I think you underestimate the power of AI. It has not to do with the devs. AI developed in 2023 MUCH faster and heavier than VR ever did. I did not saw a future in VR since beginning, it's still bad. That thing on my face would be too warm and uncomfortable. But AI is developing extremely, look how good Adobe Firefly got, look how great AI to voice with videos is and now this here. I managed to write a code with AI and I use AI really really much since 2023. I used ebay today and ebay has now AI to let it write the product description of the thing you want to sell. My new LG OLED TV has AI (Which I disabled) to improve image and sound. AI is Really a game changer. Elon musk is also working on it and also work on Androids, our World is changing, if we survive all the upcoming wars...

[@WizardVal]

@@Loony_BeLuna Do not underestimate the power of capitalism mate. They invented the infinite game, subscription game and many others. Yes, mate they will keep feeding us with “ amazing “ updates once a year, like Intel or Adobe, the recent scandal shows that “ benefits for mankind” is an illusion to keep us intrigued. In reality I didn’t find extraordinary capabilities or mind blowing art created by ai. To spend years in order to learn how to create a prompt and days to trial and errors before ai will create something interesting? No thanks man. I better learn the painting skill and create art no ai can create ever. AI is a tool. Not a creator. It is not capable of doing what humans can do. It will never be. Despite all the scaremongering it cannot take decisions, just a simple tool. A calculator. That will be capitalised accordingly. No miracles.

[@roadstudiosproductions]

Gotta use this for new feature film

[@xbrutalgamer8193]

this is so cool

[@janussquared9793]

Could a workaround to the limits both left and right of the 3D created background be to take a frame shot within either After Effects or Premiere import it to Photoshop and do a "creative fill" both left and right then use that prior to making it 3D and THEN use that to import in After Effects?

[@baptistoriginals]

Yeah depending the fill you might could even do further separation in whatever it generates for more depth

[@jeanfree3079]

Tutorial excelente!!!!!

[@RedDimensions]

Was no longer working in the beta and the newest AE. I had to roll back to 24.1 to get it to work.

[@SANJEEVKUMARGUPTA]

I have a problem , please help me out. i will be grateful. if i make logo using 3d models like box, cone etc present in create section of element , then that model is able to be saved and imported into 3D element scene . but when i autotrace any image in after effects and then apply video copilot's E3d effect load image on texture map and auto traced mask in mask map and open E3d scene set up and extrude that model in preview and and load texture on that and save it in folder whose destination is Documents/VideoCopilot/Models , then i am not able to import it . the E3d scene shows it, but E3d preview does not show the model but it is showing the gizmo of that folder which contains model . please help me out.if i make logo using 3d models like box, cone etc present in create section of element , then that model is able to be saved and imported into 3D element scene . but when i autotrace any image in after effects and then apply video copilot's E3d effect load image on texture map and auto traced mask in mask map and open E3d scene set up and extrude that model in preview and and load texture on that and save it in folder whose destination is Documents/VideoCopilot/Models , then i am not able to import it . the E3d scene shows it, but E3d preview does not show the model but it is showing the gizmo of that folder which contains model . please help me out.

[@chosenonemedia8337]

Very Cool!

[@alvaire]

Vraiment c'est super

[@bluerabbit1236]

Cool I could use this technique to create extra establishing shots for my movie so I don't have to go all the way back to the location to shoot footage 😂 This'll just do the trick and I don't even need the green screen part.

[@EY3VISIONFILMSVFX]

Yeesssssssss sirrrrrrr thanks brother going to use this asap toooooonightttt!!!!!!!!!

[@polypeptide]

Thank you so much! Is it normal for the image quality to degrade quite a bit once you convert it? Yours doesn't see like it does.

[@sensei009]

This tutorial is amazing! Thank you. 🫶🏽

[@agnesslovehealz]

Nice first time heard of this one nice good stuff

[@princeedwards1185]

Hey guys I just bought this pack with the understanding it works with Davinci resolve is this for after fix only

[@treagenkierstudios4335]

Does this technique work in Final Cut?

[@mathieudubost9730]

Awesome !

[@GreetingUser]

Nice! Is it safe to use it commercially? Does it store the images fed into it?

[@skatedyerskate6685]

COOOOOOOL! thankyousomuch