Turn any Image into 3D using AI! (ZoeDepth + After Effects)

[@tomo6716]

3D model support is available in the After Effects 24.1 official release (no longer Beta)!

[@blaylock1978]

This was just a few days ago, right? I did the update but didn’t check k it out.

[@demiloca]

thank you! That explains - or hopefully explains - why BETA isn't showing my GLB. Update: didn't work but some boxes that identify it as 3D are now populated.

[@AndyCochrane]

Came here to add this - it's in the official release now. There are a LOT of limitations to it, but it works now

[@elshad]

Amazing tutorial, thx bro ❤🎉

[@BLUEACTION1]

I need more tutorial please I purchase this pack I needed more tutorial please 🥺

[@SunshineMediaEdge]

Thank you for providing such incredible tools and tutorials. I’ve been using the 2D environments you provide and have learned so much from your lessons. However, I’m facing some challenges that I hope you can address in a tutorial or guide: 1. Reverse Shot Challenges: - How can I create reverse shots when using a 2D environment that primarily shows the front view? - Are there any techniques to simulate the environment from the opposite perspective, such as showing where the actor is coming from? 2. Dynamic Angles: - When shooting my actor from multiple angles (front, side, over-the-shoulder), how do I match these angles with the 3D environment to maintain realism? 3. Interacting with Objects: - If my actor needs to interact with elements like a door in the 3D environment (e.g., opening it, going inside, and coming out), how can I animate or mask these interactions effectively? I believe a tutorial on these advanced techniques would greatly benefit creators like me who are exploring these environments for storytelling. Thank you for your excellent work and for making these tools accessible. I look forward to your response! Best regards, Sunshine MediaEdge

[@alloneword154]

Any luck?

[@gregory7927]

wow. In the world of online tutorials there should be a prize for teachers who communicate so well. No fluff with a zillion extra nonsense chit chat to make the video longer for ad revenue nor too fast not to be able to follow your instructions. Just perfect. And such a cool lesson.

[@Iamreyking]

is there a tutorial for this process in FInal Cut Pro ?

[@nujurustudios]

Thank you for this tutorial, but right now I am stuck at the y rotation step. I did what you said but I am still seeing a black screen with the 3D arrows. Did I do something wrong?

[@novelafilmacademy]

Fantastic tutorial on turning images into 3D using ZoeDepth and After Effects! Your clear explanations and visual examples made the process easy to follow.

[@WHOSBROKEBOIPROD]

This is the wisest AI tutorial. Honestly the only one that finally makes sense in the cross with AI & creating visuals

[@IronReel]

This tutorial was fantastic. Excited to do this! Thanks for your hard work, man!

[@RedDimensions]

Was no longer working in the beta and the newest AE. I had to roll back to 24.1 to get it to work.

[@EthanCrB]

Dude this is Mind-blowing 🤯 Thank you so much for showing this to us 🔥

[@dkbthehammer8921]

Peace and thank you for this is there a way to do this in davinci resolve I have your environments pack ?

[@simonkennedy6116]

Thanks for introducing me to Zoedepth, it's really going to speed up my 3d creation

[@bhargavkalita2207]

how can u import it into blender? when i do it my textures are missing

[@00chaka]

You blew my mind right open😮 This is so incredible thank you for showing how to think outside the box. Very simple but effective technique.

[@SANJEEVKUMARGUPTA]

I have a problem , please help me out. i will be grateful. if i make logo using 3d models like box, cone etc present in create section of element , then that model is able to be saved and imported into 3D element scene . but when i autotrace any image in after effects and then apply video copilot's E3d effect load image on texture map and auto traced mask in mask map and open E3d scene set up and extrude that model in preview and and load texture on that and save it in folder whose destination is Documents/VideoCopilot/Models , then i am not able to import it . the E3d scene shows it, but E3d preview does not show the model but it is showing the gizmo of that folder which contains model . please help me out.if i make logo using 3d models like box, cone etc present in create section of element , then that model is able to be saved and imported into 3D element scene . but when i autotrace any image in after effects and then apply video copilot's E3d effect load image on texture map and auto traced mask in mask map and open E3d scene set up and extrude that model in preview and and load texture on that and save it in folder whose destination is Documents/VideoCopilot/Models , then i am not able to import it . the E3d scene shows it, but E3d preview does not show the model but it is showing the gizmo of that folder which contains model . please help me out.

[@sino1449]

Hi, i am a great fan , but please could you tell the process with davinci resolve? Thank you

[@robfernandez5234]

Hey Collin - we don’t use AE (or want to buy it!). Can we do the same thing in Resolve? Thanks much!

[@TRNRILY]

Just started playing with this, having a 3d program to take the file and then edit out things like the sky to then replace and comp in AE is kinda needed for any shots with excessive open sky, because the AI doesn't know what to make of that. Other than that tho and minor texture issues which are to be expected its making my life really easy. Was very intimidated to learn 3d modeling when I know all the other aspects of comping and just wanna make some videos using 3d environments, so this workaround combined with cutting out and adding additional assets + smoke and lights really sells it. A little bit of noise and a semi dramatic color correction goes far in the compositing. Hopefully the site is able to support PNGs soon and create mesh maps without the background issue.

[@robfernandez5234]

Thanks for spotlighting this solution. In the Environments KZbin there were a lot of questions about this. My challenge now, as a Resolve user, is dropping the processed images into Fusion! Which is a whole other thing! Much appreciated!

[@Kyle-jm4cn]

The model is great! It seems like the material is compressed? It looks like the resolution is much lower.

[@FEARFANATICS]

Great for an establishing shot. Where you going from there? These are one off shots that look cool but you haven’t shown them used in any context or scene.

[@Willi456]

Love your programs. I have 6 of your packs and use them all in my time travel sit coms. Looking forward to anything new that you add to your shopping cart.

[@Flugamefilm]

So you telling me i just spent 5 months learning unreal engine just to not even have to use it anymore to achieve this visual effect? 😂

[@AMVDon]

Post 2020 is crazy

[@Instant_Nerf]

Unreal ? Nah more like blender into unreal. You gotta 3D model these first. And with nerfs and Gaussian splats .. what’s the point anymore to 3D model.

[@Flugamefilm]

My point exactly, I get my 3d models from the marketplace. And now gaussian splatting is gonna take over. We're moving pretty fast @@Instant_Nerf

[@AtrusDesign]

Of course it’s very limited to this kind of shots… so no UE is again needed.

[@RetzyWilliams]

No game could use this technique. UE is a game engine first and foremost. These limited shots is all it can do.

[@that1guy111987]

The ZoeDepth thing is cool, and there are some great techniques and ideas behind this. Ultimately what is lacking is the lighting of the subject on green screen and matching to the scene. This is a prime example why VFX should never be an after thought and always planned ahead of your shoot.

[@PopoRamos]

I Agree! Also the 3D parallax here introduces crazy artifacts! I would use as a cheap background element out of focus. Pretty much as Ian Hubert Does it.

[@iamandycozzens]

I probably would've bought the pack when it was discounted if this tutorial came out with it.

[@iljabuinitski9745]

Wow, that tutorial is so cool, thanks for sharing this!

[@mybfsasha4803]

This has really really helped my content creating thank you!!! im not really good at blender so this tech saved me lots of time creating backdrops. I had to show support so I grabbed the packs as well and yea the environments packs look great thank you!

[@andrewgil2850]

One thing that will bring this together better is comping smoke(and other effects into it to hide any seams and you can do multiple to create a whole set, also you can add lights to this and it’ll affect everything

[@AndrewPetersGospel]

you are the greatest sensei........i understand your tutorials so easily...you're a great teacher, thanks

[@starlitguide]

Zoedepth seems to not be working anymore. Is there anything else we can use?

[@Danny_Suede]

dude this is a BANGER!

[@ferraravfx]

That’s the best tutorial ever! Thank you for helping us that works with vfx! 🔥

[@scrizofficial9281]

Incredible, thank you very much !

[@treagenkierstudios4335]

Does this technique work in Final Cut?

[@adsertheblade]

Aw, you beauty. I used to do this in Resolve, but forgot that I did... I thing I still have some presets I made to mae all this happen in a few mins with some drag and drop. I will use it again. Thanks, bro

[@apdirectedit]

BRO YOU THE REAL MVP!!!

[@beinpeacetoday]

The latest Ae has this technology, don't need the Beta anymore, but man... great tutorial! I love everything!

[@WizardVal]

It looks like this Zoedepth is directly creating a depth map and displeis the regular plane accordingly. Following that logic you should be able to add light sources into your AE scene to illuminate or enhance this scene.

[@yojacq]

how can you send a tutorial

[@WizardVal]

@@yojacq It is easy mate- use the same technique as in this tutorial when creating camera. Create a plane, subdivide it to a good number to have enough geometry then add the displeis modifier. Add lights to the scene and place them where required. Search for : camera projection in after effects

[@rgarlinyc]

Great stuff - can't believe you and your channel were unknown to me until about 15 minutes ago!

[@heveycreations4197]

Your tutorial is really good !

[@machieldaniel]

THANKS FOR TEACHING HOW TO DO THINGS IN AFTER EFFECTS IT HELPED ME A LOT

[@KeithDaviesMusic]

Colin is a clever guy!

[@PhilAndersonOutside]

Anyone know a workaround if my Mac is too old to update to After Effects Beta?

[@viperstudiosinc.]

It’s still a great skill set to have using UE. Zoedepth looks cool, it’s just another tool to add to your workflow!

[@dannybee88]

So Awesome!!!!! Thank you ! One Question my mind went blank haha When I move the null cam position my character is not locked on the stairs like yours it moves.... I know I have fixed before but like I said my mind went blank haha Can you help !!?? Thank you!!!!

[@skabarflix]

Some of the backgrounds on the site are fantastic, but others could really use a tune up. For example, a neon city isn't very good if the lights arent flickering or changing. At that point, you might as well just make your own backgrounds. Other than that, this and the backgrounds are great!

[@mariorodriguez8627]

Great work!!! Got all the packs over black friday deals :)

[@mfundoh8148]

I'm so stoked. 😂❤

[@chadiwack]

Fantastic tut. I subbed. Thanks for getting straight to the point and killing it.

[@FilmRigz]

Very good on explaining everything, very simple and straightforward, 🔥🔥🔥🔥

[@dr3w_h]

Omg, this video is just GOLD! Thank you so much!

[@violentpixelation5486]

That's a PACKED video! #Gold 💯🔥

[@JustSomeRandomStuff_fr]

hey bigfilms, i know you already have tornadoes in the apocalypse pack, but can you make a pack called tornado pack?

[@RipRecords]

Is 2k (1080p) the best resolution we can get from ZoeDepth? Any other options (including paid) that can help us keep that 6k resolution for those of us that like compositing in 4k and higher....??

[@Flugamefilm]

Could use generative fill. or topaz labs has 6k upscaling.

[@kennonfleisher]

I'm curious about the same thing. I would pay for 6K resolution, it's currently very small for 4K work.

[@jettroseofficial]

@@kennonfleisher If anyone can help but I have the VOL 1 pack and when I follow this tutorial but my backgrounds look like crap. Not like his is coming up clean they look muggy, anything I can do to fix this?

[@PhucThinh1505]

thanks for this, helped me save tons of time and money!

[@gulraizbhutta]

so much to learn in one video cool...

[@polypeptide]

Thank you so much! Is it normal for the image quality to degrade quite a bit once you convert it? Yours doesn't see like it does.

[@mnumrqz]

great tut man! thanks a lot for sharing 🙌

[@janussquared9793]

Could a workaround to the limits both left and right of the 3D created background be to take a frame shot within either After Effects or Premiere import it to Photoshop and do a "creative fill" both left and right then use that prior to making it 3D and THEN use that to import in After Effects?

[@baptistoriginals]

Yeah depending the fill you might could even do further separation in whatever it generates for more depth

[@Nohoes-]

This is amazing man ❤ thanks

[@SpectrumReviews]

You effects packs and tutorials are amazing. I appreciate your work you put into this. I'm learning from this and already have a project in the works for my stream.

[@falfieri3167]

Their effects packs are scams.

[@SpectrumReviews]

@@falfieri3167 please explain

[@SKN2024]

Y​@@falfieri3167

[@imvisuals215]

Ok. Now I have a use for these. Dope tut.

[@jason.martin]

Wow, this is brilliant!

[@peffken8834]

Thx 4 sharing Zoedeph, your experience how to handle it in AE. In your workflow to integrate greenscreen footage, I would make a copy of the scene, make a mask of the keyed one (or a duplicate with mask output setting in Keylight) and feathering the boundries (perhaps you need another copy to fence the feathering - there are a also some other, sometimes simplier ways to get to it...), use it as a mask for the backround, so that you you get an inner outline of the backround in the siloulette, precomposing it and adjust and blend it for your needs to get a nice spill of the environment. So here too, a pretty good result is achieved and explained, but what surprises me is that the shadows are mostly neglected, overlooked or ignored. Which, among other things, perfect the illusion of a composition.

[@j.i.7146]

This seems important for an even more seemless integration of the keyed out footage. Since I am not that comfortable in AE yet, can you please explain it simpler, so I can understand the steps you suggested?

[@TheLillid]

thanks for sharing- awesome.

[@roadstudiosproductions]

Gotta use this for new feature film

[@OdinsForgeEnt]

Can you do this with FCPX?

[@artemus80j.4]

Using this along side with Element 3D would be a great combo.

[@mufasa2079]

convert your glb into an obj file

[@ΥπερδιαγαλαξιακόςΑστροπολεμιστ]

Bruh this is nuts!

[@un_source]

Hello, is there a quick way to use this technique w/ C4D and retain the image textures? Importing GLB straight from Zoe to C4D only imports the mesh (with no photo textures assigned) - thanks!

[@slickslimyfilm]

Idk about GLB file in Davinci but I would keyframe the background to give it some movement

[@TheSatzy6699]

Great content and explanation ❤

[@javieleetoo2213]

Guys it’s this exclusive of AE ? Can I use your 3D elements pack on FCP for example

[@dnexovfx]

Where to get green screen footage 😅

[@Loony_BeLuna]

I'm a 3D artist and this is pretty much what I was looking for, but it's not quite finished yet. I work with DAZ3D, but I've never learned to model anything myself and with a tool like this I could finally model things for myself. AI can convert images into .Obj files, that would be amazing!

[@WizardVal]

It is not converting 2D into 3d objects. It is distorting the simple plane according to the depth map it has created. Lots of artifacts and the movement is REALLY limited. Doesn't work actually with the complex images having objects and people. For the environment as background it could work. It is something like Camera mapping in 3d max or Maya or any other modeling software. The depth map is really not as perfect as it is based on black and white 2d image. If you manage to convert this into space data in Fusion or nuke then you can improve your results. otherwise for a good result you need to build a more or less detailed 3d scene and then to map camera with your image. Hope it does make sense

[@Loony_BeLuna]

@@WizardVal Hi, yeah I had the same experience while watching the video. I hope to see that AI can make .obj files from images in the future. Especially environments. Like I would love to use a "filled" children's room or playing room, but adding many toys needs to have all those toys in your lib and that takes a LOT time to add and position. Or a room full of toys. Also filled classrooms with static objects as students would be great, at least with daz3d you struggle heavily to render with more than 4 people.

[@WizardVal]

@@Loony_BeLuna Exactly! It’s too early to expect ai to solve complex tasks. People don’t understand that this ai hype is created by ai developers to get more money. It’s obvious that when it come to something more complex than to put together some images it falls. I remember 10 years ago when I started to create VR imagery and everybody was excited and thinking that AR VR or MR is just around the corner and will change the industry. 10 years later people still use shitty images to promote and marketing products. If you can imagine the amount of money wasted.because of outdated business structures where thousands of incompetent people just show up that they are capable of something. Unfortunately our reality had turned into virtual absurdity.

[@Loony_BeLuna]

@@WizardVal I think you underestimate the power of AI. It has not to do with the devs. AI developed in 2023 MUCH faster and heavier than VR ever did. I did not saw a future in VR since beginning, it's still bad. That thing on my face would be too warm and uncomfortable. But AI is developing extremely, look how good Adobe Firefly got, look how great AI to voice with videos is and now this here. I managed to write a code with AI and I use AI really really much since 2023. I used ebay today and ebay has now AI to let it write the product description of the thing you want to sell. My new LG OLED TV has AI (Which I disabled) to improve image and sound. AI is Really a game changer. Elon musk is also working on it and also work on Androids, our World is changing, if we survive all the upcoming wars...

[@WizardVal]

@@Loony_BeLuna Do not underestimate the power of capitalism mate. They invented the infinite game, subscription game and many others. Yes, mate they will keep feeding us with “ amazing “ updates once a year, like Intel or Adobe, the recent scandal shows that “ benefits for mankind” is an illusion to keep us intrigued. In reality I didn’t find extraordinary capabilities or mind blowing art created by ai. To spend years in order to learn how to create a prompt and days to trial and errors before ai will create something interesting? No thanks man. I better learn the painting skill and create art no ai can create ever. AI is a tool. Not a creator. It is not capable of doing what humans can do. It will never be. Despite all the scaremongering it cannot take decisions, just a simple tool. A calculator. That will be capitalised accordingly. No miracles.

[@nodoarabidze8707]

your site,makebig films, if i choose this 16$ packet,what i can buy? should i pay 199 or 16,6 i dont understand

[@fissunix]

Thank you for this great vid ! All is working but is there a way to improve the quality of the texture of the glb file ? Right now when i export my vid from AE, the 3D glb file looks like a very poor jpeg ... Any clue ? thx !

[@jettroseofficial]

same is happening for me, Im reading through the comments to find a solution

[@chrisgallagher85]

This is bada$$!! Thanks for sharing.

[@jamiefolds5295]

I see that after effects is a monthly subbed app... what actual adobe editor do i need to use after effects and how much does that cost ? What software is being used in this video as the base editor that after effects is added too?

[@_Soul_Hacker]

Nice work broh🔥👍🏻

[@benpedro80]

thank you , I have learned something today !!

[@bluerabbit1236]

Cool I could use this technique to create extra establishing shots for my movie so I don't have to go all the way back to the location to shoot footage 😂 This'll just do the trick and I don't even need the green screen part.

[@radioactiveartist9246]

this is awesome but I cannot get ZoeDepth to create the mesh. Always fails to complete. :(

[@cgxlv]

Pretty cool dude. FYI, This seems to work ok in the latest version of AE I am running which is 24.1 so I doubt people will need the Beta

[@xbrutalgamer8193]

this is so cool

[@ghostware4415]

cool bro, how to make shadows from objects? and is it possible to work together with Element 3D?

[@truthunleashed5250]

Coild i use these backgrounds for podcasts

[@starfieldcommand]

Thank you ! you are an amazing creator!

[@drumSick66]

That's really cool, thanks!

[@jaydez_]

ahhhhmanzing, thank you so much!

[@AVISIONMUSICTV]

This is OK for story boarding or even comic book creation graphic novel. That's about it.

[@hossienrahimianmajd]

amazing points i needed in my after effects skills thanks for that

[@leomac3337]

how to fix the darker image? its too dark in zoe depth

[@Tetraknot]

From what I can see, ZoeDepth can only do 1080p models. Sucks to put all this work into a scene if it's going to be limited to 1080p. Is there a workaround to get 4K 3D model exports from ZoeDepth?

[@hyperbolekid]

Is there going to be a Holiday sale on these packs? I want to load up

[@Revontuletband]

Is there a way to change the texture in a glb file from zoedepth with the original image? it reduces the quality a lot

[@GreetingUser]

Nice! Is it safe to use it commercially? Does it store the images fed into it?

[@ygmgstudios]

can we do a tutorial for FINAL CUT PRO ?

[@HeroHiFi]

Excellent tut! Nice, clear steps. Thanks