Where’s the Camera?! Content Aware Fill - Seamlessly Remove Objects In 360° VR Video

[@moxx]

if the video is too big, it takes too long time for analysing. shall I create an proxy before using the content-aware fill tool?

[@eduardoisidoro3957]

You are a jedi master Hugh Hou, I was having problems with the Mocha, but with this technique, although it takes a little more time, it was very effective, thank you very much for always sharing your knowledge, big hug.

[@hughhou]

Glad it helped!

[@maratov_f]

Thanx bro for info. I need your help. where i can find rover for qoocam 8k? Thanx in advance

[@hughhou]

Any rover or RC Cart. I don't think you can buy one just for it. You can build one from any RC shop - the one you saw in my video is very expensive prob not what you need.

[@simonbaxter5822]

Brilliant help, thank you, but I'm tearing my hair out because I press 'open output/render' and don't know what to do! I still appear in my premier pro clip even when I replace and render...

[@bsuska]

Great tutorial, Hugh. I'm having an issue where when I add a 2D edit in After Effects my image still looks top and bottom? Any insight?

[@visionmagenta]

Hey nice content thanks so much! i have a project but i dindt find a content that show us how to erase Speed Rail in a Stereo 3D 360 :(

[@hughhou]

Have you try this Resolve tutorial: kzbin.info/www/bejne/kKjSm6Kwjtdpbq8

[@360vroomers]

Will content aware fill work for 3d 360?

[@geoffreyoxholm2159]

It does not yet specifically take into account 360 or 3D, so you'll need to be diligent. I hope it helps though.

[@hughhou]

Not really... but Adobe has plans for it. But prob 3D first then 3D 360... different projection.

[@borisfxlearn]

360Rumors Mocha Pro can do stereoscopic 360 object removal

[@eshu1023]

thank you so much for your tutorials! you're a total life saver. although it's taking forever for my content-aware fill to render a 3-minute video. is there any way I can make it faster? :-)

[@hughhou]

Try the After Effect 2021 in beta right now on Creative Cloud - it use GPU accelecrated render so it is a lot faster - it is still in Beta so might crash but so far working like magic on my end on my spec

[@theeditorrestrial]

Very slick...I forgot about the content aware fill..jeeeez. I'm a noob in the VR tech but learning more n more SUCH AS with the 360 sphere cam ya won't have to remove drone...but flight safety takes a lil hit. Appreciate the tute!

[@hughhou]

Glad you think so :)

[@erictao7538]

Thanks Hugh! So great as always. What would the process be for stereoscopic content? Would you consider a video that covers that?

[@hughhou]

Yes when I figure out a repeatable workflow myself. Right now the only way is do left and right eye and them merge them again. Not ideal...

[@erictao7538]

@@hughhou I eagerly await it then! Also, do you have a Patreon? I would support you in a second for all that you do Hugh.

[@hughhou]

Thanks, Eric. I don't. But I should really start one lol.

[@borisfxlearn]

Eric Tao Mocha Pro can do stereoscopic tracking, masking, stabilization and object removal.

[@cadrevr1260]

@@hughhou Has there been any updates about VR180 object removal in After Effects without Mocha? I'm trying to take out feet at the bottom of the frame and unwanted background objects and still searching for a solution with Adobe. Thanks!

[@gxi3602]

Great Video thanks! So am I correct in saying content aware is best for removal of tripod and shadows as well. In your opinion which is the best method this after effects technique or creating a plate and masking via photoshop. I've seen in some of your other videos you've mentioned that photoshop is not best, but then also use it frequently when editing. Please explain your thoughts on this. Especially if subject is moving across tripod shadow :S

[@hughhou]

I will make a indepth on coming up soon - this is a little old as AE has some new development on this AI removal thing.

[@gxi3602]

@@hughhou Thanks a lot! I'm looking forward to it. Keep up the great content

[@JD-lb8np]

at 4:49 you say go and click mask but you click the pen, how do you get it to draw that boarder around you?

[@neorage30]

Really good tutorial. I'm not really good at editing software, I only use healing brush for photo while wondering how they remove it in video. Thanks

[@hughhou]

Thanks! This is easy tho. If you can use healing bush - you can use this!!

[@ale4k545]

Hola hermano, exelente tutorial. me sirvio mucho para seguir aprendiendo de tí. te ganaste otro suscriptor. te hago una pregunta, que software utilisas para cocer los videos 360 ? yo uso mistika pero estoy teniendo problemas y nose si los hago mal o es la camara que se ve con baja resolucion. saludos coordiales desde Argentina

[@Daveperso66]

Hi Hugh, can you point me to a tutorial or software that you would use to create simple 360 cartoon or rendered panoramas to use as a backdrop or menu for a series of 360 photos or videos? I am finding some that I think that would do the trick but they are really complicated, I am looking for a simple non-animated backdrop. Could be a classroom or a street scene, or even just an empty field or beach but not a photo.

[@hughhou]

I don't have one on this channel - this require some C4D or Unreal magic which is out of my specialty

[@Daveperso66]

@@hughhou Thanks for the really quick reply. Appreciate it!

[@finesaerialimagingllc9804]

Cool! What pole / camera did you use?

[@hughhou]

First is ONE X, second is Insta360 Pro 2, third is GoPro Fusion.

[@SamaraMedia]

Great video tutorial. I see a couple different rovers in your vid's, what size are you using in the second part of this tutorial? What do you recommend for the Insta360 OneX. Thanks! Look forward to the next video.

[@hughhou]

Rover for ONE X? One X do not need a rover - just handheld on top of your head and use the same technique to remove it.

[@fresheyes3609]

Hi Hugh, I want to ask about the Mocha VR removing car, what is the purpose of BG remove in this video? I watched a tutorial of BorixFX, it only shows the car-remove and BG-track. The background after car-remove in that case doesn't look as clean as yours. Could you please share a little more about the intention of each layer and how to track it in your way? Thank you!

[@hughhou]

Yes I will. My technique is a lot more involved compared to BorisFX official tutorial - it might take a long video for this.

[@fresheyes3609]

@@hughhou : Thank you a millions. I stay tuned for it. You do a wonderful job sharing your knowledge. May you have a great day!

[@sksblake1235]

Can you use these techniques to remove underwater housing from your shot?

[@hughhou]

Yes. ONE X?

[@sksblake1235]

@@hughhou Thanks for getting back! Yes it's the Insta 360 One X with the One X dive housing.

[@madcorp206]

Thanks for the demo, however it's way too slow to be helpful. I wanted to test the "object removal" feature of Davinci to compare, but I didn't find a way to apply it to a 360 video. is it even possible ?

[@OaklynMediaLLC]

My home editing machine runs the i9900 with a 2080Ti pretty similar builds we're using!

[@davidsebastianlopezrestrep6396]

Hello Hugh , how can I remove the tripod from a 3D video? I film with the 360 pro.

[@hughhou]

Right here this tutorial: kzbin.info/www/bejne/n6PSgayah9tmbZo - little old but the workflow did not change.

[@davidsebastianlopezrestrep6396]

@@hughhou Oh Thank you Hugh, I was just wondering if you know if it is possible to do it in After effects, like in this video, it works perfectly with mono, tracking the changes of light, but I can´t find a workflow for stereoscopic. do you know how to do it in After E????

[@OaklynMediaLLC]

Little tip for insta 360 users. Convert the .insv to a .mp4 or .mov if you want to dynamic link into after effects. Premiere has a .insv plug in but after effects doesn't

[@Evil-Druid]

Друг. Спасибо тебе от всей Русской души. ты мне очень помог.

[@MatternjPhoto00]

Magnificent, thank you very much! Some day you make us a tutorial of your computer and the configuration of it. To go as fast as you in the editing of 360 videos. Since the same exercise, I have taken 3 hours in mine, to do 10 seconds of sequence.

[@hughhou]

Yes. it will release soon! I have too many backlog video and tutorial request ATM. But this is def something I want to share as there are lots of options and pretty confusing (I also waste lots of money to get my current setup...)

[@MatternjPhoto00]

@@hughhou It would be very helpful, especially with the imminent arrival of Instan360 Titan. How will we move that ????? ..... Ufhhh!

[@csdl910]

Amazing! Where did you buy the remote control car :D?

[@hughhou]

This one I made it but here is another option : kzbin.info/www/bejne/o5DQoYVspKeBj68si=ljBL8POAq5GAOjhu

[@csdl910]

@@hughhou wow! Thank you so much, another question, I’m confused, how do you take off the tripod in a 3D over/under shot? Or do you make it first left eye and then right eye? I’m stucked. Regards

[@hughhou]

I also have a tutorial on this topic on Resolve here: kzbin.info/www/bejne/gYTTfn9vbd1gbMUsi=mBPZiO3UzZpa3Drd

[@csdl910]

@@hughhouThank you so much!

[@LEXPIX]

Content aware on moving objects is getting pretty sophisticated.

[@hughhou]

Yup! Use reference frame more often you can fix that. But is not moving causing the issue. It is lighting and reflection. Have you tried Mocha?

[@capts3052]

can we do this using davincci ?

[@hughhou]

Yes! Check my resolve series

[@VRNomad]

Hi Professor Hugh! Thanks for the lesson! I tried this myself, and for some reason After Effects won't use my GPU (2080 Ti). I made sure CUDA was enabled and all that... can't figure it out. Have you had this happen too? Perhaps after an update?

[@hughhou]

Content Aware Fill is not a GPU accelerated effects yet - not like Mocha. But I am pretty sure that will be an announce in Adobe Max that this feature and many others will use GPU.

[@Lykia32964]

hiç sıkılmadan izliyorum

[@oonaghq3530]

Does this also work with 360 3d footage shot on the insta 360 pro? when I import the stitched clip into after effects, the screen displays as over and under so it's difficult to see the object clearly to mask it out.

[@hughhou]

You will need to pipe that into left and right eyes separately and then remove and merge them back in.

[@360vroomers]

Great job Hugh!

[@hughhou]

Thanks Mic!

[@Jgungz]

what if i want to remove the background instead?

[@hughhou]

The background of what? Keying?

[@Jgungz]

@@hughhou randon video background and replaced with what ever background i want. Its possible?

[@MiquelParramonCamps]

The result of the first video, of the girl walking, once the result is obtained and processed, can the video be uploaded to Google Street View? It is compatible if we have it recorded at 5 frames per second.

[@hughhou]

Yes, render out as 11fps to upload on Google Street View.

[@CapitalCraig]

How crazy, I was actually going to do a shot where I walk out the lincoln memorial with a 360... you already did it.. haha

[@hughhou]

You can still do it! I did not publish that shot - it is for a client.

[@CapitalCraig]

@@hughhou nice! we can have both! lol thx great shot.

[@lasemelleverte]

How can it work with stereo 360? Need a tutorial for that too!!! Pleaseeeeee!

[@hughhou]

Right now stereo tracking you need to do separate left and right eye and put them back together or use Mocha Pro for tracking.

[@dreamchaser3342]

Hi Hugh, You have never added the link to your PC build from the video :(

[@hughhou]

Oh forgot - the video is here: kzbin.info/www/bejne/emrSmqiqfpqJl5I

[@JD-lb8np]

how to you keep your mask from not coloring in what you masked? idk why this isn't working its like missing a bunch of little steps

[@hughhou]

Sorry, I don't quite understand your question.

[@sosavage360]

Just made my purchase using your code.

[@Kerolosnan]

from whrer i can ship this rover or any small rover please ?

[@hughhou]

Where?

[@Kerolosnan]

@@hughhou yes man...from Where? thank you

[@bertrandlevet4477]

Hi Hugh, the problem for the drone method is that color of the sky doesn't loop from left to right, so in 360 a lign appear... If you have a solution, I get it.

[@hughhou]

I will first - make sure the patch is horizonal around both side edges. I use Mocha VR to patch all my drone: kzbin.info/www/bejne/sIm0lambo5KgZ6s - when reframe with Mocha it is edge awared. Another way to do is to just replace the sky completely - usually it is the easiest and cheapest way to go: kzbin.info/www/bejne/o5WlfGt5ntOVmqs

[@brodwardz]

hello, after I get an error that says: Content sensitive fill error. Library call error. Do you know why this happens? and if it is not that error, another one says: There is not enough memory to complete in composition! Could you please help me. Thank you

[@hughhou]

You need to allocate more memory to your After Effects application. This is a very CPU and memory intensive operation. What is your PC spec?

[@brodwardz]

@@hughhou 16 ram and 120 solid state hard drive. What specification do you recommend so that it works well, or better to work with Mocha Pro for postproduction and to be able to eliminate?

[@gidas360]

Very usefull as allways. Thanks!

[@HakanKorkmaz]

Hi Hugh, I choose VR comp editor but my view is not changing. Whatever I tried did not happen. I even updated my driver. Can you help me with this, please?

[@hughhou]

After effects? What version you are on? 2020?

[@kberwager]

Hi There! What do I do when I use Content-Aware Fill and I get an orange "This project contains expression errors: errors 1 of 6. I did a lazy (by accident) Stitching job with the Insta360 Pro II I didn't manually stitch and I don't know how to fix the expression error so I can SEE how my Content-Aware Fill worked using the reference frames. I'm freaking out because the client is waiting fo their video. Any help would be appreciated! Awesome Video!!!!!!

[@hughhou]

Sorry just saw this. Expression error might caused by your other plugin? Bad stitch will not cause expression error.

[@kberwager]

CreatorUp I found my original unstitched panos, restitched them and now the error is gone. Thank you!

[@clausli9138]

This is amazing, thank you for your great tutorials.

[@hughhou]

You're very welcome!

[@vrg1337]

Is this technique usable for longer clips? My PC keeps crashing or running out of memory. Trying to remove myself from an 8k 360 video. I7 8700k with 16Gb.

[@hughhou]

8K?! You might need to downsize it to 5K - 8K with your setup is too taxing...

Simply fantastic, Your tips are exceptional, I speak from Brazil I am starting my English course, to have a face-to-face course with you! Waiting for a video talking about your machine you bought at MainGear with i9 and gtx 2080ti, my processing lasted 90 minutes for a video of 1h15, I have an i7 and an rtx2080. Is it normal or should I better change processors? Thank you very much, you are an inspiration, one day we will do a job together!

[@hughhou]

Yes it is normal - 360 take more power to process in general

[@dmitriylukin7409]

Replace with After Effects - is not active. why?

[@derekmedeiros]

This is awesome! Thank you!

[@hughhou]

glad you like it!

[@MiquelParramonCamps]

Does anyone know how to remove the car or the person from under the camera when recording kms of road or, you are traveling trails in the mountains. How does Google Street View do it? does anyone know? We use an Insta360 Pro 2. Thanks.

[@SimiTravels]

interesting video and good way to explain things, thank you Hugh ✌️

[@JD-lb8np]

when I put my after effects in 2d mode it says this effect requires gpu acceleration?

[@hughhou]

Yes, did you turn on GPU acceleration of your project?

[@hutchery3609]

I find this is taking all the memory and harddrive space on my 16gb Ram macbook pro. I had more than 100GB of HD Space, suddenly, AE crashed saying its run out of Cache. I'm not sure if this can be achieved without a GPU or lots of HD space also. I am now afraid try again.

[@hughhou]

You actually need at least 200G space and decent GPU card - I will make a Mac setup soon which rely on eGPU and SSD.

[@JD-lb8np]

how do you draw the mask?

[@hughhou]

In AE? There is the masking tool - it is a pen tool for it.

[@360id]

Nice..great job dud🤓👍

[@ChristiaanRoest79]

Hello Hugh. I have a fast computer. Specs i9 11900 processor with 128gb of RAM and a geforce rtx 3090. Is it normal that after effects is so slow while using content aware fill to remove the drone in my 360-video? According to my computer most of the time the cpu is 100% used. Sucks a lot. Mocha pro doesnt support my rtx 3090. It crashes a lot. Little bummer :(

[@hughhou]

Wow that is crazy spec! Content aware fill right now it is only CPU not GPU - use Mocha Pro instead. I don't have RTX3090 - But Titan seem to be fine.

[@ChristiaanRoest79]

@@hughhou thanks buddy. Its an amazing new pc i bought last week. Very expensive, almost 6k but worth the investment. I removed the drone with mocha pro and clean plates (edited in affinity photo) made every 250 frames. Gpu acceleration works but i have noticed that the cpu removal comes with less artifacts in the sky. The cpu removal in mocha pro is very slow. When choosing gpu tracking i sometimes get weird lines and stripes in the sky. Havent you noticed this also? I guess i needed mocha because it was a long horizontal flight with some slight rotation of the drone. The background and sky was constantly changing. Making one cleanplate to replace the sky for premiere pro or resolve (fusion) didnt work. Sometimes i am kinda searching for the best workflow depending on the footage. I will share the video when its ready :-)

[@telly5373]

You da best! 👍

[@hughhou]

thxxxx!!

[@caoscorp]

Dud, you are the best :D Thanks

[@hughhou]

Awww thanks!!

[@naha5100]

I CAN NOT FIND VR CAMP EDITER

[@360Serbia]

cool Hough

[@PandorasCrate0]

Here's the problem I'm having: I sent my footage from Premiere to After Effects in the same way, follow the same procedure as in the video, but when I go back into Premiere, none of my changes show up on my clip even after rendering. I'm loosing my mind. Please help. Please? :'

[@hughhou]

Dont use dynamic link for 360 video - render it out from after effects in ProRes and import it back in Premiere.

[@PandorasCrate0]

@@hughhou omg...I don't know how to thank you, you've alleviated such a headache...if I could subscribe ten more times, I would. Thank you, thank you.

[@PandorasCrate0]

Also I feel like a dum dum because that was so simple a fix (I am not well versed in After Effects).

[@mirinaeman]

Good!!

[@BDLabs2]

Wow

[@hughhou]

Thank you!

[@Ryudon13]

Hmmm... anyone used this technique to remove an obvious stitching on a 360 shot?

[@challengerapp3953]

Hi man! Great video! Two questions: 1) what is your preferred vehicle mount? (Excluding rovers of course) I think the only way to get a good 180 degrees horizontal view and a 140 degrees vertical view is to mount 130cm the GoPro Max ahead of the car (so that you can rotate then the pan from +90 to -90 without framing the car), but that’s unfortunately illegal... And I don’t like very tall mounts on the roof (like google street cars) 2) how can you limit the field of view when exporting from Premiere? I guess that could be another way of not seeing the rover or the drone correct?(if possible) Thank you in advance

[@hughhou]

I am actually making a tutorial on car mount - should be out soon :)

[@JD-lb8np]

Mocha pro is so damn pricey for only needing it for object removal

[@hughhou]

You can always use AE content aware fill which is free. Just need to have more interframe using photoshop for removal as the tutorial pointed out.

[@JD-lb8np]

@@hughhou ✊🙏 hell yeah haha commented too soon thanks for your replies love the content you out out!

[@JD-lb8np]

@@hughhou just got premiere and after effects haha so confusing, glad you have this tutorial! Helps sooo much 🙏