Generative Fill for Video: Change a Background using Motion Tracking and Rotoscoping

[@AbSesayPhoto]

Damn, so much to learn. So much has changed in so little time.

[@linestodesigns]

overwhelming but exciting!

[@BenroUSA]

Thanks for this!

[@linestodesigns]

My pleasure - thanks for watching!

[@mlegrand]

Amazing work and fantastic channel here!!! 👏

[@linestodesigns]

Thank you so much 👍

[@tanyasubaBg]

I'm really impressed, one more time. Thank you

[@linestodesigns]

Happy to hear that! Thanks!

[@DE-signYourLife]

Because of decreasing the opacity of the clouds its looking unnatural but of course if u leave it as it is it woukd looks also unnatural what u have done instead of that is looking for another clouds which fits better to the footage and on top of them u have to color correct it and than grade it all together

[@linestodesigns]

Thanks for the comment! Yes indeed there are more in depth ways for clouds - especially within after effects but that’s a whole tutorial within itself - thanks for watching!

[@pineaplehead5020]

generative fill AI is really a game changer

[@linestodesigns]

Sure is! Thanks for watching

[@thedust84]

very nice , thanks

[@linestodesigns]

Thanks for watching!

[@noxroypowell1766]

Amazing work! Are you getting any violation restriction errors? Seems a lot of people are getting banned from using the generative fill. Is your generative fill working as of now?

[@linestodesigns]

Still working as of now - I’ve noticed i get violation errors when I leave the prompt box blank. Im sure Adobe will update this at some point, thanks for watching!

[@mr.critic]

just add a . and you wont get errors filling in.

[@linestodesigns]

Yes! I’ve actually done this and great workaround for now

[@larrymawile]

Hi love how you combine what you create for this, btw may i know what specs you for your mac?

[@linestodesigns]

Thanks for watching! I work on an Macbook Pro Apple M1 Max / 64 gb memory

[@larrymawile]

@@linestodesigns wow so m1 max is enough to do rtoscope, i have to get one hopefully soon

[@mertgrkm]

this is awesome, I am thinking a few months how can I use AI on my videos and you are explaine it

[@linestodesigns]

Glad it was helpful!

[@kazardomain]

how to track and maintain a moving image that was pan shot let's say the camera starts from the sky to the subject.

[@linestodesigns]

You’ll need at least one spot to track so you can superimpose your background - as long as there’s something to track you should be able to do it

[@petarpetrov5548]

Very cool, just your tracking is wrong, the girl is floating , because the plane you choose in mocha was wrong, simple translate rotation tracker in ae woudlve done a better job maybe, love the workflow tho.

[@linestodesigns]

Thanks for watching! The plane chosen for tracking was for the background not the subject. But agreed a simple tracker would work as well - I just prefer mocha! 👍🏼

[@petarpetrov5548]

@@linestodesigns Yes I get it, but the shape that you drew in Mocha , the objects inside of it were not in the same plane, thats why it felt like the foreground subject is floating. I am not flaming you or anything , just friendly suggestion ;

[@linestodesigns]

ah gotcha! thanks for watching and thanks for your close eye to detail!

[@blackbird8837]

I should be impressed, but I can't help but feel the whole process and swapping between multiple programs and plugins is kinda clunky. I'm looking forward to a native implementation in Resolve's fusion where I just link a few nods and integrated AI effects to arrive at a better result in the fraction of the time. I'm sure we're like 12-24months away form that tops.

[@linestodesigns]

agreed, and Adobe im sure is working on a generative fill for video in After Effects - but until then this is how the process is done. Thanks for watching!