edit 1 frame and let ebsynth do the rest - advanced ebsynth tutorial

[@AcademyOfEdits]

*Important Explanation for the Advanced Settings from the EbSynth Team* I reached out to Secret Weapons (creators of EbSynth) and they were awesome enough to give a thorough reply/breakdown of what the *Mapping* and *Diversity* settings do so please ignore my guess in the video. Here is their explanation: *Mapping* -- It's not really a defense against moving lights or shadows. If you wanted to suppress the artifacts caused by moving shadows, you'd have to use a video with a high-pass filter on it as a source instead of the classic RGB input. Mapping is more of a defense against similar colors on different objects in one scene. If your hat and your pants had the same color in the source video, EbSynth might think they're the same thing and use the texture from the pants on the hat too. The higher the mapping the more position-aware the texture is and even if the colors of several objects are similar, EbSynth knows that they are in different positions in the image and will associate them with the correct texture. *Diversity* -- To understand diversity, it is important to keep in mind how EbSynth works. It breaks the painted keyframe into little pieces, like a puzzle, and reassembles those pieces to build a new frame. However, it might use the same piece over and over again and you might see some ugly repetitions in the results. Similar to the clone stamp artifacts in Photoshop. So the diversity tells EbSynth how many times it is allowed to use a certain piece of the texture. On low diversity, EbSynth is kind of free and can repeat each piece more. That might be beneficial for some cases. On higher diversity, EbSynth is bound and it has a limited number of repetitions to make. The thing is that EbSynth never warps any colors to match the underlying frame. It always only works with patches of pixels from the painted keyframe. That way the artist has more control over the results unlike with many current neural-network approaches. So there you have it! Thank you Šárka for the awesome explanation of these two advanced settings :)

[@secretweapons1199]

No problem! Thank you so much for this absolutely fantastic tutorial! (also, I'm quite fangirling over the fact that you did the tests on Harry Potter scenes :D)

[@sandiMexicola]

Thank you for this wonderful clarification! :)

[@bugsbunny5977]

Worth watching...

[@adult93]

Raspek for the update

[@markrichards5630]

I'm glad you added this. Tutorials should never include the phrase "I'm guessing". (just have a look around the web at people doing "Compound Blur" tutorials... just... wow!). BTW, to better blend interim key frames where you have had to update the overlay mid shot, you can not only let EbS run forwards but also run it backwards to lay in the tweak in the reverse direction on top of your previous changes. Think of it as getting closer to perfect with each iteration, and EbS having a more perfect section to remap onto.

[@ssscout]

i'm thoroughly convinced this program runs solely on magic

[@aechlo]

sameee💀

[@Raymondae]

scout holy shit

[@InnocentEdits]

tbh

[@osamabinballin5369]

Yoww

[@rekostarr7149]

well how do you define magic?

[@frankdrws]

Using it to Luma matte is a big brain play

[@AcademyOfEdits]

I whispered “oh shit” to myself when I thought to try it lol

[@rudyR20537]

Sorry, Im extremely interested in learning why it is a big brain play (Am currently learning AE)

[@ElijahCiali]

@RudyR basically means using ebsynth to rotoscope

[@ThePieGuy731]

couldn't he have just flattened the photoshop layers into a smart object and then cut out his head in photoshop and just apply it to the footage through Ebsynth as just his head instead of the entire frame?

[@TheGhostFreakz]

@@ThePieGuy731 yeah that's what i thought as well

[@dictionaryofwords1108]

Seeing how people are using this program is insane. I love the creativity

[@Luvutoo]

Honestly if you were to ask me what was faked, I'd point out the row of kids standing behind each other before even realizing the ties were gone

[@WhitefoxSpace]

The edit at 7:17 and earlier, that grainy, sepia looking transition is absolutely beautiful- you should totally do a tut on that

[@davidfairchild8566]

Looks like it is just a color adjustment with a texture overlay. The transition to the sepia was most likely done with a matte effect.

[@MorganWable]

1. Keyframe the footage layer's scale up to about 105% , over about 12-18 frames (assuming 24fps - do 15-20 frames if it's 30fps). 2. Use either Timewarp, a time remap, or something like Twixtor to slow the footage down to a still frame - and keyframe that to take the same amount of time. About half a second. 3. duplicate the layer. hide the one on top and ignore it for now. 4. underneath the hidden copy, and above the bottom copy, add three things, in this order (bottom to top): an empty Adjustment Layer, an empty Solid, and a paper texture of your choice. Just grab something from like, unsplash. doesn't matter. 4a. Make sure to parent this texture layer is parented to one of the footage layers, so that it zooms in with everything else. 5. on the adjustment layer, add CC toner and tweak the colors to your liking. 6. on the solid, add a Fractal Noise effect. You want this to be nice and subtle, so: 6a. turn the complexity down to like, 1.5 or 2. 6b. turn the scale of the noise up to around 200. 6c. keyframe the evolution of the noise very slowly - no more than 15-30 degrees per second. 6d. add a Levels effect. raise the output black - and lower the output white - both to very close to the middle. adjust this to taste. 6e. add a Gaussian Blur if the noise is still too sharp. 7. set the fractal noise and the paper texture both to Overlay blending mode. 8. re-enable the top copy of the footage. 9. on that top layer, add Extract. animate the parameters so that the top layer goes away bright areas first, over the course of that half second. Increase the softness to make it more subtle. 10. Add "Refine Soft Matte" and turn off "Decontaminate edge colors" or whatever it's called. 11. ...add a paper crinkling sound effect. You'd be amazed how much heavy lifting the sound designers do when it comes to VFX shots. 12. go back and tweak the scale keyframes (of both footage layers!) so that the zoom in a little slower than the other parts of the transition. That should be it. Tweak all the keyframes and settings until you like it, and you're done! Keep in mind I didn't test this out, I'm just coming up with this on the spot. I think it should get you pretty close to the same transition, though.

[@jezzabelle318]

@@MorganWable thanks for this!

[@ruudygh]

@@MorganWable sounds like a tons of works

[@SyncFPV]

I was convinced the process was going to take hours to generate the output, but doing all the examples in under a couple of hours means the ebsynth part must have been pretty fast! Super impressed!

[@HoofCreaition]

I have been using it for some months to create a music video that consists of scenes that are drawn/painted. This is the first app that easily projects a painted version of one or more frames on the underlying material and the result looks consistent (instead of processing each frame in Studio Artist for instance). I am so loving the results. Sometimes I am just watching the frames getting written in real-time. I hope more people get to find out about it and have fun with it. While doing all of this, I also had to learn a lot more about motion tracking, rotoscoping, and what have you, because I was making the shots more complicated after finishing the last. Pushing the boundaries of what is possible. So now I am watching a smoke simulation from Blender being rendered out. That will be comped in After Effects, keyframes processed and painted over, and then through EbSynth, and more work in AE. It is unbelievable how much one can do these days with software that is available for free or cheap (I guess DaVinci Resolve is a good alternative for AE). Your imagination really is becoming the only limit. This video is a great example of how EbSynth can bring really cool solutions. Not only funny animations or deepdreamgenerator movies that make you wonder if there was something weird in your coffee. Thanks for a great video!

[@inboundmark]

It's great to hear about your experience mate! can you share more about your process do you upload pngs from the same sequence or a totally different one?

[@lackofacontent]

I can honestly say that your videos are some of the best out there on these topics, Ive been learning after effects for the past couple of months and these videos are perfect in every way for my situation, I know the basics, but Im not a proffesional. you. are. amazing.

[@AcademyOfEdits]

Hey thanks so much, I’m really glad to hear I’m helping so many people out :)

[@hawkwardart]

thank you for mentioning how EBSynth handles transparency. I've been scouring the internet for this info

[@KarimDavisFilms]

Even the softwares name sounds magical

[@Mushiwushii]

this is probably the most unique way i've seen ebsynth be used. thank you for the ideas

[@leahpy]

This is absolutely brilliant! Thanks for putting so much effort into your videos!

[@MoviesRemastered]

This is a great tutorial, dude. A few editors have been trying to convince me to use EbSynth for months now but I've convinced me. Nice work.

[@Eddie-ik4ot]

This the new best channel that I recently discovered.

[@MichaelSavidgeStoryteller]

Oh....Oooh...OH! Wow! Fascinating, very fascinating.... Thank you very much, this has been very inspiring and enlightening. Best of luck in the new year with any upcoming projects, count me as a new subscriber!

[@cupajoe99]

Great video - just started using EbSynth this year myself

[@MrRobertC]

Quick comment on the advanced settings used in this video. They slowed my render down lots. A two hour job became five. Worse I had a classic AI overfitting problem leading to distortion which disappeared when I reran using the defaults. The author does a great job in this video explaining why he made these choices. My project was very different (de-aging). Just giving a heads up to perhaps try the defaults on a small clip depending on project type to avoid wasting lots of valuable time.

[@AndrewMurphyFilms]

Dude this is so sick! Technology is getting amazing!!

[@CLIQUEIPTV]

Thank you for your video, my brother and I are testing EBsynth for out real videos to Animations and we are talking about expanding to doing our short Syfy movies using EBsynth as well, your video showed that would can accomplish the type of effects process we are looking for without breaking our bank account using a mix of tools but EBsynth being one of the main go to tools.

[@bernacarangan]

high key i couldn't tell much of the difference of the slughorn edit until you explained them-- wtf pure magic

[@daaaassshh]

videos like these make me more motivated to make vfx projects

[@krysidian]

I always thought about style-transfer when thinking about EB Synth but using it for visual effects and tweaks is genius! It'll make changes of texture and materials so much more convinient and the tutorials as thourough as always! More people need to see this.

[@atsukikurosaki4063]

HOLY HELL! SO glad that I got your video in my recommendation Love your unique style and amazing tutorials! You got a new subscriber 🥰

[@dogukankrkclar7730]

Last year, I was slimming brides' faces in wedding videos. With this program: D

[@KnutNukem]

This is going to a whole new level

[@dogukankrkclar7730]

@@KnutNukem :D

[@GregMatoga]

@@dogukankrkclar7730 please don't tell I'm it's some standard practice... I'm fed up with only basic correction per clip. Can't imagine slimming down one person in each shot of a longer video. I'd return the money tbh

[@Killator]

i wish i knew this info before trying about a dozen different renders only to get terrible results. i think you have sparked my interest in EBsynth again. thank you

[@резня-п1е]

thank you academy of edits for making me a little more academical with every your video

[@morningcoffee1111]

Well when you put it like that it’s simple. o_o. Actually I didn’t understand most of this, but it was amazing and I subscribed and I’ll watch more. Thanks for putting this out there.

[@christopherselvo6798]

It's really scary that you can actually change an actor's performance with this. re: Normal to Sulky potter

[@intraspecies5120]

This is FREE? I was expecting it to cost a ton. Can't wait to try it out!

[@SupertzarMetal]

"The easiest way is to add white to the luma matte" Oh, why didn't I think of that? So easy!

[@BooooClips]

AI effects are getting crazy! Been using skeeter to isolate the vocals from movies, it worth insanely well and fast!

[@雪鷹魚英語培訓的領航]

This video was probably a lot of work to edit. Great job!

[@areyoureadyforamiracle2366]

i just want to said that its beautiful tutorial

[@DelilahDee]

Thank you so much for this tutorial, it will certainly come in handy!

[@Danklovic]

just discovered ebsynth, im shocked how fast and detailed it performs on a low end pc, fucking black magic

[@albertyu1358]

Love your videos man, amazing content full of new things to be learned. I know there's a lot of tutorials on color grading in AE but would love to see your technique and approach! :)

[@Diceboi]

this is huge

[@wolfman450r]

this is a tutorial i never knew I needed

[@biksw]

Welcome back!

[@Realletsplaygrey]

This is actually awesome.

[@rohithkumarsp]

this is like a VFX artist's dream

[@jackq9760]

Great Video, very handy tool. I have a feeling that they used ebsynth to get rid of Henry Cavill's mustache in Justice League lol

[@xxepicxx6830]

this is insane i would love to see more (subbed and liked)

[@dearage]

finally - videoshop! :)

[@romanmarvel]

Thank you! Its a new way for cleanup

[@wishah1]

Amazing tutorial 😊 subscribed

[@RyanBigNose]

nice video tnx

[@dooglive922]

Aw man, I would so use this program to change the style of the ties for their uniforms to match how they looked in the first two Harry Potter films

[@Mehranahmadactor]

this is amazing

[@pva5142]

This is dope man, make more videos please.

[@studioharrison]

SUPER PRO You deserve more subs!

[@aaliyan2]

in love with you whole chanel

[@RyanMatlock]

Nice trick with the Luma matte. Personally I would have opted for the Roto Brush, especially with the new 2.0 out now. But it's a toss up how well that would work in the low-lit shot.

[@mM-py1gh]

amazing video, as always ;)

[@cauemorellato1744]

dang. this is going to blow up soon

[@RahhmiPoofs]

I learned something from this. thank you.

[@SmrtPhonRtistCF]

I just knew about this and I love it.

[@MeowsyDancer]

this was great! subbed

[@RazsterTW]

This and Joel's video ( kzbin.info/www/bejne/qqLCfIKjjd6JetE ). Oh my are there going to be floods of these edits. Thank you for the tutorial and for sharing your knowledge. 💎🙌

[@thesabdog]

This video is great and the results you achieved are awesome! I'm a little confused as to why you only used the edited parts of the shirts in ebsynth. Why not just use the full image? Great job!

[@AcademyOfEdits]

Thanks! The reason we ideally want to isolate the ebsynth output is because if we feed in the whole edited frame and have ebsynth output whole frames for us, then we won't JUST be mapping the edited shirt onto the shirt from our footage, we'll be mapping EVERYTHING from the frame we chose/edited onto the video. So for example we'd be mapping a photo of harry's face back onto his actual face for no reason when all we want is the edited shirt

[@thesabdog]

@@AcademyOfEdits ohhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh that makes so much sense now!!!!! thank you very much for clarifying this :)

[@rebelgonebad]

Superb tutorial, so much appreciated!

[@VanlifeSurvivalist]

To everyone that knows what the hell he is talking about 👏👏

[@rohanimations]

This is great. I recently made a video about EbSynth as well, but I haven’t tried using multiple keyframes yet. I’ll have to give that a try. Your workflow seems very refined! One question though- is there a reason why you chose to use a Luma matte instead of the new Rotobrush in AE? I was assuming just to show what EbSynth can do but I wasn’t sure if there was another reason. Anyways, great job and I can’t wait to watch more of your videos!

[@felipe090287]

I was looking for authors who need absinthe, but this video was interesting.

[@AcademyOfEdits]

That just so happens to be the title of my next video, followed by lambs who need.. labyrinth

[@OllyV]

Awesome tutorial, thanks for sharing! Just one question - in your video, it looks like you're feeding EB synth keyframes of the just the modified shirt on an alpha channel, and that the output you load back into AFX is also just the shirt on an alpha. Is that correct?

[@vancityr6485]

What about comparison to vector mapping like smart vectors in Nuke or Mocha Pro Mesh ?

[@anonymousalias4427]

I thought he meant Absinthe. All editors should drink it, clearly.

[@bankontheriver]

Dope

[@Rachelcenter1]

3:56 when you dragged the PNG sequence into AE that synth made for you, the preview window makes it look like its only the shirt. Does that mean the image you put in the keyframe folder was just the shirt with an alpha channel background as opposed to the entire frame with harry potter in it?

[@wakegary]

I reckon you got a big ol' noggin your shoulders. Thanks for sharing your secrets with us regulars!

[@teemuntubetus]

Talent!

[@michaelvaughan2888]

your voice is so nice!

[@LucasAlvesMusic]

why did you choose to only export the changed parts of the frames? and not the whole thing?

[@Potash_label]

Good job.

[@samwallaceart288]

Isn’t this the same program that Joel Haver uses to rotoscope?

[@Enough736]

I've done things like the tie replacement in After Effects and Fusion without much issue. I'm wondering what the advantage is in using EBSynth instead of natively tracking and match-moving the covering graphic. I'm guessing that there is an obvious reason that I'm missing!

[@Enough736]

For the record, your tutorial is clear-spoken, well-articulated, and overall well done. Thank you for this!

[@StarWarsStory]

Do you have any artists for hire, I'm struggling to use EbSynth and would happily pay

[@MrSkyTown]

Thanks for this, what graphics card do you have

[@dundeedolphin]

What about using content aware full in AE?

[@ed-xs3pu]

So lower diversity is ideal. Got it.

[@jacquesalomo5024]

Thank you! ;)

[@beatboxbuynsanjaa]

In case of de aging should use Face App to create keyframe

[@dimitreze]

I was hoping to only need to use adobe premiere

[@toddbod94]

Hey look, it's clean shirt! How do you get the shirt so clean, mate?

[@dolphinenergy3411]

cool vid, for the slughorn edit would it have been easier to just copy his whole face to a new layer to edit than use that as the keyframe?

[@davidedwardsme]

Curious if anyone here uses Mocha Pro (with the power mesh) ebsynth seems to be very similar, a planer tracker. Am I right? or is Ebsynth doing something very different? Seems very cool though.

[@zarodgaming1844]

only thing is the memory usage and disk write and read. Isn't the hard drive going to be unusable in just a few movies?

[@AcademyOfEdits]

No your hard drive is a lot more resilient than that, reading and writing image sequences isn’t that taxing, it’s a regular work flow for many vfx tasks so no need to worry :) I’ve been using the same hard drives for work (I’m an editor.. big surprise lol) for the past 3 years and barely have noticeable slow down!

[@SHTALKS]

Why are you not uploading more tutorials now a days

[@Future_Guy]

MAGIC! I love AI. I love programming. This ... is bloody awesome!

[@luciano.gonzalez]

Hi there, I just found your channel, great content, very useful! I have question, in 5:33 when the "yuck" appears, how do you do that? everytime I tried to do something like that I had to use a caligraphic font and then with strokes, trims and alpha channels make it appeared as "written", I can see by looking frame by frame that you use a different technique to achieve this because the lines in the K of YUCK appear on top of each other as individual lines, I am curious about it, hope you can share. Thanks! Edit: had to correct some spelling, not native english speaker here :)

[@Noamiko2004]

1:44 How did you get your file explorer to look like that?

[@RefalaStas]

Wow. We can finally color correct Half-Blood Prince???

[@RodrigoTomassoVfx]

So do you recommend to low the "Diversity" value and rise the "Mapping" value?

[@jjohncorbett]

Isn't this just the same as the smartVector node in Nuke that's been around for years now?

[@AcademyOfEdits]

I can't speak on this with 100% confidence because I'm not very familiar with Nuke, but my understanding is that SmartVector tries to extract motion data from a sequence, then allows you to composite elements with that motion data applied to stick the element to the subject, which ebsynth also does. The main difference I can see is that ebsynth also uses something called patch-based synthesis which essentially clone stamps groups of pixels from the keyframe you give to it in order to try and propagate the composited frame across the sequence instead of just warping the frame which is what I believe Nuke does. That being said, Ebsynth is mainly for stylization of footage like painting a keyframe of a scene to make the whole scene into a painted video, I'm just showing another way you could use it to get some pretty interesting results for vfx purposes as well. In terms of a professional pipeline, nuke offers total control and would still be the way to go for sure!

[@methadonmanfred2787]

really intersting video I have only little experince with editing, how much time would you probably need to pull off those effects on the same quality level without being able to use ai tools?

[@artvideopro7689]

Can do it in mocha easely, without 2 step image sequence export-import

[@marydrawz3565]

Insane! ...I was wondering if this program works this nicely with anime?

[@kaneda7368]

if it works with complex and real humans, it most definitely will work with abstract versions of humans with less detail.

[@Alfie_Johnson]

After I hit synth it creates the folder but doesn't create any png images?

[@adult93]

Subbed to avoid bad luck