AI ASSIST VFX + Breakdown - Stable Diffusion | Ebsynth | Blender

Greeting Traveler.....
Character generate workflow :
- Rotoscope and img2img on character with multicontrolnet
- Select a few consistent frames and processes with ebsynth
- I do multiple Ebsynth process and masking combine only the good part
Background :
- photobashing a good frame and regenrate with stable diffusion
- Put some random geometry and do camera projection with Blender
Composite in Blender and final touch in after effects

[@SoggyMicrowaveNugget]

I love watching people use ai plus their talent to make something more than just an ai Generated picture. These videos show that ai doesn't replace people, just enables them to creates much more than they ever could alone. Much support friend.

[@ivaan_mz10]

estas hablando a corto plazo. pero a largo plazo si van a reemplazar a las personas. en fin xd

[@CFSStudiosAI]

You are always pushing this workflow forward, amazing result.

[@jellymage7469]

wow This is really amazing.

[@pedro_a_martins]

Amazing results!

[@Carlovision]

Very impressive!! Congrats!

[@wholeness]

Droppin back through here agin to say man this is still the best! Keep goin! We haven't heard from you in awhile but know you are inspiring people across the world friend.

[@kaushikqravindran9792]

Next level 💯

[@t-man5323]

Fantastic work man.👍

[@nikz000]

Wow great content I’m amazed

[@more_tezza]

Amazing! Keep it up.

[@erdbeerbus]

great work!

[@Tastemystyl3]

Good Stuff my guy!!

[@trolik9113]

Good god man... genius..

[@kjorns13]

Love it. This is probably the best workflow. Did you train a model specifically on your character? Or just apply a certain checkpoint on the footage and controllnetted the hell out of it? Or no checkpoint at all? Looking forward to future stuff you create!

[@BunnetSong]

Not really specifically train model. i just dreambooth myself with custom checkpoints from civitai and process controlnet IMG2IMG with some ebsynth. Then final touch with some compositing

[@poveasnapanhapich7362]

Omg blowing mind

[@KK-fe8tu]

Lmao that's crazy good job bro

[@eprohoda]

Bunnet. how are you?. like,you created fantastic ~ ✨

[@lilillllii246]

Thank you always! What should I do to change the costumes and hairstyles of the characters in the video?

[@AiArtNoGlow]

nice video

[@SuiSlyder808]

Hey man, this turned out beautifully! Any way for you to do a tutorial that goes into more detail on how you did this, or if there is a place you can point us to that could allow for us to replicate this in our own projects? I got a school project coming up and would love to be able to do something creatively like this! Appreciate it!

[@sebastianhernandez294]

Hello friend, congratulations on your evolution, it is amazing. Could you explain to me how you managed to do that rotoscoping with multicontrolnet? Just a little more detail please.

[@BunnetSong]

Rotoscoping was done with third party software *AE rotobrush. Then i put it out with green background to easy mask out later after doing batch img2img

[@user-vu1wk6xx5h]

bro pls reply are you traing your models( FINE TUNING ) or lora for this stuff nice work keep it up😍🤩🤩🤩🤩

[@ekke7995]

Wow Amazing! I just have two question, how far can you push the CFG Scale and and reduse Controlnet and still get the video coherent (push it to a different style like Pixar 3D characters)? secondly when you understand the workflow, how long dose 10 Seconds take you to get to this level? I made my calculations 2 months ago and got to about 2 weeks for 30 Seconds final production without the audio. Is it correct or am I being optimistic.

[@BunnetSong]

In this video CFG is around 7-8 with denoise strength around 0.5-0.6 + multi controlnet maintain the same pose and not too much away from original input. i don't understand ur 2nd question but the more frame / second u put in the longer it take. i use 3080 which is pretty fine with this but still take half a day to generate all these character frame. also all the process in this video took me a whole week.

[@EhsanDabbaghi]

Amazing work... I couldn't get a good result with EBsynth at all. I just get very distorted image, No matter what I do.

[@promptjungle]

Hey Bunnet, great content. how can we connec?

[@redwong6119]

wow, looking good, but how do you remove the background from SD? (so much fickering)

[@JJ-yw3ug]

This is cool! Liked and followed! I noticed that you used img2img in combination with multiple control nets to generate multiple frames of images. However, the light and shadow on each face and the whole body seem to be constantly changing and differing from the previous one. But after using Ebsynth, the light and shadow on the face become stable instantly. Is this due to Ebsynth's keyframe extraction? But I'm not sure how to choose the keyframe extraction to achieve a stable solution for both light and shadow and flicker problems. I hope the author can give some guidance, thank you very much!

[@JJ-yw3ug]

Then I noticed that the male character initially followed the 'input-img2img-Ebsynth' process, while the female character went through 'input with blender hair-img2img-Ebsynth'. Are these two different methods used to compare the effects, or was the male character done first, then the female character was created with the aid of Blender's hair simulation to achieve the best hair restoration effect? I'm a bit confused here because I'm not very familiar with Blender. Both characters look good after using Ebsynth, so does the Blender hair simulation help with the image animation in some way?

[@BunnetSong]

like i list in description workflow. Both character are done with mutiple ebsynth process. And mask it out only the good part to combine each other. i pick only the frame that have similar light and shadow to avoid as much inconsistant as possible. Oh yeah there are few trick to help sell the illusion like (Deflicker, limit framerate to 12 *to reduce uncanny feeling*)

[@BunnetSong]

@@JJ-yw3ug technically both male and female are using the same method. blender is use only to add wig. u can just go wear the real wig to save ur time from running simulation and composite it.

[@ne3l]

Hey, which stable diffusion model did you use?

[@BrandonChoo]

Hi Bunnet, can I check what do you use to do the rotoscoping and why do you need to rotoscope? Thanks 🙆🏻‍♂️

[@BunnetSong]

Rotoscope is to use as alpha layer later (mask out people from background) after doing batch img2img

[@shimabukufilm]

howd you get the 3d geometry to match the ai image?

[@nightcoreempress5248]

can you test us how to do a random 3d geometry camera projection

[@ExpanseHues]

please upload a tutorial

[@khush_19]

How you do this, teach plz

[@MAKARUTV]

[Urgent question]. The image storage function in Stable Diffusion(pc ver) is normal. It is impossible to work with the image because the image keeps getting deleted in the viewer. As soon as the image is created, the image disappears from the screen. How can I get the final image to remain intact on the screen???

[@BunnetSong]

It not go anywhere. Check the Automatic1111 directory there is a folder called output. All generated images store there

[@MAKARUTV]

@@BunnetSong The images are created normally. But in the screen viewer, the image disappears right after 100% and becomes blank. Sending as "image to image" is not possible.😭😭😭😭😭

[@BunnetSong]

@@MAKARUTV look like u tick something wrong the GUI setting. idk much all those stuff but i believe it is there. And If something wierd keep happen just reinstall it ( it dont take long )

[@MAKARUTV]

@@BunnetSong Thank you for your sincere reply.😁😁😁😁

[@julianbonilla64]

Can u made a tutorial for the camera projection? i dont get it how u did it

[@BunnetSong]

im pretty bad at teaching. but this video might help u understand it kzbin.info/www/bejne/q5KbdKV9m5uqhpo

[@nawaredit8226]

Can you do a full tutorial about this ?

[@BunnetSong]

Sadly no, im just not good at all for tutor thing. But with all these keyword u can go around searching more on it. Alot of other channel are doing tutor already

[@mrcrobart]

when you look closer to it, it's uncanny, the eyes are really strange and the shadows aren't realistic

[@kiraa69420]

Ye try making vfx of such quality at home by urself

[@BunnetSong]

Ai alone is uncanny. It is what is, for now

[@SnoopyDoofie]

Shaky camera aint cool.

[@jdomanic6492]

Hi Bunnet! Do you have a email or instagram where I can shoot you a message?

[@BunnetSong]

sorry i only use FB. u can add me there : t.ly/H3sma