Stable Diffusion IMG2IMG animation settings Pt. 1. I bought a new GPU for THIS!!

Got some great AI topics I will be diving into for the next couple of videos!
HOW TO SUPPORT MY CHANNEL
-Support me by joining my Patreon: / enigmatic_e
_________________________________________________________________________
SOCIAL MEDIA
-Join my discord: / discord
-Instagram: / enigmatic_e
-Tik Tok: / enigmatic_e
-Twitter: / 8bit_e
_________________________________________________________________________
NerdyRodent:
/ nerdyrodent
Aitrepreneur:
/ aitrepreneur
Midjourney Artstyle
mega.nz/folder/Z0xS1BpI#S40xU...
Disco Diffusion Checkpoint:
huggingface.co/sd-dreambooth-...
Timecodes:
00:00 Intro
00:40 Purchased GPU
01:36 Local SD recommendations
02:35 Setting up images
03:30 Working SD UI
09:00 Generating Images
09:53 Importing AE

[@Aitrepreneur]

Great video man! Nicely presented and the final result (especially the one you showed in your shorts video) looks fantastic! Well done! ;)

[@enigmatic_e]

The legend himself. Thank you for sharing your knowledge with everyone and thank you for checking out my vid!

[@magejoshplays]

Thanks for all your work helping us figure these tools out, and i will love you forever for that Goosebumps reference!

[@octimus2000]

I'm on the edge of my seat waiting for your next video. Really good job! I had never subscribed to anyone after just only one video

[@enigmatic_e]

🙏🏽🙏🏽🙏🏽🙏🏽

[@luandrakko4631]

really interested to see the next video explaining how you get the final results refined. The frames images are way more consistent in the second video.

[@AdrianMagni]

Something I've found helps with the inconsistency is to render only a quarter of the frames then run it through DAIN to smooth the motion. It also smooths out the transitions when elements pop in and out.

[@qq373163143]

you mean 6 frames/s,if the video is 24F/s？

[@JoeMultimedia]

Amazing! I love this special effect. Thanks a lot.

[@kaizey]

As someone who is studying graphic design, I am definitely scared. My school is COMPLETELY sleeping on this AI stuff, they're saying "there's always going to be a demand for real, human made stuff". But it's pretty obvious I've gotta think about what areas of visual communication have any longevity any more. Animation is changing, graphic design, logo design are all changing, even pro level photography and videography are becoming more and more accessible to "normal people" through AI work + phone cameras that can do the job a lot of the time.

[@NameIsDoc]

As a professor of the subject.. Art is always changing its the one profession that never sits still. Stagnation is death. Keep a thumb on the pulse of the world. That said... People claimed photoshop would end photography, 3d animation would kill 2d animation and so much more. What's likely going to happen is physical arts will become more valuable as well as 3d aspects. Likely some jobs will be lost but artists will be able to integrate this into their work flow to speed up render passes. Ai is great at getting weird concept or causing varirients to a nearly done piece. In 20 years I bet it'll be another tool in our belt to hammer out thumbnails or provide some render pass on their work.

[@timmydotlife]

See the ai as your pencil and the prompt as your canvas and you have creativity as your best partner

[@synthdream]

As someone from that world, the ship in graphic design job security sailed a long time ago. Photoshop did make people loose jobs, so will AI. This industry requires you to continuously learn the past, and the future, then they'll still pay you like trash. People will tell you physical arts and human made things will be what people want in the future, but just so you know, everyone including themselves knows, they're full of it. Companies and people will continuously invest in finding ways to screw you over, even if it cost more than paying you a fair wage. Help from the government to aid your security won't arrive, and you'll keep having to be continuously paranoid that something new will come out of nowhere, and you won't be needed anymore. This is the truth, if it scares you, just know everyone is also very scared. This is the reality of the world, all you can do is just keep learning and hope tomorrow won't be the day your employers need to have "a talk".

[@brexitgreens]

@@synthdream In addition to everything you have said, there've already been too many very talented artists in the world for actual demand - even before AI. Even very, very long before AI. Anyone still remember Van Gogh? 😂 P.S. I've got a crush for your user image.

[@OfficialGOD]

You still need to learn theory and last year ai..

[@Copperpot5]

Appreciate the tutorital - very cool results - nice you credited back also. Continued success!

[@ethan-fel]

I've been studying img2img/inpait animation for a while now.With Krita and auto-sd-plugin, increasing the image size (base setting) really help with consistency

[@f.scribbles9546]

Do you know or have any tutorials for doing this with Krita? I barely found out I could do animation with it let alone AI stuff that program is an absolute beast

[@AscendantStoic]

Awesome work, truly inspiring ;)

[@robojobot77]

Dope video. Looking forward to more.

[@amitdas1967]

Goosebump was my life..thank you

[@ARTificialDreams]

Great video! Great content!

[@digital_magic]

A very awesome video :-) Thanx Mate

[@mageenderman]

"I feel for those that animate cause this will be difficult to compete with" Animators have an advantage, don't act like they can't use these tools too When digital artists use AI I've seen insane results I imagine the same would be true for Animators Sure we can do impressive things with Stable Diffusion without having an animation or art background but goddamn the stuff people with those skills can do + the ai toolset is wild.

[@theunderdowners]

Animators already have an advantage most of the terms used in SD and the tech to run it on are staples of animators, doubt they're crying too much, they've got some serious new toys coming too, this is just like the first bucket of sand, of a crystal palace. kzbin.info/www/bejne/e3ytiXxnrbxnndk

[@marcthenarc868]

I agree. When MIDI and sampling came out, people thought that musicians were dead and anyone could write a score. The younger (30 years ago) generations of musicians lapped it up and today, you can still distinguish those with talent from those who dabble in it thinking it's all too easy. History is repeating itself in so many ways from that particular adventure.

[@theunderdowners]

​@@marcthenarc868 What is happening now with A.I. art is beyond anything I thought possible in my life time, when I was a young one, has reignited an old passion. Basically wonder what this button does? WOW!

[@synthoelectro]

it's like the old 80's music videos that did animation, such as Take on Me by Ah Ha.

[@PeterParnes]

Very good introduction. Thank you!

[@KentHambrock]

For doing a combo with ebsynth that's similar to this one, I'd recognize filtering out the model and choosing a single background image that suits the style. If you process everything in ebsynth with a transparent background and add the background in your video editor, it should look a lot cleaner, even if the model's basic image keeps changing. You could also try finding a style you like and trying to generate enough images with similar enough features that you can run reverse inference on it to train the model's basic image and help ensure that it generates the same basic model design each time which should also help with flickering and inconsistencies. This is all stuff I've been meaning to try personally, but haven't had time. Really looking forward to seeing what you do with ebsynth and img2img combined

[@800pieds]

So you're saying you haven't tried it yet with a separate background?

[@cwdoby]

This is exactly what I was thinking. Green screen an actor and then try this. I think we can really smooth this out with just a few tricks. It's so damn fascinating where We are now with this technology.

[@jamesdrummond187]

Not sure if you are saying you can AI generate just the model and keep the background the same/untouched by the AI. I would REALLY like to see this if it is possible without a lot of post editing. I mean even if there was something that could provide a mask automatically would be nice for post production but on the fly would be even better. Would be cool to see streamers somehow use this technology. Somehow sync the output of AI and the content they are showing. Exciting times for individual creators.

[@KentHambrock]

@@jamesdrummond187 You would likely need to do the img2img like he does here, then rotoscope out the model. I haven't explored any methods of doing this automatically, but I'm sure some good methods exist to speed up the process. It's possible he could also request the img2img to replace the background with a green screen, though I haven't tested this so I'm not sure if it's possible or how reliable it would be.

[@KentHambrock]

@@800pieds I haven't had the time to try it at all, but I know ebsynth works best when the background is applied in post. It can get warped and distorted as the model moves, otherwise.

[@DJ-Illuminate]

OMG. I knew something was creating the animations. I did download Stable Diffusion but had no idea that I could batch images or what the sliders meant. I also heard people mention Style as being a thing but had no idea how I add new styles. I wish Stable Diffusion had documentation on mouseover or links to FAQs from the software. Thank you!!!

[@enigmatic_e]

👍🏽

[@jams2blues]

Go Goosebumps brother! 🤣🤣 Thanks for the amazing tutorial amigo

[@IGORTSARENKO]

Your videos are amazing. Pls do more test of img2img animation. Looks fantastic

[@mcgibs]

The flickering in the animation is still good for replicating the flip book effect like in the music video for Take On Me, for example.

[@duythinhnguyen6705]

Worked smoothly, tysm

[@enigmatic_e]

Awesome! I see some people had issues, glad to hear its working for others.

[@shogaartx8643]

THANK YOU SO MUCH FOR THIS VIDEO

[@oli333]

hey mate, don't know if this has already been said, but at about 10:28, the reason the video is a different length is because your imported sequence is interpreted at 30fps and you've put it on a 24fps timeline. You can just specify that by right-clicking on the sequence you've imported and going to 'interpret footage' and changing it. Great video. amazing results.

[@enigmatic_e]

Thank you! Yea someone mentioned this and now I always do this.

[@maricii33]

Thank you so much this was so helpful 🙏

[@enigmatic_e]

Wow thank you for the super thanks!!! It mean a lot to your support!!

[@billionaeris1183]

This is insane, give it 5 years or less and i can see this being consistent and the animation industry changing for better or worse.

[@jagz888]

It wont be able to produce anticipation squash and stretch exaggeration (core animation principals) unless the reference material contains this which is not possible since we cant break real humans in footage, also hyper dynamic camera angles like attack on titan would require absurd camera cranes hundreds of thousand of dollars of equipment stunt teams to create reference footage for the AI & there is a reason holly wood doesn't do attack on titan camera angles & action POV its just too difficult. the AI is as good as the reference footage supplied. Animators will be fine this is a fancy tweening tool for the production.

[@creativeleodaily]

Its already happening, being an Indian with 2d and 3d animation background, i talk to all my links in INDIA and many are already using and developing the AI further to improve the process

[@CanalDojogames]

Man this is amazing! honestly you can do draws or get videos and make AI do the complement for you like i want to draw the sequence of poses to make an character getting his sword and attacking enemy, but i dont want to draw all the details and colorize,so AI do it for me... Honestly i love this setting because i can get same pose as the photo. now i want to do inverse, get photo from someone's back doing something and AI will creat his ''front'', this will be an challenger for sure,hahahaha. Thank you so much

[@spearcy]

Nice! I also installed that yesterday using Aitrepreneur's video links and then tried it out a bit. It seemed to work well, but I need open it later today to make sure it's using my GPU (RTX 3090) rather than my CPU. Maybe that's in the settings, but I just forgot to look for that. The scene I used was one of my daughter on a trail run. It kept spitting out images of her running away from the camera rather than towards the camera as in the original. So I moved the sliders all over the place to try and get that right, but then it would show two people on the trail. I can see it's gonna take some time to get it to do what I want... 😆

[@enigmatic_e]

I feel you man. It takes a while to get something to look right and not one setting works for all circumstances.

[@westingtyler1]

check out Royal Skies video Understanding Prompt Formats in 3 minutes. super helpful. I do 150 sample steps, use the Euler (not Euler a) sampler, get a good image first to use as a "base" for the rest of the attempts, and I put the artist names at the end. sometimes I open an image in an image editor and reframe, add or remove details. very roughly, with colors and shapes. then I use that in img2img to generate new things.

[@top115]

Temporal consistency is missing, but we have the image which was generated before, can't be too hard to diffuse in something very similar looking SOON (tm)

[@izac9382]

FYI you can have your animation match your original by making sure they are the same frame rate. When you inport your jpg/png sequence right click > Interpret footage > Main > Change the frame rate to match your original > Ok

[@enigmatic_e]

Oh yea thats right! Ive done that in premiere before. Thank you for the info!

[@slickrick37]

Grreat stuff. Thanks!

[@lockswap]

idk if you've heard but there is a script, img2img HD that has long render times but you can upscale the images and it renders the img 9 to upscale the detail in the changes made. future is here fr

[@maricii33]

Great video thank you! Can you please share some of your opinions on the copyrights and commercial usage for the technology? I’m hoping to create a music video and from what I’ve heard AI tech has issues with copyright violation.

[@chessmusictheory4644]

excellent video. I did not realize that people were using this to create videos by using the img to img. I have been using stable diffusion for some time now to create the skins for my cgi characters to great effect. Now with this img to img video idea I think Il be exploring this to make the backgrounds for my cgi characters. you mentioned no one has created a smooth render so far by doing the img to img for the frames? perhaps you should try doing one at 60 frames per second but keep in mind that you need to use an animation that was rendered at 60 fps or record a video at 60 fps. this may give you a much better fluidity. there is another part of the prompt that you can play with that can give you more exacting images. down below there is a script section in the img to img . play with the x/y script and add more steps and lower the resolution but no lower then 512x512 for speed and exactness then you can upscale later with the ersgan+4anima6b for super smooth img's cheers.

[@gemini9775]

interesting thanks 😀

[@aiculture6486]

Sick tutorial thx!

[@EricHKmedia]

I am use google colab not work path, internal stable diffusion can work, do need any setting for this case

[@ivideogameboss]

I posted this comment on ur other video. Your 13:12 animation just got shown live on stage at the Stable Diffusion presentation today. Look up "Stability Diffusion announcements" from Robert Scoble. It appears at 50:27. Congrats!

[@outboxfpv4360]

Good one but how to reduce flickering and random animation notice?

[@clenzen9930]

I liked your video, keep it up.

[@James-ip1tc]

Where do I find that program that makes still images move you mentioned. Thank you for your videos.

[@JamesPound]

welp, everything I want to know is going to be in the 2nd video I guess. I want to know how you got it looking smooth

[@dan323609]

Where can I download the midjourney style in ckpt format?

[@enigmatic_e]

AItreprenuer has a link. I have a link to his channel in my description

[@ZeroCool22]

Also, would be nice a video for training Hypernetworks, kind of Dreambooth but some ppl saying it's better.

[@Coltography]

Where do you get the midjourney ckpt model?

[@enigmatic_e]

Check description

[@SUNRIDERMR6]

hi, please help. I exactly repeat your actions after you, after generation a black picture comes out. I looked on reddit and followed the instructions to turn off the check, but it still gives a black picture. Picture like yours and promt also

[@jinyizhang455]

Hello, can I put Midjourney Artstyle files on Google's hard drive? Thank you!

[@tonystark4872]

What version of stable diffusion are you using, can you share the link?

[@plachenko]

11:15 this isn't a competition... this is a tool that enables a different form of creativity and encourages exploration of iterative ideas. Seeing it as competition forces everyone to lose. Great work on the result! Was impressed when I saw it a few days ago

[@TOPFACTSjames]

what are the ram and gpu requirements foe stable diffusion to work smoothly ?

[@lioncrud9096]

I LOVED GOOSEBUMPS AS A KID!!

[@Wijnfles]

do u know why on mac (on the M1 app silicon) you can't see any seed numbers? nothing pops up? where do i find these numbers?

[@enigmatic_e]

Mmm not sure. Sorry i mainly use windows.

[@creativeleodaily]

Thanks for your other videos, I am running AMD 2700x + GTX 1660 Super and Half HD Image Size gets easily rendered in 2 mins, I did a test of a footage which was 15 seconds long at 60fps and divided the frames to 30fps and conversion took almost + -13 hours and quality came out awesome....

[@creativeleodaily]

My recent Shorts Video is my first Control net test, it was very basic, I didnt even knew about the feature to restore faces, but yet, my face almost came out perfectly with very less flickering. Now I hope to convert some more shots, So i am very excited for whole Nmax Moto vlog...😅

[@rauld8355]

just wow!....so anyone can make awesome content now!

[@Amelia_PC]

0:01 Terrible anatomy. As an artist, it takes me some time to fix AI-generated image anatomy issues, but it saves some time because of the colors. HOWEVER, img2img generates super cool environments based on my colored sketches, and it follows the perspective (if it's below 0.5 influence strength. I love it :) (congrats on your new GPU! RTX 3080 is great!)

[@user-kl6pg9ie4z]

hello, what is the version of Stable difussion that you use in that tutorial? thanks

[@enigmatic_e]

It’s an older version. You can check out some of my newer videos for more current versions.

[@evilra6552]

Can I applied this in the collabs version?

[@ceciliatabbi4218]

Do you have a particular tutorial you could recommend on how to install Stable Diffusion? Thanks!

[@enigmatic_e]

Yes! Here kzbin.info/www/bejne/rJibXoGJl8aKkKs

[@PlayerGamesOtaku]

hello, in settings I don't have that screen that appears to you. In fact I could not check if I had Disco Diffusion, Could you help me?

[@enigmatic_e]

you have to install stable diffusion kzbin.info/www/bejne/p57RiXWuaLWWq68

[@EduardoAlves-gd4oo]

This run with GTX 1660 super ? or i need upgrade my gpu ?

[@sadau16dec]

where can i get the disco diffusion checkpoint model? can u please share it?

[@enigmatic_e]

check description, just added

[@weareeternal3230]

what SD model are you using?

[@LeroyFilon]

Anyone who can guide me where to find the Midjourney checkpoint? In Super SD there's now a new tab called "Checkpoint merger" but i can't find MJ.

[@Coltography]

yeah I'm curious where you get that too!

[@skandalist]

The output it is generating is just a black image⬛ every time I type a prompt. Can anyone help with this please?😭 allocated memory try setting max_split_size_mb to avoid fragmentation.

[@Rivershield]

I'm wondering if Ai could, for example, generate in between frames of an animation. Do you guys know if there's any that can do that?

[@MEATHEADBooYA]

Yeah Nvidia, AMD, Intel all started doing it with their latest graphics cards. :D

hm? i dont have batch img2img on my stable diffusion

[@John_Krone]

Davinci Resolve generates frames in between to create smoother animations.

[@scofield168]

For the image you used in 05:57. The girl shut her eyes. How can we make sure img2img create the same facial expression?

[@enigmatic_e]

There’s a new thing called control net that you could use with SD. It helps keep track of footage way better. Here’s a video about it kzbin.info/www/bejne/Z4SscoB9d9enjdE

[@RagingGamingBear]

Can you make a vid on how to make PC wallpapers? :D

[@subhankitbasu620]

Corridor Crew just did an animation !

[@enigmatic_e]

Just watched! That was very impressive!

[@LegendD112]

lol good tutorial, how do you use midjorney's style? Thank you!

[@enigmatic_e]

Download it from description and put into models-stablediffusion folder.

[@zvit]

What dark mode extension or theme do you use to get those blue colors?

[@enigmatic_e]

its appearance settings in my edge browser

[@craftywafty7869]

i thought it can generate animated frames on its own, so you still need to have a series of animated frames for it to copy?

[@enigmatic_e]

Yea you need sequence of images.

[@Spindonesia]

Nice tuts sir, pelase do animatediff tuts for webui instead of comfy, im ur #1 fan!

[@SouvikKarmakar1]

Hi where did you get other models like the disco and midjorney styles ??

[@enigmatic_e]

kzbin.info/www/bejne/qpi1mo2wrLiXjsk

[@SouvikKarmakar1]

@@enigmatic_e Thanks

[@okachobe1]

When i drag my height and weight around it doesnt highlight anything on the image to get the correct resolution, is there an option to toggle that on and off?

[@enigmatic_e]

Interesting. Not sure why it’s not doing it. Might have to check settings or update?

[@okachobe1]

@@enigmatic_e yeah I'll have to look around I guess, i just recently got the program setup too. I'll take a look thanks for the fast reply!

[@bustedd66]

my main issue is i would need a second system so i can work while it runs sd. some animations i did took 5 or 10 hours meaning if it was local i couldnt use the system while it was running i am assuming.

[@enigmatic_e]

Yea I totally get that issue. The great thing about google colab is that it’s not processing anything on your actual computer. Maybe there are alternatives. I’ll definitely look into it because I know this doesn’t work for everybody.

[@bustedd66]

@@enigmatic_e i am saving for a system next year just for AI. all i can say is that sd is awesome i would hate to be stuck with dall-e or mj

[@tayballtop]

Have you made a video on stable diffusion and Ebsynth yet?

[@enigmatic_e]

No not yet. I want to do that for my next video.

[@Complaints-Department]

I'm a bit of a novice when it comes to this stuff, still trying to wrap my head around it though just curious if people think an RTX 3070 card would be sufficient to run these processes on a gaming laptop?

[@fritt_wastaken]

Basically for the quality only video memory matters. You can get away with 4GB for small resolution, but higher resolution tends to give a better detailed result. There's practically no upper limit on how far you can push this

[@silvakaioagv]

how can i get to this site? I use mac os and I can't find it at all.

[@enigmatic_e]

I’ve never installed on Mac but here’s a website showing how to install github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Installation-on-Apple-Silicon

[@EricHKmedia]

PC also can not work for Batch

[@MatichekYoutube]

Hey, how did you get midjourney ckpt ??? If you can say, link it in desc please :)

[@enigmatic_e]

Its in description now

[@MatichekYoutube]

@@enigmatic_e oh, thank you, that is the set from that other tutorial right? the guy you mentioned

[@ohmikegold]

where can i download the disco diffusion style ? nice video as always

[@AscendantStoic]

Check the Aitreprenuer video about styles, he shared both the Disco Diffusion and the MidJourney styles models.

[@ferhf824]

IN TIKTOK IF I SAW A VERY WELL DONE VIDEO I REMOVED THE BACKGROUND AND THE VIBRATIONS DISAPPEAR IN THE IMAGE EVEN IN THE BODY.

[@ramilgr7467]

where did you get such an interface from? thank you!

[@enigmatic_e]

I have a tutorial in how to install

[@RenderBenderProductions]

do you have a video on how to install disco diffusion locally?

[@enigmatic_e]

I dont. I tried it once but hit a roadblock. Couldn’t find any answers since most people moved on to Stable Diffusion.

[@RenderBenderProductions]

@@enigmatic_e that’s sad, I’ve been looking into trying to do that but I can’t find anyways to really do it.

[@iamYork_]

Wow... You bought a brand new GPU just to run locally... Now I know your serious about AI... haha... great video... keep it up my friend...

[@enigmatic_e]

Yea that and my old GPU was already giving me trouble but lets pretend it was cause of my passion for AI! 😂

[@iamYork_]

@@enigmatic_e it is for the AI!!! KZbin monetization coming soon to an enigmatic_e near you!!!

[@samikshanchandrabiswas7243]

ur a fcking legend dude honestly

[@s.o.s.l.o.w]

I can make this on the google collab of SD ?

[@enigmatic_e]

You can. It works a bit different though kzbin.info/www/bejne/gqPJY4V9Yt95pKM here a tut i did

[@imshypleasebenicetome.5344]

My 1080ti runs the locally installed stable diffusion no problem. I didn't even know about the whole compatibility issues lmayo

[@AustNerevar]

Could somebody just link the video that shows the setup for this UI version for SD?

[@enigmatic_e]

kzbin.info/www/bejne/pZO5oXmIicyEbqM

[@movietrailersvfx1318]

great tut! just found you. I can swear you wanted to say "first of all the two settings you want to FUCK with" 04:57

[@enigmatic_e]

😂

[@sub-jec-tiv]

It will improve, wait a year or two. AI will be taking hella jobs.

[@kiran_selfie]

Software name

[@spider853]

what repository are you using? Automatic?

[@enigmatic_e]

Yes

[@ANGEL-fg4hv]

He said....." Works fine eith a 3080' . Such humble words

[@enigmatic_e]

😂 I was fairly new to all this when I made this video. I had no idea about gpu’s.

[@TruthSeekah]

Are you for hire? lol. I'd love to have a music video done in this style.

[@enigmatic_e]

sorry I am not. 😅

[@purposefully.verbose]

try 15fps, doubled, with frame interpolation set to optical flow

[@igordasunddas3377]

I bet we'll get movies where we will be able to chose the actors, the style and e.g. the rating and outcome as well as possibly on what genre to focus on and it'll be generated. It'll be forever rewatchable and you actually pay for the huge or mediocre amount of ideas.

[@ArielTavori]

Realtime processing is announced and due to be released as early as this week, so... You should NOW be able to swap actors in a movie, LIVE as you watch. ~30 fps... (Sadly probably not with yourself yet, but soon I imagine)

[@ArielTavori]

Or to quote him directly: "Distilled #StableDiffusion2 20x speed up, convergence in 1-4 steps We already reduced time to gen 50 steps from 5.6s to 0.9s working with @nvidia Paper drops shortly, will link, model soon"...