Stable Diffusion IMG2IMG animation settings Pt. 1. I bought a new GPU for THIS!!

[@Aitrepreneur]

Great video man! Nicely presented and the final result (especially the one you showed in your shorts video) looks fantastic! Well done! ;)

[@enigmatic_e]

The legend himself. Thank you for sharing your knowledge with everyone and thank you for checking out my vid!

[@octimus2000]

I'm on the edge of my seat waiting for your next video. Really good job! I had never subscribed to anyone after just only one video

[@enigmatic_e]

🙏🏽🙏🏽🙏🏽🙏🏽

[@AdrianMagni]

Something I've found helps with the inconsistency is to render only a quarter of the frames then run it through DAIN to smooth the motion. It also smooths out the transitions when elements pop in and out.

[@qq373163143]

you mean 6 frames/s,if the video is 24F/s？

[@ARTificialDreams]

Great video! Great content!

[@jams2blues]

Go Goosebumps brother! 🤣🤣 Thanks for the amazing tutorial amigo

[@magejoshplays]

Thanks for all your work helping us figure these tools out, and i will love you forever for that Goosebumps reference!

[@robojobot77]

Dope video. Looking forward to more.

[@Copperpot5]

Appreciate the tutorital - very cool results - nice you credited back also. Continued success!

[@amitdas1967]

Goosebump was my life..thank you

[@kaizey]

As someone who is studying graphic design, I am definitely scared. My school is COMPLETELY sleeping on this AI stuff, they're saying "there's always going to be a demand for real, human made stuff". But it's pretty obvious I've gotta think about what areas of visual communication have any longevity any more. Animation is changing, graphic design, logo design are all changing, even pro level photography and videography are becoming more and more accessible to "normal people" through AI work + phone cameras that can do the job a lot of the time.

[@NameIsDoc]

As a professor of the subject.. Art is always changing its the one profession that never sits still. Stagnation is death. Keep a thumb on the pulse of the world. That said... People claimed photoshop would end photography, 3d animation would kill 2d animation and so much more. What's likely going to happen is physical arts will become more valuable as well as 3d aspects. Likely some jobs will be lost but artists will be able to integrate this into their work flow to speed up render passes. Ai is great at getting weird concept or causing varirients to a nearly done piece. In 20 years I bet it'll be another tool in our belt to hammer out thumbnails or provide some render pass on their work.

[@timmydotlife]

See the ai as your pencil and the prompt as your canvas and you have creativity as your best partner

[@synthdream]

As someone from that world, the ship in graphic design job security sailed a long time ago. Photoshop did make people loose jobs, so will AI. This industry requires you to continuously learn the past, and the future, then they'll still pay you like trash. People will tell you physical arts and human made things will be what people want in the future, but just so you know, everyone including themselves knows, they're full of it. Companies and people will continuously invest in finding ways to screw you over, even if it cost more than paying you a fair wage. Help from the government to aid your security won't arrive, and you'll keep having to be continuously paranoid that something new will come out of nowhere, and you won't be needed anymore. This is the truth, if it scares you, just know everyone is also very scared. This is the reality of the world, all you can do is just keep learning and hope tomorrow won't be the day your employers need to have "a talk".

[@brexitgreens]

@@synthdream In addition to everything you have said, there've already been too many very talented artists in the world for actual demand - even before AI. Even very, very long before AI. Anyone still remember Van Gogh? 😂 P.S. I've got a crush for your user image.

[@OfficialGOD]

You still need to learn theory and last year ai..

[@plachenko]

11:15 this isn't a competition... this is a tool that enables a different form of creativity and encourages exploration of iterative ideas. Seeing it as competition forces everyone to lose. Great work on the result! Was impressed when I saw it a few days ago

[@ethan-fel]

I've been studying img2img/inpait animation for a while now.With Krita and auto-sd-plugin, increasing the image size (base setting) really help with consistency

[@f.scribbles9546]

Do you know or have any tutorials for doing this with Krita? I barely found out I could do animation with it let alone AI stuff that program is an absolute beast

[@JoeMultimedia]

Amazing! I love this special effect. Thanks a lot.

[@billionaeris1183]

This is insane, give it 5 years or less and i can see this being consistent and the animation industry changing for better or worse.

[@jagz888]

It wont be able to produce anticipation squash and stretch exaggeration (core animation principals) unless the reference material contains this which is not possible since we cant break real humans in footage, also hyper dynamic camera angles like attack on titan would require absurd camera cranes hundreds of thousand of dollars of equipment stunt teams to create reference footage for the AI & there is a reason holly wood doesn't do attack on titan camera angles & action POV its just too difficult. the AI is as good as the reference footage supplied. Animators will be fine this is a fancy tweening tool for the production.

[@creativeleodaily]

Its already happening, being an Indian with 2d and 3d animation background, i talk to all my links in INDIA and many are already using and developing the AI further to improve the process

[@luandrakko4631]

really interested to see the next video explaining how you get the final results refined. The frames images are way more consistent in the second video.

[@KentHambrock]

For doing a combo with ebsynth that's similar to this one, I'd recognize filtering out the model and choosing a single background image that suits the style. If you process everything in ebsynth with a transparent background and add the background in your video editor, it should look a lot cleaner, even if the model's basic image keeps changing. You could also try finding a style you like and trying to generate enough images with similar enough features that you can run reverse inference on it to train the model's basic image and help ensure that it generates the same basic model design each time which should also help with flickering and inconsistencies. This is all stuff I've been meaning to try personally, but haven't had time. Really looking forward to seeing what you do with ebsynth and img2img combined

[@800pieds]

So you're saying you haven't tried it yet with a separate background?

[@cwdoby]

This is exactly what I was thinking. Green screen an actor and then try this. I think we can really smooth this out with just a few tricks. It's so damn fascinating where We are now with this technology.

[@jamesdrummond187]

Not sure if you are saying you can AI generate just the model and keep the background the same/untouched by the AI. I would REALLY like to see this if it is possible without a lot of post editing. I mean even if there was something that could provide a mask automatically would be nice for post production but on the fly would be even better. Would be cool to see streamers somehow use this technology. Somehow sync the output of AI and the content they are showing. Exciting times for individual creators.

[@KentHambrock]

@@jamesdrummond187 You would likely need to do the img2img like he does here, then rotoscope out the model. I haven't explored any methods of doing this automatically, but I'm sure some good methods exist to speed up the process. It's possible he could also request the img2img to replace the background with a green screen, though I haven't tested this so I'm not sure if it's possible or how reliable it would be.

[@KentHambrock]

@@800pieds I haven't had the time to try it at all, but I know ebsynth works best when the background is applied in post. It can get warped and distorted as the model moves, otherwise.

[@DJ-Illuminate]

OMG. I knew something was creating the animations. I did download Stable Diffusion but had no idea that I could batch images or what the sliders meant. I also heard people mention Style as being a thing but had no idea how I add new styles. I wish Stable Diffusion had documentation on mouseover or links to FAQs from the software. Thank you!!!

[@enigmatic_e]

👍🏽

[@digital_magic]

A very awesome video :-) Thanx Mate

[@izac9382]

FYI you can have your animation match your original by making sure they are the same frame rate. When you inport your jpg/png sequence right click > Interpret footage > Main > Change the frame rate to match your original > Ok

[@enigmatic_e]

Oh yea thats right! Ive done that in premiere before. Thank you for the info!

[@synthoelectro]

it's like the old 80's music videos that did animation, such as Take on Me by Ah Ha.

[@duythinhnguyen6705]

Worked smoothly, tysm

[@enigmatic_e]

Awesome! I see some people had issues, glad to hear its working for others.

[@PeterParnes]

Very good introduction. Thank you!

[@creativeleodaily]

Thanks for your other videos, I am running AMD 2700x + GTX 1660 Super and Half HD Image Size gets easily rendered in 2 mins, I did a test of a footage which was 15 seconds long at 60fps and divided the frames to 30fps and conversion took almost + -13 hours and quality came out awesome....

[@creativeleodaily]

My recent Shorts Video is my first Control net test, it was very basic, I didnt even knew about the feature to restore faces, but yet, my face almost came out perfectly with very less flickering. Now I hope to convert some more shots, So i am very excited for whole Nmax Moto vlog...😅

[@spearcy]

Nice! I also installed that yesterday using Aitrepreneur's video links and then tried it out a bit. It seemed to work well, but I need open it later today to make sure it's using my GPU (RTX 3090) rather than my CPU. Maybe that's in the settings, but I just forgot to look for that. The scene I used was one of my daughter on a trail run. It kept spitting out images of her running away from the camera rather than towards the camera as in the original. So I moved the sliders all over the place to try and get that right, but then it would show two people on the trail. I can see it's gonna take some time to get it to do what I want... 😆

[@enigmatic_e]

I feel you man. It takes a while to get something to look right and not one setting works for all circumstances.

[@westingtyler1]

check out Royal Skies video Understanding Prompt Formats in 3 minutes. super helpful. I do 150 sample steps, use the Euler (not Euler a) sampler, get a good image first to use as a "base" for the rest of the attempts, and I put the artist names at the end. sometimes I open an image in an image editor and reframe, add or remove details. very roughly, with colors and shapes. then I use that in img2img to generate new things.

[@AscendantStoic]

Awesome work, truly inspiring ;)

[@shogaartx8643]

THANK YOU SO MUCH FOR THIS VIDEO

[@mcgibs]

The flickering in the animation is still good for replicating the flip book effect like in the music video for Take On Me, for example.

[@maricii33]

Thank you so much this was so helpful 🙏

[@enigmatic_e]

Wow thank you for the super thanks!!! It mean a lot to your support!!

[@Amelia_PC]

0:01 Terrible anatomy. As an artist, it takes me some time to fix AI-generated image anatomy issues, but it saves some time because of the colors. HOWEVER, img2img generates super cool environments based on my colored sketches, and it follows the perspective (if it's below 0.5 influence strength. I love it :) (congrats on your new GPU! RTX 3080 is great!)

[@oli333]

hey mate, don't know if this has already been said, but at about 10:28, the reason the video is a different length is because your imported sequence is interpreted at 30fps and you've put it on a 24fps timeline. You can just specify that by right-clicking on the sequence you've imported and going to 'interpret footage' and changing it. Great video. amazing results.

[@enigmatic_e]

Thank you! Yea someone mentioned this and now I always do this.

[@godned74]

excellent video. I did not realize that people were using this to create videos by using the img to img. I have been using stable diffusion for some time now to create the skins for my cgi characters to great effect. Now with this img to img video idea I think Il be exploring this to make the backgrounds for my cgi characters. you mentioned no one has created a smooth render so far by doing the img to img for the frames? perhaps you should try doing one at 60 frames per second but keep in mind that you need to use an animation that was rendered at 60 fps or record a video at 60 fps. this may give you a much better fluidity. there is another part of the prompt that you can play with that can give you more exacting images. down below there is a script section in the img to img . play with the x/y script and add more steps and lower the resolution but no lower then 512x512 for speed and exactness then you can upscale later with the ersgan+4anima6b for super smooth img's cheers.

[@slickrick37]

Grreat stuff. Thanks!

[@gemini9775]

interesting thanks 😀

[@top115]

Temporal consistency is missing, but we have the image which was generated before, can't be too hard to diffuse in something very similar looking SOON (tm)

[@ivideogameboss]

I posted this comment on ur other video. Your 13:12 animation just got shown live on stage at the Stable Diffusion presentation today. Look up "Stability Diffusion announcements" from Robert Scoble. It appears at 50:27. Congrats!

[@IGORTSARENKO]

Your videos are amazing. Pls do more test of img2img animation. Looks fantastic

[@lioncrud9096]

I LOVED GOOSEBUMPS AS A KID!!

[@iamYork_]

Wow... You bought a brand new GPU just to run locally... Now I know your serious about AI... haha... great video... keep it up my friend...

[@enigmatic_e]

Yea that and my old GPU was already giving me trouble but lets pretend it was cause of my passion for AI! 😂

[@iamYork_]

@@enigmatic_e it is for the AI!!! KZbin monetization coming soon to an enigmatic_e near you!!!

[@clenzen9930]

I liked your video, keep it up.

[@ANGEL-fg4hv]

He said....." Works fine eith a 3080' . Such humble words

[@enigmatic_e]

😂 I was fairly new to all this when I made this video. I had no idea about gpu’s.

[@jamesdrummond187]

People will still need graphic designers to actually use the AI software for those that are worried. Just as we moved from pen and paper to drawing on computer to be faster, to me it is the same with using AI. As someone that cannot draw that well but loves art, I love that I can create art with AI. However graphic designers still have way more knowledge on what make things look "better", being able to modify that art manually and creating a consistent style across a product line. Also until the AI can make videos that can compete with higher quality content, graphic designer will be needed but maybe less to design the original content and more to refine the AI results. Art is kinda this way already as we take images into our brains or lookup concepts art to base our art from. The problem is we are slow at generating our art or at least mockups for others to sign off on. I would argue that more graphic designers might be needed in the future as demand for unique content grows and the ease of creating application/websites for companies continues.

[@lockswap]

idk if you've heard but there is a script, img2img HD that has long render times but you can upscale the images and it renders the img 9 to upscale the detail in the changes made. future is here fr

[@CanalDojogames]

Man this is amazing! honestly you can do draws or get videos and make AI do the complement for you like i want to draw the sequence of poses to make an character getting his sword and attacking enemy, but i dont want to draw all the details and colorize,so AI do it for me... Honestly i love this setting because i can get same pose as the photo. now i want to do inverse, get photo from someone's back doing something and AI will creat his ''front'', this will be an challenger for sure,hahahaha. Thank you so much

[@movietrailersvfx1318]

great tut! just found you. I can swear you wanted to say "first of all the two settings you want to FUCK with" 04:57

[@enigmatic_e]

😂

[@סולוקמינר-ס9ס]

hello, what is the version of Stable difussion that you use in that tutorial? thanks

[@enigmatic_e]

It’s an older version. You can check out some of my newer videos for more current versions.

[@aiculture6486]

Sick tutorial thx!

[@igordasunddas3377]

I bet we'll get movies where we will be able to chose the actors, the style and e.g. the rating and outcome as well as possibly on what genre to focus on and it'll be generated. It'll be forever rewatchable and you actually pay for the huge or mediocre amount of ideas.

[@ArielTavori]

Realtime processing is announced and due to be released as early as this week, so... You should NOW be able to swap actors in a movie, LIVE as you watch. ~30 fps... (Sadly probably not with yourself yet, but soon I imagine)

[@ArielTavori]

Or to quote him directly: "Distilled #StableDiffusion2 20x speed up, convergence in 1-4 steps We already reduced time to gen 50 steps from 5.6s to 0.9s working with @nvidia Paper drops shortly, will link, model soon"...

[@PlayerGamesOtaku]

hello, in settings I don't have that screen that appears to you. In fact I could not check if I had Disco Diffusion, Could you help me?

[@enigmatic_e]

you have to install stable diffusion kzbin.info/www/bejne/p57RiXWuaLWWq68

[@ferhf824]

IN TIKTOK IF I SAW A VERY WELL DONE VIDEO I REMOVED THE BACKGROUND AND THE VIBRATIONS DISAPPEAR IN THE IMAGE EVEN IN THE BODY.

[@TruthSeekah]

Are you for hire? lol. I'd love to have a music video done in this style.

[@enigmatic_e]

sorry I am not. 😅

[@outboxfpv4360]

Good one but how to reduce flickering and random animation notice?

[@JamesPound]

welp, everything I want to know is going to be in the 2nd video I guess. I want to know how you got it looking smooth

[@Spindonesia]

Nice tuts sir, pelase do animatediff tuts for webui instead of comfy, im ur #1 fan!

[@RenderBenderProductions]

do you have a video on how to install disco diffusion locally?

[@enigmatic_e]

I dont. I tried it once but hit a roadblock. Couldn’t find any answers since most people moved on to Stable Diffusion.

[@RenderBenderProductions]

@@enigmatic_e that’s sad, I’ve been looking into trying to do that but I can’t find anyways to really do it.

[@maricii33]

Great video thank you! Can you please share some of your opinions on the copyrights and commercial usage for the technology? I’m hoping to create a music video and from what I’ve heard AI tech has issues with copyright violation.

[@dan323609]

Where can I download the midjourney style in ckpt format?

[@enigmatic_e]

AItreprenuer has a link. I have a link to his channel in my description

[@subhankitbasu620]

Corridor Crew just did an animation !

[@enigmatic_e]

Just watched! That was very impressive!

[@Coltography]

Where do you get the midjourney ckpt model?

[@enigmatic_e]

Check description

[@SUNRIDERMR6]

hi, please help. I exactly repeat your actions after you, after generation a black picture comes out. I looked on reddit and followed the instructions to turn off the check, but it still gives a black picture. Picture like yours and promt also

hm? i dont have batch img2img on my stable diffusion

[@EricHKmedia]

I am use google colab not work path, internal stable diffusion can work, do need any setting for this case

[@MatichekYoutube]

Hey, how did you get midjourney ckpt ??? If you can say, link it in desc please :)

[@enigmatic_e]

Its in description now

[@MatichekYoutube]

@@enigmatic_e oh, thank you, that is the set from that other tutorial right? the guy you mentioned

[@sub-jec-tiv]

It will improve, wait a year or two. AI will be taking hella jobs.

[@Wijnfles]

do u know why on mac (on the M1 app silicon) you can't see any seed numbers? nothing pops up? where do i find these numbers?

[@enigmatic_e]

Mmm not sure. Sorry i mainly use windows.

[@ZeroCool22]

Also, would be nice a video for training Hypernetworks, kind of Dreambooth but some ppl saying it's better.

[@tonystark4872]

What version of stable diffusion are you using, can you share the link?

[@samikshanchandrabiswas7243]

ur a fcking legend dude honestly

[@jinyizhang455]

Hello, can I put Midjourney Artstyle files on Google's hard drive? Thank you!

[@LeroyFilon]

Anyone who can guide me where to find the Midjourney checkpoint? In Super SD there's now a new tab called "Checkpoint merger" but i can't find MJ.

[@Coltography]

yeah I'm curious where you get that too!

[@ohmikegold]

where can i download the disco diffusion style ? nice video as always

[@AscendantStoic]

Check the Aitreprenuer video about styles, he shared both the Disco Diffusion and the MidJourney styles models.

[@sadananduwarey]

where can i get the disco diffusion checkpoint model? can u please share it?

[@enigmatic_e]

check description, just added

[@John_Krone]

Davinci Resolve generates frames in between to create smoother animations.

[@James-ip1tc]

Where do I find that program that makes still images move you mentioned. Thank you for your videos.

[@scofield168]

For the image you used in 05:57. The girl shut her eyes. How can we make sure img2img create the same facial expression?

[@enigmatic_e]

There’s a new thing called control net that you could use with SD. It helps keep track of footage way better. Here’s a video about it kzbin.info/www/bejne/Z4SscoB9d9enjdE

[@weareeternal3230]

what SD model are you using?

[@tayballtop]

Have you made a video on stable diffusion and Ebsynth yet?

[@enigmatic_e]

No not yet. I want to do that for my next video.

[@gxrsky]

Like for the Goosebumps!

[@TOPFACTSjames]

what are the ram and gpu requirements foe stable diffusion to work smoothly ?

[@SouvikKarmakar1]

Hi where did you get other models like the disco and midjorney styles ??

[@enigmatic_e]

kzbin.info/www/bejne/qpi1mo2wrLiXjsk

[@SouvikKarmakar1]

@@enigmatic_e Thanks

[@EricHKmedia]

PC also can not work for Batch

[@ceciliatabbi4218]

Do you have a particular tutorial you could recommend on how to install Stable Diffusion? Thanks!

[@enigmatic_e]

Yes! Here kzbin.info/www/bejne/rJibXoGJl8aKkKs

[@Rivershield]

I'm wondering if Ai could, for example, generate in between frames of an animation. Do you guys know if there's any that can do that?

[@MEATHEADBooYA]

Yeah Nvidia, AMD, Intel all started doing it with their latest graphics cards. :D

[@LegendD112]

lol good tutorial, how do you use midjorney's style? Thank you!

[@enigmatic_e]

Download it from description and put into models-stablediffusion folder.

[@Snafu2346]

when I see the animation I think Take on meeee. Take on me Take meeee on. Take on me I'll beeeee gooone. Dooo Doo da dooo DOOOOOoooo

[@skandalist]

The output it is generating is just a black image⬛ every time I type a prompt. Can anyone help with this please?😭 allocated memory try setting max_split_size_mb to avoid fragmentation.

[@mrssirens]

I think its important to remember that current iterations of ai tech for art/design are fairly unethical apart from a few sources, in order to train them they basically use copyright material to create and test the algorithms used. Its a literal legal minefield for any company that's going to try to monetize the tech or actually sell products generated by it. It's sort of a wild west situation similar to how crypto currency was initially but more so recently regarding nft, just look how those turned out, lists and lists of lawsuits and litigation. The saving grace of ai art and design right now are that copyright laws havent yet been amended to target the creators of said ai tech as they specifically only impact flesh and blood creators, but it is only a matter of time till that happens. To be clear, i'm not saying don't learn the tech, or use the services, but be very mindful of where it came from and what you put out. It would be supremely foolish to assume that things will stay as they are and anyone is immune to legal action.

[@MEATHEADBooYA]

Sorry to say but nothing will happen, unless its 1:1 then there is no proof that you used their image as a reference because you liked their design.

[@spider853]

what repository are you using? Automatic?

[@enigmatic_e]

Yes

[@okachobe1]

When i drag my height and weight around it doesnt highlight anything on the image to get the correct resolution, is there an option to toggle that on and off?

[@enigmatic_e]

Interesting. Not sure why it’s not doing it. Might have to check settings or update?

[@okachobe1]

@@enigmatic_e yeah I'll have to look around I guess, i just recently got the program setup too. I'll take a look thanks for the fast reply!

[@EduardoAlves-gd4oo]

This run with GTX 1660 super ? or i need upgrade my gpu ?

[@imshypleasebenicetome.5344]

My 1080ti runs the locally installed stable diffusion no problem. I didn't even know about the whole compatibility issues lmayo

[@RagingGamingBear]

Can you make a vid on how to make PC wallpapers? :D

[@ramilgr7467]

where did you get such an interface from? thank you!

[@enigmatic_e]

I have a tutorial in how to install

[@craftywafty7869]

i thought it can generate animated frames on its own, so you still need to have a series of animated frames for it to copy?

[@enigmatic_e]

Yea you need sequence of images.

[@kiran_selfie]

Software name

[@zvit]

What dark mode extension or theme do you use to get those blue colors?

[@enigmatic_e]

its appearance settings in my edge browser

[@royaltechtk]

how can i get to this site? I use mac os and I can't find it at all.

[@enigmatic_e]

I’ve never installed on Mac but here’s a website showing how to install github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Installation-on-Apple-Silicon

[@SkywalkerBRA]

Hi, FANTASTIC WORK! You mentioned in the end some settings you liked, can you describe them please, I know that i can have different results, but I want to try them out! THANKS and keep the excellent work! :)

[@enigmatic_e]

Yea of course. I made a part to this. kzbin.info/www/bejne/rqWpd356nN59baM

[@evilra6552]

Can I applied this in the collabs version?

[@s.o.s.l.o.w]

I can make this on the google collab of SD ?

[@enigmatic_e]

You can. It works a bit different though kzbin.info/www/bejne/gqPJY4V9Yt95pKM here a tut i did

[@scienceandmatter8739]

Any gpu? What about win11/rx 6800 ??