Рет қаралды 29,769
Computer Specs: RTX 30708GB Laptop GPU, 16GB RAM, nothing else matters.
Contents include:
Sample results
Generation using LCM LoRA + Tile+Temporal+Soft edge controlnet
Generation without controlnet using LCM LoRA
Generation with using LCM LoRA + IP Adapter and other control nets
Notes about Davinci resolve
- In this video, we will be using LCM LoRA in Automatic1111 in order to generate Videos 3 to 5 times Faster using Video to Video method in img2img.
- Img2img video generation is simple, doesn’t require extra extensions to use, and gives us the ultimate control over the generation as I have explained in a previous video. • AI Video 2 Video Anima...
- We will see LCM without Contorlnet, and some nice Control net combinations that may produce some interesting results.
- While LCM Sampler is not yet implemented in Automatic 1111, LCM LoRA still produces good results using Eular a sampler for example as we will see in this video.
🎯 Key Takeaways for quick navigation:
00:00:01 samples videos and intro
The video discusses using LCM in Automatic 1111 to generate videos 3 to 5 times faster, focusing on image-to-image video generation, which is simple and doesn't require extra extensions.
00:01:08 Getting frames using Davinci Resolve
Demonstrates using Davinci Resolve to generate video frames and prepare them for image-to-image generation.
00:02:40 LCM LoRA usage
It shows how to use LCM LoRA for image-to-image generation and adjust parameters like sampling steps, CFG scale, and control nets.
00:04:18 Controlnets (Tile, Temporal,Softedge)
Setting up Tile+ temporal net and soft edge or open pose for enhanced image control
00:06:51 Batch image processing
Cover generating frames, checking their quality, and using Topaz Photo Studio for image adjustments.
00:09:43 Davinci resolve compsition tips
Adjusting video speed, retime, and scaling settings in Davinci Resolve to enhance the final video quality is discussed, show optical flow for frame interpolation
00:14:19 IP Adapter usage
The video mentions using IP Adapter for more style transfer and control in image-to-image generation.
00:17:15 Conclusion on LCM LoRA
LCM LoRA is recommended for faster video and image generation, but it's noted that it may not work well with Anim Diff and requires more experimentation in A1111, and conclusion.
see first video in • AI Video 2 Video Anima...
see LCM LoRA explanation in • Super Fast Image Gener...
see controlnet guide in • Complete Controlnet Gu...
A1111 and stable diffusion beginners guide • Beginners Guide for St...
download LCM LoRAs
SD 1.5 LoRA model
huggingface.co...
SDXL LoRA model
huggingface.co...
download Temporal net Controlnet models
huggingface.co...
download IP Adapter
huggingface.co...
www.blackmagic...
Now unfortunately, LCM didn’t work well with animatediff on Automatic 1111 in my tests, possibly it requires LCM Sampler and some updates, so I recommend sticking with ComfyUI for Animatediff, it also requires better GPU to be used with Controlnets which is important if you plan on controlling your video output.
So LCM LoRAs allows us to generate videos and images faster in stable diffusion, which is an worth trying and using
all videos used in this work are free from freepik and pexels.com, you can download them from
www.pexels.com/
and
www.freepik.com/
thanks to all authors who have created these amazing videos and for their hard work.
www.freepik.co...
www.freepik.co...
www.freepik.co...