AniPortrait - AI Audio-Driven Synthesis of Portrait Animations - Local Install!

  Рет қаралды 9,730

Nerdy Rodent

Nerdy Rodent

2 ай бұрын

Using python & AI for animation images is always something I find fun, and there's a new kid on the block - AniPortrait! Using the power of Stable Diffusion, this repo can create animated avatars with fairly minimal effort. There have been quite a few research advances over the years, and this brings us a step closer. Want to install some of the latest, cutting edge, AI research at home? Well now you can, as this will run on consumer hardware too 😃 This step-by-step tutorial will guide you through getting it running locally, meaning you too can be on the cutting edge! Crack that anaconda terminal open once again to begin your journey…
Want to support the channel?
/ nerdyrodent
AniPortrait - github.com/Zejun-Yang/AniPort...
AniPortrait paper - arxiv.org/abs/2403.17694
Installing Anaconda for MS Windows Beginners - • Anaconda - Python Inst...
RVC WebUI - • RVC Web UI - FREE, Ope...

Пікірлер: 37
@vi6ddarkking
@vi6ddarkking 2 ай бұрын
Ok, so hear me out. This with SD3 models + Tavern AI text to speech with Llama 3 or Grok derived models. 2024 is shaping out to be a truly fun year.
@jackrabbit1704
@jackrabbit1704 2 ай бұрын
It'd likely take a nasa quantum super computer to run stable diffusion image prompts, a moderate llm, rvc/applio and then this all at the time. But yes, yes please.
@vi6ddarkking
@vi6ddarkking 2 ай бұрын
@@jackrabbit1704 Not really. Anything above a RTX 5070 should be able to handle it comfortably. Considering the Blackwell architecture and the improvements in AI efficiency we're seeing.
@kariannecrysler640
@kariannecrysler640 2 ай бұрын
Here comes Peter cottontail. Hopping down the bunny trail. Hippity hoppity nerdy’s on his way! 🐭🐇
@NerdyRodent
@NerdyRodent 2 ай бұрын
😀
@kariannecrysler640
@kariannecrysler640 2 ай бұрын
@@NerdyRodent 🤘😉💕
@marilynlucas5128
@marilynlucas5128 Ай бұрын
@@NerdyRodent My suggestion is to try experimenting with fourier transforms to eliminate the flickering in stable diffusion videos as the frequency level. Please do you understand me?
@PrincessSleepyTV
@PrincessSleepyTV 2 ай бұрын
This is so cool!
@NerdyRodent
@NerdyRodent 2 ай бұрын
Can’t wait for a few more papers down the line! 😉
@Sol-zp6kc
@Sol-zp6kc 2 ай бұрын
I wonder if we'll ever get something like LucidSonicDreams but with SD, that would be incredible!
@LaurinkoSattumaa
@LaurinkoSattumaa 2 ай бұрын
Yes!
@NerdyRodent
@NerdyRodent 2 ай бұрын
Maybe one day ☹️
@RhapsHayden
@RhapsHayden 13 күн бұрын
Ugh I forgot to create an environment and screwed up Comfyui. Took me all day to fix it😂. I'll try it again tomorrow because I need this
@DeconvertedMan
@DeconvertedMan 2 ай бұрын
+1 points.
@UnchartedWorlds
@UnchartedWorlds 2 ай бұрын
Fix those eyes to look directly into the camera and this is great!
@leavemealoneandgoaway
@leavemealoneandgoaway 2 ай бұрын
there is software for that too
@marilynlucas5128
@marilynlucas5128 Ай бұрын
@@leavemealoneandgoaway What is that software? descript?
@MrRaja
@MrRaja 18 күн бұрын
If you have Nvidia GPU you can use Nvidia Broadcast on your camera and there is a A.I. function to lock your eyes to camera. even when you are reading something on your monitor or looking down to your keyboard to type your videofeed will show you staring at the camera at all times as long as your eyes are decently visible (bang/too dark).
@marilynlucas5128
@marilynlucas5128 17 күн бұрын
@@MrRaja oh? How nice
@pfbeast
@pfbeast 2 ай бұрын
How to use "instruct pix 2 pix" & "SDXS" in comfyui?
@user-rt6nk9sc4y
@user-rt6nk9sc4y 2 ай бұрын
now this tool can make , two hand ,mouse , Natural movements and realistic performances
@smtabatabaie
@smtabatabaie 2 ай бұрын
How's the inference time with audio driven mode? is it near real time?
@NerdyRodent
@NerdyRodent 2 ай бұрын
Not even close 😉
@smtabatabaie
@smtabatabaie 2 ай бұрын
@@NerdyRodent Thanks, Do you know any talking head with near real-time inference? Something like D-ID real-time avatars
@NerdyRodent
@NerdyRodent 2 ай бұрын
Where you can do your own custom stuff easily, locally and for free… not that I can think off 🫤
@user-rt6nk9sc4y
@user-rt6nk9sc4y 2 ай бұрын
How long time we can make out put video 5 nminutes or 10 or 30 minutes if we want
@NerdyRodent
@NerdyRodent 2 ай бұрын
Each video can be as long as you have the hardware for!
@LouisGedo
@LouisGedo 2 ай бұрын
Hi
@wsx256
@wsx256 2 ай бұрын
Strabismus attack
@user-rt6nk9sc4y
@user-rt6nk9sc4y 2 ай бұрын
and any tool can make voice clone and train voice , thanks
@NerdyRodent
@NerdyRodent 2 ай бұрын
Do you mean like the example in this video?
@sinayagubi8805
@sinayagubi8805 2 ай бұрын
we want a speaking rodent in the corner of your videos. ahaha
@NerdyRodent
@NerdyRodent 2 ай бұрын
Ikr!
@el-_-grando-_-_-scabandri
@el-_-grando-_-_-scabandri 2 ай бұрын
creepy
@LilShepherdBoy
@LilShepherdBoy 2 ай бұрын
Now this is actually very cool. Must be great for people that want to do VTuber content but don't want to go through the whole rigmarole of setting one up. - Jesus Christ loves you 💙 He has a plan and a purpose for your life, plans to prosper you and not to harm you, plans to give you hope and a future. Jesus Christ loves you 💙
@fernandodiaz8231
@fernandodiaz8231 Ай бұрын
Thank you for the information. I would like to ask if you know some Colab options or Kaggle notenook for AniPortrait
New IP Adapter Model for Image Composition in Stable Diffusion!
8:38
Omost = Almost AI Image Generation from lllyasviel
9:43
Nerdy Rodent
Рет қаралды 20 М.
ПООСТЕРЕГИСЬ🙊🙊🙊
00:39
Chapitosiki
Рет қаралды 37 МЛН
Do you have a friend like this? 🤣#shorts
00:12
dednahype
Рет қаралды 56 МЛН
ComfyUI Pose To Video Animate Anyone Workflow! 2 of 3
7:04
Grafting Rayman
Рет қаралды 2,2 М.
How To Connect Local LLMs to CrewAI [Ollama, Llama2, Mistral]
25:07
codewithbrandon
Рет қаралды 56 М.
Ultimate NixOS Guide | Flakes | Home-manager
15:30
Vimjoyer
Рет қаралды 105 М.
dnhkng GlaDOS - Your Own, Free & Unhinged AI Companion!
10:43
Nerdy Rodent
Рет қаралды 4,7 М.
Индуктивность и дроссель.
1:00
Hi Dev! – Электроника
Рет қаралды 1,6 МЛН
ПК с Авито за 3000р
0:58
ЖЕЛЕЗНЫЙ КОРОЛЬ
Рет қаралды 1,9 МЛН
Нашел айфоны в мусорке!
0:32
По ту сторону Гугла
Рет қаралды 275 М.
cool watercooled mobile phone radiator #tech #cooler #ytfeed
0:14
Stark Edition
Рет қаралды 8 МЛН