Automatic lip-sync source code released! (lazykh walkthrough tutorial)

lazykh GitHub repo here: github.com/carykh/lazykh
(Note: It works on both Mac OS AND Linux. (In 2020 I ran gentle in Ubuntu 16.04))
lazykh channel retirement announcement video (from a few weeks ago): • I'm retiring the "lazy...
Adobe Animate Automated lip-sync tutorial: • Automated Lip Sync in ...
KaeOnline's Live2D tutorial: • 『 Live2d Cubism』START ...
My original, 2020 "automatic lip-syncing" video: • AUTOMATIC LIP-SYNCING

[@ardentofzeal6244]

Mad respect for making your code available ❤️

[@abjw]

@Gray Man 🅥 bruh imagine advertising

[@ivywt]

@Gray Man 🅥 literally stop bruh

[@_general_error]

Ha.. we should automate the whole process...

[@mathshouldntdie000epic]

​@@_general_errorI agree

[@codenamelambda]

Two things: 1. considering the things you've explained, this does look like it should work on Linux pretty with only minimal changes, especially because gentle works well enough in a docker container in my experience 2. 17:40 this is because your terminal isn't wide enough for the whole line, and since iirc (I could be wrong) it literally just outputs to rewind the line to the beginning, meaning that if there *was* a line break because a line was too long, it won't rewind far enough

[@RobinHagg]

Would be fun to hear someone run it on Linux (since I'm a noob) he he

[@invinciblenoodle]

"[...] well-polished, nicely wrapped up piece of marketable software like something that Adobe would create". As someone whose only experience with Adobe software was Flash CS5, I'm legitimately not sure if this was intended as a joke.

[@MaxSpec]

Either that was a backwards joke, or he was being sarcastic in a weird way. Edit: I genuinely doubt that was a joke now after that further into the video, because I just wanna say that he is really, really wrong.

[@MaxSpec]

To clarify, I didn't want to insult him on that. It's just, I believe Adobe products aren't that good, but well, people have their own choice of what they use.

[@mini_bomba]

17:40 Your terminal is not wide enough to fit the whole status line, that's why it's creating new lines.

[@aka5]

Very cool project. Each component seems simple enough but the result is greater than the sum of its parts. The outcome looks amazing considering how few clues you give it about emotions and stuff but it probably helps a lot that your drawings are so expressive! Also the changing pose on punctuation really helps. Great work

[@aiforge8866]

Thanks for making this code available! Really enjoyed the lazykh channel, and really excited to see how it all worked

[@JustEggroll]

The first video I watched from your channel was that video. This brings back so much memories

[@drowzee4425]

17:18 the reason why it may be so inefficient is because Mac laptops don’t usually have the best of the best optimization for open source projects. FFMPEG is a powerful tool, however it could be much slower running under the circumstances of CPU rendering rather than GPU. This can’t be solved on WSL because it doesn’t have the means to hardware accelerate. The only way to increase speed would likely either be hacky optimization or running Linux with a good GPU for ffmpeg to use. Really glad you released the source and I will be using it for future projects!

[@coderhd8554]

It isnt running ffmpeg at this point- its drawing the frames correct??

[@KimChhay-hm5ef]

Îjśijjdjsßnxnjxksnamakækdkdkßkdkkdifkdfododdiidpœæęjfjjdhlïisj

[@justjames4]

Very neat! I'm glad you're fulfilled with what you did on the LazyKH channel.

[@mathshouldntdie000epic]

lazykh is better than my channel

[@Myalnyblth0]

Yay I’ve always wanted to experiment with the program you made so thanks!

[@wafflesforbreakfast774]

Hey carykh, I've watched your videos since 2019-2021. I like your channel. Your videos have alot of effort and you animate amazingly. That's why I subscribed.

[@mathshouldntdie000epic]

W move

[@wafflesforbreakfast774]

@@mathshouldntdie000epic Thanks

[@stuff31]

It's a good day when cary appears to bless us with his code

[@EdbertWeisly]

Rip Lazykh

[@thecatherd]

People who want something like this on Windows may want to look into HONK. It's a low-cost, single-developer project to create a program that people can use for vtubing avatars, and will lip sync to spoken word on the fly. Just wanted to put that out there for the people who either aren't using MacOS/Linux, or want something already pretty well polished.

[@MeepChangeling]

What if I don't want to do live stuff at all? Ever? What if I just want to make a video that I then upload?

[@DoomRater]

@@MeepChangeling what's the difference between on the fly and recorded for later use? A miserable little pile of bytes, pretty much.

[@coolman36kmaway34]

on windows 10 you can use the windows subsystem for liinux feature

[@Matthew_MBG]

@@coolman36kmaway34 and 11

[@coolman36kmaway34]

@@Matthew_MBG yea but 11 is shit

[@LifEsYouTubeChannel]

Gentle should run fine on Windows, as it says that it will run fine on all platforms supported by docker :)

[@arf20]

The gentle library *does* run on Linux, and Windows using the docker image, as stated by the README.

[@jiaweiliu5226]

cary's back with his first upload in 2022

[@Pixiltation]

Finally a video on carykh after 5 months

[@DigitalicaEG]

I love this! Thank youuu

[@EdanMeyer]

Very neat, and awesome of you to open source this! I'm very tempted to try using this for videos on a second channel

[@donutgamer6505]

does it work with music too?

[@Fjiere]

not sure

[@aekwav]

Almost went away after hearing it only works on Mac but found that it works on Linux in the description. 👍

[@12DAMDO]

i have been waiting for this since the original video

[@braydensonaslaughtmbve545]

Well I am making an object show and I think this will help me! Also keep up the awesome work!

[@violet_broregarde]

Good job releasing it!

[@Mr-Raptor]

I just watched that video today and you released this one What a coinsidence

[@marcyvillegas5443]

New favorite KZbinr

[@nzcsx]

I just want to say this: You are amazing.

[@santumChannelYes]

i was just rewatching the original video yesterday and wondering if the code had already been released what a coincidence

[@Emeraldboy-rj5dx]

I like watching this channel Carykh you are the star to me

[@TrueKrisDreemurr]

i might actually use this. this is cool!

[@maflouffe]

Oh my, I can't believe my immense luck. I was somehow born around the time the htwins started to upload videos out of the multiple thousands of years i could have potentially been born in. I'm literally witnessing history watching lazyhk retire, and even if I'm just water in the sea, I'm happy haha.

[@maflouffe]

@@wamwamwam watch the video maybe?

[@mynameisphi-2v49x]

finally, a new upload

[@zvwiztihvihgwiv7388]

Nice that gonna be evolving.

[@andrewmirror4611]

Oh I was so excited to try the thing out as I literally just recorded and edited audio for a dumb video of mine. It's unfortunate that it's MacOS only, but, like, totally understandable.

[@flippedmasterguardian]

The legend returns!

[@codahighland]

Now I want to try my hand at putting a nice GUI on this project.. and maybe trying my hand at the DSP necessary to do phoneme alignment myself. Sounds like a fun challenge.

[@jessicadickerson3050]

YES- I needed this- TY CARY!!!!

[@farofa9999]

"cat, i'm recording a video" " *MEEEOOWWW* " cried at this part

[@edward17829991]

In the rendering step, it shouldn't take that long just to overlay a few images together. It's the PNG compression slowing down the process and since they're just intermediate files so you can switch to some lower compression image format such as bmp or jpeg at the cost of larger disk usage temporarily.

[@objecter-qe9fh]

CARYKH IS BACK!

[@SegaChannelHappyPride]

You’re finally back after your long hiatus :D

[@SegaChannelHappyPride]

macOS Ventura just released To beta profiles so you really need to update :q

[@dhpz]

12:35 i see that someone is a bit lazy jk your projects are always crazy good and the fact that you make it public is amazing, keep it up!

[@user-vw4xp5nt9f]

a bit... lazykh

[@EricJSamme]

Wow this is just amazing

[@WaffyWRM]

Babe look! A new CaryKH video!

[@itze_]

Such a nice human/virtual being

[@JohnPaulBuce]

great job bro

[@banirolls]

This dude's content is like crack to me I love it so much aa

[@Yukki64_]

Can't wait for a Windows and Linux port of some kind

[@Omperpera]

Cary posted :D

[@pringle378]

I literally just watched the lip sync video for the first time yesterday lol

[@nickgo79]

HES BACK

[@nikitademodov3446]

The fact that there's a timer for drawing the billboards kills me. xD

[@Hyperboid]

One reason to use lazykh over the other options is that it's free of charge, and the source code is available.

[@holybananapeel3795]

Holy crap a rare Cary sighting!

[@alexthespooder7544]

wow havent seen carykh in a while that's crazy

[@2OXX]

Please clarify. On Github your repository is MIT licensed which requires no attribution. Yet, you say in the video to attribute you if we use the code. Is attribution necessary for derivatives?

[@LandonJobe]

MIT does require attribution though... "The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software."

[@4rumani]

What an obnoxious comment

[@4rumani]

​@@LandonJobeAnd that's not implying attribution.

[@TheOfficialHattyHattington]

ITS ALIVE

[@Scoobery]

I JUST WATCHED THE VIDEO YESTERDAY NO WAY

[@ieatnoodls]

the oldDesktopFiles folder on 3:40 is a mood

[@caryhuangplssmarryme9377]

BIG THANK YOU OMGGGGG

[@fungus1665]

Wow that was very cool

[@CARCATGames]

I just watched the lip-sync video earlier today and then I watched this one and I was like "what do you mean YEARS AGO?" I thought it newer lol

[@havitjustimagine134]

i know i am late but i am waiting for long time for this code

[@Santerim]

A new video!!

[@Seissmo]

Insane!

[@countingwithjerold]

This is epic 😎

[@countingwithjerold]

@Gray Man 🅥 fake 🤮

[@zendio6882]

i have a suggestion for a cool maybe filler, what if you made or used a pre-made auto-encounter, and made a recursive loop, where you gave it a starting image, then re-gave it into the encoder, and then so on and so first until you (hopefully) get a cool animation and a different final image?

[@12DAMDO]

the whole reason i subscribed all those years ago was because i knew there had to be a future where you finally decided to release the source code... finally, that future is today.. i have no reason to be subscribed anymore (just kidding)

[@GoofballPaul]

adobe creating well polished software hahah, good one!

[@ren-142]

that's crazy, very pog

[@zachdoesanimations.]

RIP Lazykh Jan 2nd 2020- May 13th 2022. You were amazing. lol I’m doing the Muslim prayer on it.

[@dafaakingdom9692]

WOOO

[@HurelyDev]

"Why are there police cars outside now?"

[@jan_harald]

this is awesome, though I wonder if there wouldn't be any way to speed up that inefficient generation...maybe multithreading? or without the billboards, you could check which frames would be duplicates, and just skip generating, and straight copy those? the billboards could be added on with ffmpeg, as another layer

[@mathshouldntdie000epic]

ooh ffmpeg interesting

[@tommyhetrick]

A Cary upload… on the main channel!?!?!

[@crabinijig8403]

god you're just awesome.

[@IgnisPeaks]

True Cary knife holder

[@HuntingSunder]

'Like something that Adobe would create' Hah! Good one!

[@OccyDaBoss]

cary upload within 5 years challenge

[@PvZPlaying]

(impossible)

[@KingJellyfishII]

(failed)

[@AlexSolander]

Hi Cary! I am Alex or Alexandfriends! But you can check out M&BA on June 17 at 9PM EST.

[@BostYT]

24:08 IT'S HILARIOUS HOW THE CHARACTER STARTS FROWNING AND GETS SUCKED AWAY LOLOLOL

[@matzematratze]

What would be the result with other languages like german or spanish? Great work, thanks!! ❤️

[@SonicBoy145]

I literally asked for this about 2 days ago lol

[@Funniguy2011]

“WHAT THE FRICK, AAAHHH” says the thumbnail

[@maxcraftobjectssituated5519]

We need mor acronyms Cary Kant Hear

[@marilynumbanacagmat5004]

Hello KHary!

[@narayanbandodker5482]

would you be merging PR's submitted to it though?

[@MarioFanYT]

Thanks for mouths

[@dunlopchop54]

*15:00** you can hear a nice inflection when the phonemes are enunciated "so i uploaded a video"*

[@rainbowspongebob]

Epic

[@Cat102Music]

YEEEEEEEEES

[@gingerb0z0dogarmy17]

I like how people think that flower is Cary with a pink wig on.

[@Orange_Marker]

Cary I have a question. Sorry I cant make it to the meetup I’m not vaccinated cause I’m a kid but if your gonna host a live stream I’ll be sure to join and also is the rocky plush gonna be available online after July 30?

[@catattack885]

6:02 Adorable!

[@frankoceanloverr.]

Say Cary Kangaroo Heist for the next intro

[@RainStorm2]

That’s cool

[@analogfile5012]

When is the IPD video planned to come out?

[@kreuner11]

Does it run on Linux then? The source says it should

[@carykh]

Fortunately, it does! I actually used to run this project in Ubuntu 16.04 a couple years ago, before I switched desktops. So if anything, you could say lazykh is sort of "designed for Linux"!

[@atravellingbleach8668]

@@carykh I mean, most people probably can infer that it works on Linux too but maybe you should clarify that it works on Linux aswell

[@kreuner11]

@@atravellingbleach8668 Technically it should work on most POSIX systems, which would be Cygwin or WSL on windows, though that depends

[@stary5446]

next kh joke must be: cary killing hotdogs