Lip Syncing Has Never Been Easier | PIka AI Video Tutorial

[@TheoreticallyMedia]

Opening video skit was awesome! Great job!

[@curiousrefuge]

haha thanks dude.

[@Mornar1]

How far technology has come! The guy who reads the text looks real!

[@curiousrefuge]

Haha you mean Caleb???

[@Mornar1]

@@curiousrefuge I have no idea what the name of this character is, in a circle, reading the text.

[@HaydnRushworth-Filmmaker]

Love it when your videos pop up. Always really helpful!

[@curiousrefuge]

Glad you like them! Thanks so much for watching!

[@funfactall]

Thanks for the video. It's amazing and solved every requirement that I had at this moment. I tried out so many things but nothing worked out so far as per my satisfaction. Now, with Pika and other tools, a perfect (at least close to perfect) talking head video is made that blinks her eyes. It's a bit robotic at the moment, but definitely it's working. Thanks a lot.

[@curiousrefuge]

You're welcome!

[@schrodingersfilmclub]

Nice to finally having something accessible that isn't the headbob generator, lol. RIP D-ID.

[@curiousrefuge]

This will help keep moving everyone forward :)

[@superbowladman]

I'm excited for class to start AI Advertising!

[@curiousrefuge]

Woo hoo! Excited to have you in the course. :)

[@shivercanada]

Awesome info I can actually do a music video with lyrics now! Subscribed!

[@curiousrefuge]

That's true! Thanks for subbing!

[@SienaFilms]

Oh that's fantastic news! :) I'm sure it will get better.

[@curiousrefuge]

It's only the beginning :)

[@HeidiSchroll]

Thank you. This is the information I was looking for

[@curiousrefuge]

Glad it was helpful!

[@NGW_Studio]

Dude when did pika dropped this gem?? I guess time to renew my credits..thanks for the tip!

[@curiousrefuge]

Less than 24 hours ago :)

[@AiMovieTrailers]

Just to note, this feature is for Pro and Super collaborators only for now*

[@curiousrefuge]

True! Thanks for adding that clarification!

[@AllanGildea]

Thanks for another excellent video.

[@curiousrefuge]

Our pleasure!

[@noNumber2Sherlock]

Amazing channel! So well done! IS there a way to have the the characters eyes blink will speaking even once, and what to do to correct if lips seems off when speaking? Thank you for this awesome channel! Cheers!

[@Alanx_ai]

Awesome. It's about time!

[@curiousrefuge]

Indeed!

[@studiolonepine]

Wow, this is very nice! : )

[@curiousrefuge]

Thank you for watching - cheers!

[@theroaringshadows]

awesome!

[@curiousrefuge]

Thank you! Cheers!

[@brianmonarchcomedy]

Was going to try it and it said I can't. It only works with the pro plan? $58/month is the cheapest plan where you can use this?

[@curiousrefuge]

True it's pretty pricy - and currently only with the pro plan.

[@IvoKlerk]

Now available for everyone. I have a pro license though but can’t see how to create longer lip sync than 3 sec, it’s automatically trimming video and audio to max 3 sec..

[@brianmonarchcomedy]

@@IvoKlerk Weird, I did notice that when you look at the plans now, every single paid plan has the lipsync functionality now... But none of them mention anything of time limits. Did you figure it out? Was it an actual limitation of 3 seconds on every plan or was it something on your end? I'm guessing it's capable of longer based on the demos in this video we're commenting under! Let me know if you figured it out. Thanks!

[@brianmonarchcomedy]

@@IvoKlerk Actually in this tutorial he mentions it's 3 seconds limit if you use a still image. I think if you use a video, you can go longer. I'm going to try it.

[@income-geek]

I feel its a half hearted attempt from PIKA. Lot of bugs and the quality isn't comparable with HeyGen or DID at all. Lalamu did a better job in my view. The competition is getting tougher by the day. They need to level up else SORA will take the cake

[@curiousrefuge]

Fair perspective. There is still a lot of work to be done on all sides but we think this is also a big gain for workflows (not explorting with back and forths - at least for Pika users).

[@Jam_Bon]

Pika sucks … worst paid AI experience I’ve had. Was fun at first but they clearly aren’t progressing anywhere near as fast as others

[@iggykoopa7756]

​@@Jam_Bonwhat do you recommend to turn ideas into short videos with ability to lip sync? I am looking to get going on some projects but havent nailed down a clear winner yet (thats available). Thank you

[@cheneffective1983]

great tip with the topaz fix!!! boom🙏

[@curiousrefuge]

Glad you liked it!!

[@stevevanzandt9432]

Very helpful and informative video. Thanks for posting! A few questions: Do the paid versions improve the lip-sync quality? I noticed that on some syllables the mouth opens far wider than with others. Also, does the program automatically add a teeth image? On my Pika test production, I used a video created in another program (CrazyTalk) that inserts "teeth" to appear when the mouth is open. In the The Pika test video I created, it appears as if Pika does the same, because on playback the inside of the mouth appears a bit odd.

[@curiousrefuge]

We'll do some more testing and get back to you. There may have been a few more updates since then! We appreciate you watching and engaging!

[@tariqfaizi3899]

Excellent

[@curiousrefuge]

Thank you! Cheers!

[@CREATIVEAIGENCY]

Excellent tutorial thank you

[@curiousrefuge]

We appreciate you! Thanks for watching :)

[@MichaelOhanian-y6w]

Hey, i cant upload a video to pika labs. Do i need to upgrade?

[@curiousrefuge]

It could be server trouble. You can check your account status at the top right

[@smokedoutmotions_]

oh man. it begins.

[@curiousrefuge]

::cue the Terminator 2 music::

[@gueberninja]

well i hope eventually i can afford 70$ a month to do this. this was a pretty kick ass upgrade!!

[@curiousrefuge]

Definitely a cool upgrade!

[@michaeltaylor1106]

Is it possible to make a video of myself and then add music that I wrote And recorded to create a lip sync Video.

[@curiousrefuge]

Yes it is possible!

[@TibStromb]

Pika das galáxias

[@curiousrefuge]

We

[@gu9838]

main issue for is that the video quality just inst there yet. more so with landscapes it just makes it very muddy even when upscalling . i hope in the future pika really tries to work on upgrading their video quality. but not a bad start with the lipsink

[@curiousrefuge]

We'd also love that!

[@thelioness22]

Thank you for this video. It was very informative. I just subscribed to Pika but I haven't been able to add the 4-seconds option. Do you have a video that explains that?

[@curiousrefuge]

Glad it helped! Yes, you have to extend the scene (one of the buttons). Is that button not showing up for you?

[@thelioness22]

@@curiousrefuge Thank you for responding so quickly. I have the button it does show up and I click it, but nothing happens it never extends it. I think I must be missing a step or something but I don't know what it is.

[@DucklingChaos]

Anxious to try this, my last lip sync project used HeyGen, and it came out pretty good, but they get pricey

[@curiousrefuge]

Very true - these tools can really start to add up!

[@dachisam]

thanks a lot!

[@curiousrefuge]

Our pleasure!

[@firstever27]

first , thank you for the video

[@curiousrefuge]

Our pleasure! Thanks for watching!

[@michaeltraversmusic]

I'm currently recording a song which I would also like to create and synch up to AI generated video. I want the video to have animated characters that will lip synch the vocals in the song, and for the video to have a sci-fi action feel in the background. Also I want some of the characters in the video to be animated versions of famous people. As someone who doesn't know the first thing about how to generate an AI video, are there any tools you could recommend on how to go create such a complex piece?

[@curiousrefuge]

Certainly take a look at Runway, Pika, D-ID

[@michaeltraversmusic]

@@curiousrefuge Will do. Thanks !

[@NilsYW]

I must ask, where did you get the jacket, i want it too!

[@curiousrefuge]

We'll have to start a Caleb Ward'drobe section of the videos :)

[@NilsYW]

But really where did you buy it? Can you ask him?

[@wellnessvibe]

I was trying Pika Labs to lip-sync with a FREE tier. It takes forever and shows me the "File size should be less than 10MB" error. Do I need a paid plan for files bigger than 10MB? Thanks in advance.

[@curiousrefuge]

For more than 10MB we believe you do...

[@Ebenessone]

very cool

[@curiousrefuge]

We're pumped!

[@wokzilla]

can you change the teeth? say you wanted yellow and sharp teeth

[@curiousrefuge]

You can try inpainting and see what you can get. Also photoshop generative fill may help!

[@surrealstructures1497]

Before I try, do you think it will work if I change the image every 1 second in a video or must the video only have like the same scene/character the whole time so it wont glitch out?

[@curiousrefuge]

Sorry I'm unsure of your question - mind rephrasing?

[@LukasKeraitis]

As I understand, there is no way to lip-sync with a specific voice (or the voice from uploaded video?). To kind or remix of what one is saying

[@curiousrefuge]

You can choice voices from an ElevenLabs API (a handful of options) or you can upload your own MP3 file!

[@LukasKeraitis]

@@curiousrefuge but then lip syncing will happen to whatever is IN that audio - not by taking that audio and WRITING whatever you want the lips to say?

[@fernandodiaz8231]

Thanks for the input. Through you I found out that Pika supports Lip Sync. I take this opportunity to ask you if you know how to improve contact eye. I did a simple test with "Descript" and a single minute took hours to process.

[@curiousrefuge]

So glad you enjoyed the contact! We'll have to test some ways and get back to you!

[@HerrXabu]

THank you very much

[@curiousrefuge]

Our pleasure!

[@deepdiver849]

where is the link?

[@curiousrefuge]

For Pika labs?

[@mrbabyhugh]

7:02 LOL, talking over her "other mouth"

[@curiousrefuge]

Haha there are still some things that need to be worked out :)

[@TeddyLeppard]

Interpretation of scripts complete with director's notes will probably be coming soon.

[@curiousrefuge]

Ahh good point! We'll see...

[@hsan.1951]

where is the link to pika labs then?!

[@curiousrefuge]

Pika.ai

[@kipghestos8974]

Awesome

[@curiousrefuge]

thanks for watching!

[@dancebattleangelwithprophe9881]

link to pika labs please..

[@curiousrefuge]

Pika.ai

[@Experternas]

really awesome. i can't wait til the market is flooded by the end of the year and maybe then they lower those absolute decapitating prices. $30 bucks per month x 10 different ai tools, that is too much money. I saw midjourney estimated sub count has dropped significantly, they should be the first to lower the price.

[@curiousrefuge]

True - all these tools are really starting to add up!

[@gueberninja]

how do you get them to talk ?

[@curiousrefuge]

Add your own audio file :)

[@gueberninja]

@@curiousrefuge i saw this is cool but very expensive atm so i will wait till hopefully i get monitized

[@gitcat8160]

does this work on animals like a cat?

[@curiousrefuge]

Unfortunately not well but with some testing it does!

[@madwurmz]

cool! would be nice if they allow one free generation , they ask to pay for lip sync while not sure how it will turn out

[@curiousrefuge]

That's a great idea - we hope they do that too!

[@Cave_Boy]

Hello, thank you for your good videos. I want to start a KZbin channel and make an anime on the subject of the first discoveries or ancient inventions of mankind, such as the discovery of fire, chips, oil, popcorn, etc. Is this possible with a mobile phone? How should I write my prompts that include many sequences and provide the details I want correctly? Thank you for your guidance❤

[@curiousrefuge]

It is possible because many of these apps are web based. HOWEVER, it will be difficult. You can try the runway app to use mobile tools for video, and midjourney on discord can generate images. Then use any mobile editor. However this will be a lot of thumb moving! :)

[@sukhpalsukh3511]

Passed years still mostly talking avatar using same wav2lip integration, no improvement after wav2lip or new method for lipsync ,

[@curiousrefuge]

We believe there is a strong advancement in terms of the blur box that typically comes with Wav2Lip.

[@micbab-vg2mu]

nice:)

[@curiousrefuge]

Thanks 😁

[@annhalgren1660]

Ok guys, help a noob out. At 1:43 he shows this lovely interface where you add things, change settings, do camera stuff, etc....discord messaging does not look like that. As far as I can tell, the internet is telling me that the way to use pika labs is to message the Pika bot in discord (I joined the discord already). But discord direct messaging does not have those options or look like that interface he is using! And unfortunately, there is no link to pika labs in the description as he promised, so I still can't find any pika labs site that I may be missing. Could you guys help a girl out?

[@curiousrefuge]

For questions like this, feel free to jump into our Curios Refuge discord and we can help answer this questions!

[@annhalgren1660]

@@curiousrefuge Perhaps I'm just not familiar with Discord enough, but I searched for curious refuge and curiousrefuge on discord and I didn't see any results. How should I join the discord?

[@caseyaddington]

Wow topaz doesn’t even have a free edition $300 for video? Also how are you getting 8 second clips from pika labs?

[@curiousrefuge]

Topaz is pricey BUT it's a one-time purchase which we highly recommend. For Pika - you can extend scenes an additional 4 seconds!

[@JohnnyLCob]

*It says its only avalible to Pro memebers which is £600 a year. WTF dude.*

[@curiousrefuge]

True! It's a super steep cost at this time. We hope this goes down as the competition rises.

[@minijpmotorcycles]

This is my first attempt at AI. kzbin.info/www/bejne/a3nTnnluZcZ0prMsi=FVxRu5bIWGoCh28V Let me know what you think.

[@curiousrefuge]

We'll check it out soon!

[@imagineartsstudio]

Add a Song maybe?

[@curiousrefuge]

Good idea! We will next time :)

[@ai-musicvideo]

Has anyone tried Lalamu yet? Its also pretty amazing

[@curiousrefuge]

Lalamu is another great tool!

[@ai-musicvideo]

@@curiousrefuge I tried it a few times. It might be even better than pika and is free to use now. After upscaling the videos its useable

[@BarbieSL]

try hedra its the best ever

[@curiousrefuge]

HEDRA def is awesome!

[@Yakiraw]

what did that man do to get in jail 😲

[@curiousrefuge]

Lots and lots of bad things!

[@armondtanz]

You a bit slow... have you not seen EMO : text to image. Its on another level 😮😮😮

[@curiousrefuge]

What tool are you referring to? Mind sending a link?

[@arock1999]

28.00/usd a month is overpriced at this moment in time for this. will wait for a better alternative...with the way AI improves it shouldn't take long

[@curiousrefuge]

Fair point!

[@jakemathew]

I used to think Pika was impressive. But now that I've seen Sora, all other AI videos look really rough. The Pika lip syncing might be "easy" to create, but the results are not really usable. The distortions and artifacts are so distracting that you can't focus on anything besides that. I'm sure in 6 months, Pika or another company will have refined Image to Video so it doesn't look so clunky.

[@curiousrefuge]

We'll see how it all evolves in the next 6 months. We appreciate your perspective!

[@jakemathew]

@@curiousrefuge apparently, we didn't need to wait 6 months for the lip syncing to be drastically improved. lol: kzbin.info/www/bejne/raXGhI2afb-hm5Ysi=FwrxN7LNPnhgmXxP

[@rocketburnz2297]

pika labs... 1080 max.... no 4k..... sludgy visuals... more miss than hit on prompts

[@curiousrefuge]

We appreciate you engaging and watching!

[@ai-musicvideo]

Yeah, but right now just available for Pro users :(

[@curiousrefuge]

True! It's quite new so hopefully it opens up int he future. We'll see!

[@MartinZanichelli]

Much lower quality than what Sora is bringing in just a few months.

[@curiousrefuge]

We'll see what Sora will do about voice syncing...time will tell!

[@FutureLaugh]

it looks absolutely hideous but a start

[@curiousrefuge]

Over a few months there should be some great improvements :)

[@Logophile-wc7cu]

they limit it to 3 second clips, lame

[@Gadfly321]

Where can i get vaccinated against pika?

[@curiousrefuge]

Lol wrong KZbin channel!

[@rumaruelberta]

EMO is coming.

[@curiousrefuge]

We look forward to it!

[@cantas187]

honestly it just looks like shit... i generate ai pictures in mass and my videos are not animated but before i animate such a shit i rather leave it and make only beautiful pictures

[@curiousrefuge]

We appreciate you enganging with us. These tools keep getting better and better.

[@alexmehler6765]

looks like shit , good enough for memes though

[@curiousrefuge]

Fair enough, but it's only the beginning!

[@singaporeanlivinginjapan4641]

So long winded

[@curiousrefuge]

We appreciate you watching!

[@tp7225]

[@curiousrefuge]

xoxo back to you!