Runway vs Pika Lip Sync - Compare the Best Way to Make Talking Characters for AI Movies (Tutorial)

Pika and Runway both have the ability to combine an image or video with either text or an audio file to create a lip sync video. Pika has had this for a few weeks, but I believe the Runway version is currently better in small but significant ways. Want to make your own judgement about who has the best AI lip sync? Watch to see a comparison using four different videos.
#ailipsync #aivideo #aivideocreation #aitutorial #aitutorialforbeginners #runwayml #pikalabs #runwaylipsync #pikalipsync #talkingcharacters

[@aivideoschool]

I made a tutorial on how to combine Lip Sync with consistent characters from Midjourney kzbin.info/www/bejne/pH2chqKtm7ljhqc

[@marvinjonathan1093]

Hey do u take a paid job to make a request video?

[@noNumber2Sherlock]

Excellent Video! Easy to follow, easy to listen to, and substantial value! Subscribed! Thank you!

[@AI-deepshorts]

Thank you for this video. It saved me some time in trying that out myself. Highly appreciated!

[@tyngjim]

Excellent video demo and comparison. Thanks for doing this!

[@aivideoschool]

Thank you for watching, it was pretty fun to test out

[@suzannecarter445]

This was really useful - thank you!

[@aivideoschool]

I'm glad it was helpful, thanks for watching

[@TimothyDark]

Awesome video! Thank you!! Just subbed.

[@JosieKayeMedia-zw6tq]

This was awesome! thank you!

[@aivideoschool]

I'm glad it was helpful, thanks for watching!

[@MadMonkMani]

Great video. Subscribed, got out of the ai tool landscape but Been itching to jump back in. havnt had the time and there’s so many emerging tools it gets overwhelming sometimes. hard to know where to start sometimes so this was a killer vid.

[@aivideoschool]

Glad it was helpful! I agree, it's overwhelming at times. I try to learn a little bit every day about something that interests me, even if it's not the latest, newest thing. That makes it feel normally whelming.

[@crdiazmunoz]

Wow, I did my first lip sync in Runway. I did not know it could do it. Thank you so much!!!

[@aivideoschool]

It just came out Friday. Thanks for watching!

[@NatureGreene]

​@@aivideoschoolHi, after convertinng from text to video in "runway ai" i am able to download only once. How can i download more than once?

[@Rocky_6301]

Where can I get the app

[@rubensbonon3427]

great content my man, congrats

[@aivideoschool]

Appreciate it!

[@AItechIsBeautiful]

thank you Mike.

[@Raharajabimindset-vg3rz]

Thank you:)))

[@vidpic8311]

Thanks for sharing 👍🙏👍

[@TheTinker394]

Thanks for this 👍

[@aivideoschool]

You're welcome, thanks for watching!

[@kaliljimini]

Great stuff 🎉

[@aivideoschool]

Thank you for watching!

[@nd6286]

I'm goin with Runway

[@aivideoschool]

Same, especially after today's Gen-3 announcement

[@jimmyalfonzo]

Great video! Really informative and interesting, it made me wonder how Runway handles different face types, can it do big beards, obscured mouths, or even non human characters talking as organically?

[@aivideoschool]

Those all would have been good ones to test too. I wonder if Runway would have been able to do the bearded monk if he didn't have a beard. I'm working on another project and it's lip-synced some half profile shots of faces without beards.

[@vidpic8311]

Test it and find out 😮😮😮😮

[@director_enman]

Great video

[@aivideoschool]

Thanks for watching

[@codyrubino5715]

What good is lip syncing an image if no other part of the face moves ….

[@Chris-AI-music]

Thank you, great video! However, pika doesn`t offer lip sync at the moment and runwayml didn`t work with my animation videos and it also didn`t work with faces in profile 😞

[@aivideoschool]

Try Hedra, it does better with animated/non-human characters. None of the generators do great with faces in profile yet.

[@kingslaphappy1533]

If the head moved as well, even slightly and randomly…it would be much better. Ty for a good vid!

[@aivideoschool]

Totally agree, many of the AI avatars have that sort of head movement and it helps sell it as real

[@noNumber2Sherlock]

I have a quick question if I may. What is the secret or the right ai to get the animation character to blink?

[@aivideoschool]

I think with Runway's motion brush you can select the eyes and choose ambient noise. It's not perfect and sometimes they'll just blink on their own.

[@noNumber2Sherlock]

@@aivideoschool Thank you! You're awesome!

[@tomkent4656]

Only works when face is full frontal.😂

[@aivideoschool]

Pika does a little better at half profile (45 degree) shots. It's not as good as facing directly though for sure

[@wellnessvibe]

I was trying Pika Labs to lip-sync with a FREE tier. It takes forever and shows me the "File size should be less than 10MB" error. Do I need a paid plan for files bigger than 10MB? Thanks in advance.

[@aivideoschool]

I'm not sure off hand, was the 10MB+ file audio of the voice or was it the video you were adding lip sync to?

[@heartshinemusic]

Great video. However, once that EMO lipsync platform (incredible moving image from picture + audio file) gets public, both Pika and Runway are nowhere. I just don't see how they can quickly keep up with next level things like Sora and the Emote Portrait Alive (EMO). The A.I. revolution goes so fast, many platforms that look impressive now will become obsolete pretty fast. I wonder if there will be fusions of platforms to combine features and resources to evolve faster and keep up with the (still unavailable) platforms that already show us new mind-blowing possibilities.

[@aivideoschool]

That EMO demo is amazing and if anything, I think Runway/Pika will find a way to integrate it like they've done with ElevenLabs voices. The smartest move for any AI company right now is not to build the best model but to offer the best set of models in an easy to use toolset. I predict within the next year we'll all be disappointed by Sora, either from something better coming out, the cost, or the content filters. We'll also be blown away by Sora but that's the example I think of for your observation about impressive technology becoming obsolete. Even the amazing tech that isn't out yet will be obsolete in two years.

[@ShiroAisan]

I'm waiting for an open source text/image to ai video. I'm tired of the credits and subscription plans.

[@aivideoschool]

Have you looked into some of the Discord based tools? Some are still free like Morph Studio, VisionStory, Pika (I think?), and Moonvalley.

[@crdiazmunoz]

I hope that happens one day but I am not sure about that sadly

[@ladieschoice3126]

Sorry I came late but can’t I do this with my phone?

[@aivideoschool]

If you're on your phone, try logging in with a browser instead of the Runway app. Also, I just saw that lip sync will work with Gen-3 alpha coming out in a few days!

[@Raharajabimindset-vg3rz]

I don't have the "generative audio" on my Rumway

[@aivideoschool]

On the Runway dashboard, it should be under the square that says GA at the top. It's not available on mobile. If that doesn't work, ask on their Discord. They have some good moderators there.

[@Raharajabimindset-vg3rz]

@@aivideoschool I found it. Thank you!:)

[@rubensbonon3427]

not a lot of these videos out there

[@AriyaKashaf]

make video on stable video please

[@aivideoschool]

Here's one I made on Stable Video a few weeks ago: kzbin.info/www/bejne/h6ekgIWLjrlgZ68

[@icecoldyellowredbull]

I want to be very respectful so my comment doesn’t get removed but honestly I tried both and they really really suck. Don’t even east your time guys.

[@aivideoschool]

Thanks, btw I'd never remove a comment like this. I still think it's cool I can generate an image, turn that image into a video, then make a person in that video talk using a generated voice. The quality is still uncanny valley but I'm cool with that for now.

[@icecoldyellowredbull]

@@aivideoschool that’s honestly all I was talking about was the precision and quality other than that it really is remarkable what they are trying to achieve.

[@x14550x]

tldr: They are both terrible.

[@faceplants599]

What about Sync Labs?

[@blkb33]

I get what you’re saying, but saying they are terrible is a bit extreme. You gotta realise this is early doors and it’s actually incredible that were even here in the first place

[@x14550x]

@@blkb33 Runway has been abject dogshit for at least a year and a half. Their products are essentially incredibly overpriced vaporware tech demos, and this lip-sync tech has hardly moved the needle since the Chinese released it two years ago. Not incredible, and not impressed.

[@blkb33]

@@x14550x fair enough man, I’m a complete outsider watching from the sidelines. Defo overpriced for the result which I agree looks shite. Cool concept though if and when it’s pulled off properly