FaceFusion Basics 04 - Lip Sync - Easy, Simple, and Completely Free

[@bollywoodsymphony]

can I use this to personalize videos by uploading a excel data with different names?

[@enagid]

Wonderful tutorial! Is there a way to lip sync a still image with Facefusion, or just a vodeo?

[@shadyendeavor]

The only option is to bring a still image into an editing software or similar and turn it into a video that's of the length of your audio or longer. Lip syncing in FF is done based on the length of the target, not the source.

[@BIAOfficials-bw5mp]

I need link to download the face fusion video and link to edit audio

[@erjavid]

Wow, nice video!

[@8561]

Do you have any methods for replacing the moving mouth on a target video with a closed mouth, such that when you upload it as a target, the source audio does not really need to match the underlying movement? Basically replacing a talking mouth with a still one and then using that as a target video for the lip sync.

[@shadyendeavor]

Let me see if I understand your question. It sounds like you have a video that has a person already speaking and then you want to get it so that that person's mouth is no longer moving so that you can then use a "blank canvas" of a face to add lip syncing to it? Yeah, not possible. At least not with current open source tech that I know of.

[@psi-q6929]

i like that tom mcdonalds is there presenting the lip sync 😀

[@demm9000]

USEFUL! Thanks!!!!!

[@NinjaKittyBonks]

The easiest tell of AI is often movement of the lips. Aren't there like 5,684,291 muscles in the human face? I recommend you try this on kitty's. We haz like way less muscles, cuz' only says "meow" and "hiss". My modeling fee is 5oz. catnip per hour with a 4K hour minimum 😸This issue will be overcome and what we saw Matt discuss at length last evening about the hoax, will be a lot easier to believe if accompanied with really good image to go with what is pretty damned good audio already.

[@shadyendeavor]

Yep, and as you can see the lip syncing is getting much better. Some of the examples are very difficult to tell in this video while some are obvious. Nobody should expect perfection with what's currently available, but yes, it's going to get there sooner than later. And sorry, FaceFusion doesn't recognize 😿 faces. Some of the tech is definitely advancing at a much more rapid pace than others. Audio (both voice and music) have become insanely good as of recently. Still imagery is and has been very good for quite some time. Video is getting there, but with the complexity of it, I'm surprised it's progressed as quickly as it has. This year is going to be absolutely insane. Facebook is probably going to be the worst place for misinformation (both sides) because people there tend to believe everything they read/see and repost without doing any research. Just make sure you brought some popcorn.

[@NinjaKittyBonks]

​@@shadyendeavor ... FF does not recognize kitty's...? 🙀... Furrphobic companies have no place in a decent society! This is an outrage😾

[@shadyendeavor]

@@NinjaKittyBonks yep, maybe you should go protest at Columbia about it 😉

[@NinjaKittyBonks]

@@shadyendeavor... [packs little stick with hobo bag and heads off to NY 😾]

[@shadyendeavor]

@@NinjaKittyBonks hopefully you find a nice unlocked train car

[@JavierCamacho]

The results I'm getting are close to just pure trash. Lips barely moving and look nothing like this

[@shadyendeavor]

Yep, it can be hit or miss. This was just the Basics video I created to show how to use the tool simply. If you want to look into it a bit more to see what does and doesn't work, check out the other video I made about it. kzbin.info/www/bejne/jYeVn5h4pMitptk Not everything is going to work well, or even at all sometimes. At least not yet. More features are being added to FF very soon that might help with this too.

[@JavierCamacho]

@shadyendeavor i like the live portrait solution but i get a very shaky head. But lips are awesome

[@Ron711711]

how to do adult content

[@shadyendeavor]

Sorry buddy, you're going to have to figure that one out on your own.

[@Nabil-v6w]

@@shadyendeavor lmao