Bethesda Mod School: Dialogue 102 - Generate Lip Sync Data Automatically

IMPORTANT as of December 2019, you need this patch for the CK to generate lip files: www.nexusmods....
In this second Dialogue lesson, kinggath shows you how to setup your environment to quickly generate Lip Sync data for your dialogue. This video is long, but after you do the setup, generating entire mod's worth of Lip Sync data only takes minutes.
You can download the companion files here: www.nexusmods....
Lip Sync Bat File: www.nexusmods....
Required Knowledge:
::: Dialogue101: • Bethesda Mod School: D...
Understanding the ways a quest record can be used.
Join the cause on Patreon: / kinggath
Follow on social media for more news and extras:
Twitter: / simsettlements
Facebook: / simsettlements
Special Thanks
Galdavant and Kaigalinksi ( / @void-x4e ) for doing an amazing job editing all this video content!
RuinedWorld for the kinggath animated logo and JebRWocky for giving it sound effects!

[@chemicalbacon5210]

Timestamps 0:00 Preamble 0:57 Dialogue basics 4:50 Setting up an environment for lip generation (tools and patching) 12:38 Generating an XWM file for your lip files 19:14 Running the lip fuser program and troubleshooting 26:12 Exporting your files

[@kinggath]

You're a hero Chemical, thanks for keeping up with this. Get in touch with me on Nexusmods.com or simsettlements.com - have a present for you.

[@chemicalbacon5210]

@@kinggath *Sweats nervously*

[@lazyradly]

Glad to see my tool is still working. Good work on the video!

[@caiooca5793]

And not only it is still working, but is still the best solution we have apparently.

[@xXBlackWorkXx]

@@caiooca5793 How can I do that with skyrim se creation kit?

[@Pax-pw4es]

I expect this will help a lot of people. I know I've been doing the manual CK32 way so far, and it didn't seem like there's actually much info out there about how to make use of all the little utilities Bethesda gave us. This will definitely beat squinting and carefully zooming/moving the scene editor around to find the lines to click on.

[@OscarN1N7]

Thanks so much for this. Patch is still necessary and working as of 12 October 2021

[@Confusedalien1133]

king, there's only 764 views and I don't know how you pull that motivation to post more, but man you are amazing. Opening creation kit, is exactly how the lone survivor would've felt exiting the vault. hopeloss, lost , confused and everything single thing out there is there to make your life miserable ( creation vs commonwealth).. but thank you man... Obviously I dont have much to be a patreon but I can send some one time gifts nothing big.. just something to get you a cup of coffee.. saying thanks.. I'm a software engineer by profession and bethesda game worlds seemed best to use my skills.. and be fun with it... there's so many mods needed for fallout 4 .. and i might do it. but thanks to you.. let me know how i can send you a small gift..

[@Tracks777]

awesome video

[@NicklasBB]

This tutorial is great, but is missing an essential step. You must acquire and place (or already have) fonixData.cdf in the processing or LipGen folder, or else .lip files will not be generated! (The file may not be included with all installers, as Bethesda sometimes forgets to include it...)

[@someallay]

idk if you'll respond but wdym the "processing folder"?

[@NicklasBB]

It's a folder called Processing in Sound/Voice (same as in skyrim i believe) though it may also be found in Tools/LipGen/LipGenerator, created when installing creation kit 32, however depending on which installer you've used for CK, not all required files for lip sync may be present (Bethesda forgot to include it in the installer at the time of my original comment, it may be corrected by now). Just ensure that the file exists, or the process will fail silently...

[@bubbles6989]

On the scene tab in creationkit 32, where you can't see the scenes, place your mouse in the white gap, just zoom in a lot and use the scroll down till you see the action. then you can double click on the action.

[@SwarmerBees]

I saw that on one of my machines but not the other. I suspect you may have registered an old version of flowchartx32.dll. The machine that displays correctly is using flowchart dll version 4.2.1.0. Simply copying to the system or application directory may not be enough. You might have to re register it with the system with that cmd command for ActiveX controls. whose name escapes atm.

[@seskalarafey9285]

The year 2024: If anyone here wants to create lip files with Fallout 4 and Bethesda didn't include this tool with their Creation Kit. You can find it in the Skyrim Special Editon: Creation Kit. There you will find the MS-DOS LipGenerator tool in the Tools/Lipgen directory. The only disadvantage is that you need to know the wav file name and the spoken text in order to create the .lip file in 2024 for Fallout 4.

[@kinggath]

Mod School Resources include all 3 bat files: www.nexusmods.com/fallout4/mods/38669

[@Deehvad]

Can someone explain to my like I'm a five-year-old why the hell I can't just click on "Generate Lip File" in the CK for my audio. Everything works in game except for the lip-synching (the .wav is recorded and I can hear to preview in the CK, and I can hear my npc say the line in-game). This is so irritating... I remember Skyrim had a similar issue but I can't remember how I fixed it.

[@sword522]

Very sorry, but you now have 70 likes, I ruined the best number. :( Thank you so much for this guide!

[@kaitheguy7832]

What's the archive thing at the end? I'm trying to make an npc follower but my custom audio .wav and .lip files don't seem to be transferring to the game, even though I can see and hear them working in ck.

[@SwarmerBees]

It's a crack up that the lips were actually generated. After the hang on the ComQCIdes thing, I assumed failure and naturally didnt bother to check the voice wave folder. I just have been executing ck32 from the command line as advised back in 2017. I see there is a method that makes sense if you are doing a lot of lip files. I worked around it a different way. I wrote most of the following prior to viewing the patch solution described in the youtube: I prefer my way but I suppose if I start doing a lot of lips I will go to all the bother of patching ck32. Anyway... Note that if the CK32 instance being run from the cmd prompt immediately terminates, that your .esp may have a version number that CK32 does not like. KingGath describes a workaround that patches CK32, but jumping through these hoops is actually unnecessary and might not work with future versions of CK32. Anyway, the CK currently on bethesda has been writing out esps with version number 1.0 in the header since December 2019. If you have not updated CK since then, it will write out esps with version .95 and you will not see this problem. I suspect CK32 was not recompiled with the new version info. As KingGath speculates, maybe they will correct that with a future drop of the tools. but It has been a half year since this error occurred, so maybe we are stuck with it. If this problem affects you, then if you launch ck32 in interactive mode, you will see a warning message to the affect that the version of esp is not supported. The workaround is to simply go into the .esp with fo4edit and change the version back to .95 in order to create the .lips. The change the version in the esp header workaround also works with fallout.exe barfing on old .esps.

[@MrCuriousModding]

Would you be willing to guide me through this? Hit me up on Discord Mr.Curious#0625

[@yutaniskynet2653]

@@MrCuriousModding Did anyone ever walk you through this bro? Because this method isn't working for me either and we are putting a lot of work into a mod just to find out "Oh, look, we can't make the lips move!" That really destroys any potential for the modding community growing with people like me finally getting time in life to work on it. Can someone point me in the right constructive direction where I can access a Hive Mind to help me out?

[@PulsarFusion]

I tried it and it didn't work.

[@linuxtuxvolds5917]

Where is the voice wave folder you speak of?

[@deaddropmedia3970]

Big fan. Also am brand new-- Ran into some trouble where the Creation Kit says my file is a higher version than the EXE can load, so it won't generate anything. Should I.. I dunno, check for updates?

[@indecisivewolf5620]

For the record, as of 4/28/2021 the 32-bit CK still hasn't been fixed by Bethesda. I've got my mind set on learning how to create a custom companion mod and I'm gonna follow yours and Seddon's tutorials until I've got it working. Already have the character in game with dialogue written and basic follow commands functioning but it just isn't the same without recorded dialogue. Hopefully this method works for me.

[@MrCuriousModding]

If you have time to help someone new, please hit me up here or on Discord Mr.Curious#0625

[@indecisivewolf5620]

@@MrCuriousModding If you follow this tutorial you'll learn how to do it. It's ridiculously simple once you have everything installed. It seems daunting at first - literally everything involving the CK is daunting. But this tutorial covers it perfectly.

[@-ftang.5-15]

Hey mate could you make a tutorial on adding entirely new creatures, and importing textures, models and if possible animations. Also could you make a tutorial on editing existing models to make new creatures? I want to port the l4d2 tank in aswell as make different types of ghouls.

[@kinggath]

Possibly in the future, I've not seen a lot of custom creature work done, so I'll have to learn it first myself.

[@-ftang.5-15]

@@kinggath ok, i reckon it'd have to be a multi part episode as ive been told you have to do blender work aswell as cc. What about a music tutorial, an episode showing how to add new background music or make certain weathers and enemies cause a song to be played ect.

[@someallay]

I doubt ur still responding to comments but im out of ideas i have a single wav file, from an external program, named exactly right, with lip gen in the main fo4 directory along with the fonix data, but when i run it, it opens ck, starts facegen, but then stops and goes to the press a key to continue and when i check the dir there's no lip files. any help?

[@lordnix82nd]

After generation, there are no .lip files anywhere. I've patched the CK version, added exclusions, tried in the Data folder and in MO2 folder, made sure the .wav files are 44100hz, 16bit, and mono...nothing seems to work.

[@kinggath]

Any better luck if you try the manual way instead of the bat file method? Does the CK detect the wav files when you do that way? I'll say that I personally avoid mod managers when I'm making mods, as they create a lot of potential oddities with the way they move files around.

[@lordnix82nd]

@kinggath I haven't tried manual yet, but I'm doing everything locally through the Data folder now with no dice. I'm at a bit of a loss here, but I'll see if I can do it the old fashioned way.

[@someallay]

@@lordnix82nd Did u ever figure it out? I'm having the same issue ;-;

[@lordnix82nd]

@@someallay Nah, I didn't, sorry. I gave up on this shit because it was so frustrating. I'm definitely not doing it manually because it's such a huge waste of time

[@someallay]

@@lordnix82nd btw it is more time consuming but you can do it manually (although a lot less that in the vid) via the command line. I'm currently trying to figure out batch.

[@jonthemachine1970]

fallout 4 esm. is a higher level that creation kit 32 can launch. Keeps crashing

[@RandomSturf115]

noice

[@MarceloDFerrer]

Hello! That tool is dangerous. I say why. In the first place, it degrades the files in each transformation, which takes away the fidelity of the audios. But this would be nothing. Depending on the version you download, the execution of the application DELETES the archos .wav and .lip from your PC, which is a complete lack of respect for my property (the PC). At least if it generated a copy of them by creating a folder for that purpose, it would be more or less contemplated. But what the author should have done is create a folder to put the files he creates without touching my original file structure. In my case, I have lost hours of work by retransforming the .fuz files that the application had created, they either no longer had sound or the sound was choppy. Therefore, I think you should advise your subscribers and visitors to use this tool with extreme caution. Sincerely.