DIY Vtuber Unreal Engine 5 / 4.26 Application for FREE - Full guide

I also stream on Twitch: / fofamit
Vtuber tech that won't break the bank - • Vtuber tech that won't...
2.171K Views - Nov 14, 2023
|||||||||||.... 33% ............... 33.8K/100K
Latest Subscriber - WHYAREDRAGONSSOCOOL
Latest Member - Robert Street - Pie
Check me out on Patreon!
/ fofamit
The VPN I recommend:
www.privateint...
Links for the things talked about in the video:
github.com/
www.unrealengi...
visualstudio.m...
github.com/Epi...
github.com/HAL...
HEY! they changed their page use this link instead of downloading the code: github.com/ruy...
github.com/HAL...
github.com/HAL...
unity3d.com/ge...
For help from the community check out my discord!
/ discord
--------------------------------------
Things to use for tracking objects
--------------------------------------
Vive Tracker 2.0:
amzn.to/3fHF8Zl
Vive Tracker 3.0
amzn.to/357WeNf
Oculus Quest 2:
amzn.to/3bNKrGt
Cable for Oculus Link:
amzn.to/2PDwKzf
--------------------------------------
Other videos:
--------------------------------------
Waidayo Video:
• Waidayo: Free iPhone, ...
$1500 iPhone mount:
• So Comfy: Why I spent ...
Blender tips to create iPhone Face tracking:
• How to get Face tracki...
DIY your own VTuber application like Codemiko, Ai Angel, & Projekt Melody
• DIY VTuber application...
Converting Avatars to VRM for Vtubing~
• Converting Avatars to ...
VSeeFace Revisit:
• Best FREE Vtuber App -...
Face Tracking iPhone App:
• Waidayo: Free iPhone, ...
-Fofamit's Recommended VR Computer for Streaming-
A computer parts list recommendation for something that will be quiet and cool, but also be able to run stream and vr at the same time. I picked parts based on what I currently use or would want to use in the future... also picked parts that would look nice together.~
Motherboard - Gigabyte B550:
amzn.to/3afGnxO
CPU - AMD Ryzen 5600X:
amzn.to/38s9duY
GPU - RTX 2070 Super:
amzn.to/33BWiVT
RAM - 16-32GB DDR4 3200:
amzn.to/31sWELI
Power Supply - Corsair 850W 80+ Gold:
amzn.to/31s69uE
SSD - Crucial M500 1TB:
amzn.to/3aaHkXS
Hard Drive - Seagate 4TB:
amzn.to/3gKSkOk
CPU Cooler - Noctua D15:
amzn.to/3fFV0eP
Computer Case - Fractal Define R7:
amzn.to/3kszJbV
For Real-Time Face/Body Capture:
• Real Time Face & Body ...
#howto #unreal #vtuber

[@AICandii]

Amazing tutorial, I'm excited to get time to try it out ;;

[@Badguy292]

Thanks for linking me here! Awesome stuff~

[@Kikichichu]

Take you for linking me here can’t wait to get it set up one day!

[@jchanel04]

THANK YOU SO MUCH FOR THIS! There has been so little resources on setup up v-tubing in Unreal. Your channel is definitely the most informative!

[@Casey__Dilla]

It's important to note that when you link the github account, they send an invite email for their github organization. This allows you to see the github page at 3:50 mark.

[@MaximumObesity]

thank you for this

[@路上行走分析師]

Thank you for this

[@CorbinChancellorTV]

Would love a 2022 update to this. Many of the steps shown in the video no longer are working

[@catboyVIDS]

can't wait to do this myself! thanks so much!

[@z.maulerant5861]

This tutorial holds up great even in 2022! There was some growing pains as I had to find a couple fixes as plugins have changed since then, but I was even able to build and package from an editor instance of UE4! This is great to get started and JUST what I was looking for! Thanks for your guide, it was a BIG help

[@austeria23]

can you describe the fixes you had to do?

[@z.maulerant5861]

@@austeria23 for one, unreal fixed it's install so you can do it straight from the epic launcher instead of building an install yourself. Next, the creator of most of the mentioned plugins released fix updates since this video has been done that address most of the build errors you can run into doing this process.

[@Smoses_senpai]

Thank you so much for this video^^

[@Raelice]

Thanks for this! I'm excited to see what you could make with Unreal Engine!

[@nullcasting8666]

just saw that this video exists and i'm so excited, thanks so much! Can't wait to give this a try :)

[@dabi_]

I seriously love your channel; believe it or not, this is a question I’ve been thinking about for literally the longest time. Thank you!! Watching your channel makes me feel smarter 😂 EDIT: and watched the entire video. There was so much work put into this vid. So respect 🤜🤛

[@earlnuclear]

As someone who gets aneurysm looking at the way unity handles its 3 render pipelins, its asset pipeline and complete lack of interchangeability between them, this is amazing. Thank you so much.

[@Vie37]

If you are trying this after August 19,2021, Unreal has release 4.27 and the VMC4UE file will ONLY work if you have UR 4.26 or UR5. As of today, UR4.27 will not work with this tutorial.

[@hobistinyheartbag]

Why don’t you use Unreal 5?

[@peterxyz3541]

Definitely watching…in the morning. 4am is bad, passing out

[@dorrelredmond]

This is such an amazing tutorial! Thank you so much for making this and sharing your knowledge! I can't wait to try this out and start setting everything up.

[@centuryblocks]

Great tutorial! Thank you for sharing. I'm just discovering vTubing myself and love the possibilities. Maybe 1 day I'll get the brains to build an UnReal space like you showed.

[@TheGladScientist]

heck to the yes! so happy to see this video, i've been in the same boat using unity stuff since last year and wanting to switch it all to UE5 :))))))

[@TheGladScientist]

It took me a second to understand why vSeeFace was still needed in this setup...Is it just to receive the OSC messages from vSeeFace in Unreal? Have you had any luck using the LeapMotion plugin directly in Unreal instead of piping it through vSeeFace? I'm hoping to have it be all in one in UE bc vSeeFace seems to bring my CPU to a crawl no matter what else I'm doing on it :/

[@VIRTUALPLAZA]

thanks for the videos as always! Your vids are on notifications on my server :) thanks a bunch

[@paultheslayer2176]

Word of advice to anyone trying this, if the engine isn't building properly in VS. Add a Plugins to the project directory and not the Engine directory. It fixed so many issues Also: If your CPU has a bunch of threads, don't use incredibuild.

[@iHeartDom]

do we copy and paste or just drag? i copied and pasted and the plugins folder was like 12 gigs.

[@nonexternal]

Finally. Been looking for something like this for a while for my models, as i despise unity and the current VRM formats

[@tinybasketbun]

Thank you for this and all your other content! I've been spending the last few months doing research when I came across your work and I'm really looking forward to following a few of your tutorials!

[@sirench.4845]

Pls this is revolutionary 👁👁💕

[@WhispawASMR]

Thank you for making amazing, next-level content!

[@KataraVtuber]

Yess finally unreal engine. Tq so very much for ur hard work fo!! I've come a long way as a vtuber thanks to ur tutotials 😍

[@RubyVoxxASMR]

AHHHH YES YES YESYESSSS! im so excited ty ty ty

[@necroixes8206]

this was a phenomenal video. I want to get into vtubing, and i work on UE4 stuff on the side, so this is like striking gold for me! thank you so much for walking us through it all so perfectly!

[@lysgusmao366]

Fofa I love you! Thank you so much

[@RaveEpic]

Good work as usual, Fofa. Thank you.

[@Chill.GAT0]

Amazing I’m going to try this!!!

[@sonicstorm7979]

U r so helpful so amazing so I love you ❤️ thanks

[@Fofamit]

Happy to help

[@solidv2]

Your stuff is so helpful ! I hope you get thanked enough!

[@AlyCatVR]

Thank you for your hard work, Fofa

[@KatsuoAkimoto]

thanks i love you finally i was waiting for it

[@ByakkoJ]

OMG thank you, this was amazing.

[@rkaidia]

I knew there was going to be a way of doing this with UE and Live Link Face! Absolutly building this out and finally get to maybe use some of the assets ive been hoarding.

[@chazilla8615]

Ty for another amazing guide

[@comble999]

Awesome, thank you fofa

[@zippyholland3001]

Most excellent 👍 Thank you 😊

[@RenegadestickyXXL]

thank you, i've started looking for ways to do vtubing in UE4, your a life-saver. the bit about never using Unity is definitely me.

[@DalomarGrimm]

Your tutorials are great. Excellent teacher.

[@austeria23]

thank you for the tutorials :)

[@arch-professorcosmo2285]

What a coincidence. I'm learning learning Blender and Unreal Engine so I can go 3D. Can't wait to dive into the video. (Will be coming back to edit after watching :D) Crud.... I've already got a *lot* via the unreal launcher.... Well, need to clear space anyway. Might as well go do the "pro" method and do UE via a source build. Lookin' good. Going to have to give this a bit of a go when I finally snag mocap. Until then I'm still learning the programs, lol.

[@nbee99]

Finally something more flexible

[@vineshsinel]

This is awesome, I'm gonna work on it to make it work with metahumans

[@dulldusk]

Awesome video!

[@resetmatrix]

very good tutorial, thanks for sharing, I hope I can try it very soon !!

[@Equ1no0x]

Let's GOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO!

[@Mestrei7]

Thank you!

[@aramisbetances572]

glad u fixed ur ava, the shading before was weird now its clear!

[@FreeManson00]

I consulted with an incubator last week, but he didn't know anything. He was talking about chatting, so I thought I couldn't work with an amateurs. This video is all included. but he cant English. good job & thank you.

[@FreeManson00]

I introduced it to a person at Epic Japan, but it was just wonderful. He Twitter doesn't like it. They only evaluate relatives?

[@supremebeme]

really interesting stuff thnx

[@bunbunHD]

OMG my friend AndrewArcade is going to upgrade to Unreal with his new Vtuber model tooo! This is coming at the PERFECT time!

[@RockG.o.d]

thanks for the tutorial. for unreal engine 5 main, you need vs 2019

[@loopacute]

Jesus you are amazing for sharing all this.

[@MarioScott]

Great tutorial

[@alexcas]

I am grateful you made this however I had a lot of issues getting this to work. Specifically with UE5. You said to use VS 2017 but it didn’t seem to support the necessary components to compile UE5 code + there are issues with the latest versions of VS as well. I spent most of today trying to troubleshoot with no luck.

[@FleischYT]

You found a solution ? Also not working for me trying on UE5

[@Fofamit]

Hey you. If you don't have your GitHub and Unreal linked it some links won't work.

[@MightBe_Swan]

Hey you.

[@ArtificialLight]

you're finnally awake...

[@Hamshtickfowrsale]

how much storage space?

[@Fofamit]

@@Hamshtickfowrsale 120GB

[@Hamshtickfowrsale]

Wow that's alot, thanks

[@friendlysealstudio4447]

can you make a tutorial on how to connect meow face to unreal engine?? i cant seem to make vseeface transfer shape key values into unreal engine for arkit

[@이팩터]

wow this is very nice...

[@nebi_neko]

I need some help please. When I go to go download Visual Studio 2017, that download button takes me to another page which had me log into microsoft and then while I do have the option to download stuff theres more than just Studio 2017. It lists multiple options like...Visual Studio Community 2017, Visual Studio Enterprise 2017, Visual Studio Agents 2017, Visual Studio Team Explorer 2017, etc. Theres got to be a dozen at least but none just say "Visual Studio 2017" help? I think they updated or changed things since this video

[@MAMAvsGOD]

Facts. i really despise when i watch tutorials and these details are overlooked causing me major time to find exact VERSION! When i would believe Fofa would have already anticipated that...its sad. Im literally googling everywhere and searching comments because i dont know which version im actually supposed to download. smh

[@nebi_neko]

@@MAMAvsGOD same, then i gave up. I've been trying to find someone to make me one of those really nice and detailed unreal models and finally was like fine i'll do it myself after a year of not being selected when the makers did have commissions.....and I can't get very far if I don't know what programs I'm supposed to use :( its really disheartening that i can't do anything to get the type of vtuber model i want.

[@iHeartDom]

This process has changed and the 2017 version has been depreciated with the github plugins. Damn, I am stuck. It says my file is incompatible with 2017. I had 2019 installed and i uninstalled it thinking that may had been a problem. When I went to Generate Project Files it errored out and said I needed 2019 to generate file.

[@Xothika]

YES!!!!!!!

[@Voltraxer1]

when i download VRM4U i haven't folder plugin and releasetool. there are others files

[@bamboocube]

👍👍👍

[@xThatAwkwardGamer]

Do you think apple will ever make a camera for people using models, using the same technology in the iPhones? Everyone uses the iPhones for facial capture and I find it strange apple has not jump at the opportunity to sell this tech to game devs, animators, and VTubers. I have been making a lot of different models from VTube models in 2d as well as using meta human but unreal engine EATS my pc’s CPU. I have a pretty good pc so idk what is up with it. I have always wanted to make a 3D model with good facial expression capture but right now I use the Memoji on iPhone cause it captures my expressions and looks cute at the same time. It though is really limited and I wish it could be more. Really enjoyed your video have have watched it multiple times to learn and make new models. Thank you for the hard work you put into your videos!

[@3polygons]

What is the advantage of using Unreal versus Unity for V-tubing ? I ask it because for me is more convenient to learn Unity as there are way more jobs in my area requesting Unity.

[@ProtoPropski]

Not much, untill Unreal 5 fully releases (if you want large worlds. Otherwise Unity has most of what Unreal Has available through the Unreal Asset Store.

[@3polygons]

@@ProtoPropski Nice to know... As actually for vtubing, nothing about vast large worlds with complex geometry (key in today triple games though, I know) is being needed, I think...

[@StevenJohnsonAKASven]

Awesome video - I’m struggling to understand why the Unreal Engine Source + Git Plug-ins + Unity approach is necessary vs doing it entirely in Unreal with Blendshapes, livelink, plugin for the chosen mock-up source, etc. Is it truly that this is the only way to do it or is this an option that works well for specific styles oof Vtubing?

[@crossoverer]

i was gona ask the same question

[@slightlyniceron]

YOU'RE AMAZING! ..and maybe you can read minds. 🤔 I've been looking for this for the couple of past weeks and all of the sudden you show up.

[@GrimGearheart]

Is this superseded by the newest unreal video explanation? Or is this different overall?

[@greatideas218]

Is vseeface required to do facetracking within unreal using iphone for vrm models? I would have thought you can independently use the iphone ar kit/live link to use it without any other external programs?

[@MR3DDev]

I rather do it in engine without packaging tbh xD

[@popgothika8078]

I keep getting the same build error and I've not been able to find a good answer for why it's happening. Anything will help! MSB3073 The command "..\.?\Build\BatchFiles\Build.bat -Target="UE4Editor Win64 Development" -Target="ShaderCompileWorker Win64 Development -Quiet" -WaitMutex -FromMsBuild" exited with code 6.

[@Kitzoomer]

same!

[@ripulse1839]

same issue. So close yet so far

[@BrandonStewart0]

Were you able to solve this? I've tried almost everything to solve this lol

[@ripulse1839]

@@BrandonStewart0 I've found the same workflow for this one by joining fofa's channel kzbin.info/www/bejne/hYGlpIdmgpWkirM

[@epm9947]

Yeah...Unity seem like a much quicker setup

[@ManikClub]

is there a way to track face and body/hands simply by using multiple webcams?

[@GrimGearheart]

Do you feel like something like this could run, stream, AND play a game at the same time?

[@chengjin565]

Another question: If I had downloaded the 4.26.2 version in Epic Games Launcher, should I download the source code version? Will the source code version conflict with the launcher version?

[@kal8965]

3d background tutorial?

[@Inariann]

i've been trying, but to no avail even asking a friend who works with unreal engine for help. VRM4U plugin made build fail, and when I added it to a project following a different tutorial, it broke the project. I dunno how to deal with the VRM4U plugin at all. :/ Well, talked to a friend who worked with unreal and he says to wait til 5 comes out since it's apparently broken at the moment, so who knows. Hopefully I can follow this later on. Thank for the time you put into this hun btw.

[@Inariann]

Thanks Fofa. I found a workaround and was able to get it working. Now trying to find a cheap mocap method because I'm trying to do something a little too ambitious, but this helped a TON. Thank you. Appreciate all your videos, you helped me a ton being able to stream

[@Inariann]

@@hfjde Sorry, I haven't touched my project in a long time and didn't try installing UE5. I found the workaround on youtube, but I don't remember the video title. I think it has to do with putting the plugin in both UE plugin folder AND the project's plugin folder

[@randomgyal643]

​@@Inariann omg ... there is a words search in the history .... I wish you karma for when you search for something. I wish you see someone who knows how to solve your problem and gives you an answer as vague as the one you just gave. Have a nice day :)

[@Inariann]

@@randomgyal643 try installing the plugin in both the UE directory AND in the plugin directory. That's what I did, but I don't know if it works for everyone. OR if it works that way now. OR if it causes issues in the final product. I've never used UE until this and havent touched it since. And never finished the project. If i share a way that breaks people projects cause I'm new and i can't share links to other videos...

[@chengjin565]

Is the setup speed depends on the internet speed or something else？And generateprojectfile step warn that it can"t find VRM4U plugin

[@V_TheCyberKitten]

it says I needed Visual Studio 2019 when I clicked "generate project files" but I got both visual studio 2017 and 2019, confused

[@activemotionpictures]

If this was a game-boss-immunity crack code in a videogame, you'd found the gold mine. How obnoxious to jump through all those loop setups. But thank you so much for sharing this crucial information!!!

[@cloudvomit]

would this still work if I exported it as a regular game made for windows?? the new complete unreal engine 5 doesn't have a mlt file inside the UE5 folder. i have UE5 already installed.

[@elfiecakes]

I linked my epic games account to github but i still get the error 404 for the link?

[@stormr]

I dont need unity if im already trying use an unreal character do I?

[@FlamyREC]

Great tutorial however I'm stuck after doing the blueprint, I'm sending the data to correct ports, and the character still doesn't move, ocasionally I saw it moving 15 degrees in place still doing the T-Pose, not quite sure where the problem stems from. Any kind of help would be appreciated! Thanks

[@ibraabbas]

Hello, please I have same issue, did you fix that? and how?

[@FlamyREC]

@@ibraabbas yes, my model was actually done by 3rd party. The actuall settings within the model's vrm file were not properly set up. The reason why it also didnt work was because facial features and body movements are being sent by one protocol(one of the numbers that you set up on vseeface) found a friend that actually created a small program that works on top on VseeFace that splits these two facial and body protocols into two different ones. Once I get back home I will get in touch with you... Leave me your discord number here

[@Voltraxer1]

Can I close vs2017 once unreal engine is open ?. Should I always open unreal engine from vs2017?

[@Will_Is_Coming]

can someone help i got a problem telling me when i try to open my unreal engine it says plugin ueosc faild to load because module ueosc could not be found.

[@FrozenInIce]

codemiko uses xen tracking suit

[@MAMAvsGOD]

Thank you for this guide Fofa, its just difficult to follow when certain things like at 4:44 are skipped leaving me the viewer totally thrown into an abyss of confusion on which version of Visual Studio 2017 to choose to proceed. Thank you though truly, 13

[@will_rcq4264]

Did you figure out which version of 2017 you need?

[@MAMAvsGOD]

@@will_rcq4264 I didn't I kinda paused the operation until I could get help. Ill update u soon as I do bro.

[@Mestrei7]

Unreal enggine or unity? what is the best? which one has best performance? Are there differences between them?

[@kyoko.eclipse706]

can someone help me? idk whats a source code and where to download ittttt

[@l3b0vsk1]

I think this setup needs a separate computer if you want to stream the game as well, right?

[@Fofamit]

Depends on your computer.

[@osoiman]

Thanks for this, I know UE4 way better than Unity

[@breadbotnik]

This is really awesome, one question, when I tried Unreal Live Link Face before it captured the blendshape info but didn't send the head position with it, did you notice this problem at all or know which element of your workflow here that got around that?

[@Transrenata]

Great now I got to uninstalled Visual Studio and install a different version again

[@thisisZOA]

Does this work on a MacBook Pro m1?

[@p1nunotv555]

pls make a video using vup on steam.

[@kerenmendez4482]

hey i am having issues with the "generate project files" step. i get this error C:\Program Files (x86)\Microsoft Visual Studio\2017\Enterprise\MSBuild\15.0\Bin\Microsoft.Common.CurrentVersion.targets (1179,5): error MSB3644: The reference assemblies for framework ".NETFramework,Version=v4.6.2" were not found. To resol ve this, install the SDK or Targeting Pack for this framework version or retarget your application to a version of the framework for which you have the SDK or Targeting Pack installed. Note that assemblies will be resolved from the Global Assembly Cache (GAC) and will be used in place of reference assemblies. Therefore your assembly may not be correctly t argeted for the framework you intend. [C:\Program Files\Epic Games\UE_4.26\vt\Engine\Source\Programs\UnrealBuildTool\Un realBuildTool.csproj] how do i fix this

[@kerenmendez4482]

for anyone havin my issue: Visual studio installer > modify > individual components, click everything requiring sdk and .net

[@ripulse1839]

@@kerenmendez4482 like I've downloaded every SDK and .net there is on the checklist. Still having this issue

[@destiny_aix]

I had to install the following to get this step to work: 1. ".NET desktop development" (found under "Workloads" in the VS Installer) 2. "NuGet package manager" (found under "Individual components" > Code Tools in the VS installer) 3. .NET Framework 4.6.2 Targeting Pack (found under "Individual components" > .NET in the VS installer)

[@kerenmendez4482]

If the plug in dont appear at 11:33 how can I add them into the project?

[@LizardMods]

When linking your account your given two options, which one do you pick?

[@doranmingo4624]

for the 3d model do we need rigging before input to ue4 or ue4 can just capture real life actions?

[@Fofamit]

Not exactly sure what you mean here