DIY Vtuber Unreal Engine 5 / 4.26 Application for FREE - Full guide

I also stream on Twitch: / fofamit
Vtuber tech that won't break the bank - • Vtuber tech that won't...
2.171K Views - Nov 14, 2023
|||||||||||.... 33% ............... 33.8K/100K
Latest Subscriber - WHYAREDRAGONSSOCOOL
Latest Member - Robert Street - Pie
Check me out on Patreon!
/ fofamit
The VPN I recommend:
www.privateinternetaccess.com...
Links for the things talked about in the video:
github.com/
www.unrealengine.com/
visualstudio.microsoft.com/vs...
github.com/EpicGames/UnrealEn...
github.com/HAL9HARUKU/VMC4UE
HEY! they changed their page use this link instead of downloading the code: github.com/ruyo/VRM4U/release...
github.com/HAL9HARUKU/ueOSC
github.com/HAL9HARUKU/VRMMapE...
unity3d.com/get-unity/download
For help from the community check out my discord!
/ discord
--------------------------------------
Things to use for tracking objects
--------------------------------------
Vive Tracker 2.0:
amzn.to/3fHF8Zl
Vive Tracker 3.0
amzn.to/357WeNf
Oculus Quest 2:
amzn.to/3bNKrGt
Cable for Oculus Link:
amzn.to/2PDwKzf
--------------------------------------
Other videos:
--------------------------------------
Waidayo Video:
• Waidayo: Free iPhone, ...
$1500 iPhone mount:
• So Comfy: Why I spent ...
Blender tips to create iPhone Face tracking:
• How to get Face tracki...
DIY your own VTuber application like Codemiko, Ai Angel, & Projekt Melody
• DIY VTuber application...
Converting Avatars to VRM for Vtubing~
• Converting Avatars to ...
VSeeFace Revisit:
• Best FREE Vtuber App -...
Face Tracking iPhone App:
• Waidayo: Free iPhone, ...
-Fofamit's Recommended VR Computer for Streaming-
A computer parts list recommendation for something that will be quiet and cool, but also be able to run stream and vr at the same time. I picked parts based on what I currently use or would want to use in the future... also picked parts that would look nice together.~
Motherboard - Gigabyte B550:
amzn.to/3afGnxO
CPU - AMD Ryzen 5600X:
amzn.to/38s9duY
GPU - RTX 2070 Super:
amzn.to/33BWiVT
RAM - 16-32GB DDR4 3200:
amzn.to/31sWELI
Power Supply - Corsair 850W 80+ Gold:
amzn.to/31s69uE
SSD - Crucial M500 1TB:
amzn.to/3aaHkXS
Hard Drive - Seagate 4TB:
amzn.to/3gKSkOk
CPU Cooler - Noctua D15:
amzn.to/3fFV0eP
Computer Case - Fractal Define R7:
amzn.to/3kszJbV
For Real-Time Face/Body Capture:
• Real Time Face & Body ...
#howto #unreal #vtuber

[@tinybasketbun]

Thank you for this and all your other content! I've been spending the last few months doing research when I came across your work and I'm really looking forward to following a few of your tutorials!

[@dorrelredmond]

This is such an amazing tutorial! Thank you so much for making this and sharing your knowledge! I can't wait to try this out and start setting everything up.

[@nullcasting8666]

just saw that this video exists and i'm so excited, thanks so much! Can't wait to give this a try :)

[@necroixes8206]

this was a phenomenal video. I want to get into vtubing, and i work on UE4 stuff on the side, so this is like striking gold for me! thank you so much for walking us through it all so perfectly!

[@Raelice]

Thanks for this! I'm excited to see what you could make with Unreal Engine!

[@catboyVIDS]

can't wait to do this myself! thanks so much!

[@KataraVtuber]

Yess finally unreal engine. Tq so very much for ur hard work fo!! I've come a long way as a vtuber thanks to ur tutotials 😍

[@AICandii]

Amazing tutorial, I'm excited to get time to try it out ;;

[@Badguy292]

Thanks for linking me here! Awesome stuff~

[@Kikichichu]

Take you for linking me here can’t wait to get it set up one day!

[@CorbinChancellorTV]

Would love a 2022 update to this. Many of the steps shown in the video no longer are working

[@RaveEpic]

Good work as usual, Fofa. Thank you.

[@VIRTUALPLAZA]

thanks for the videos as always! Your vids are on notifications on my server :) thanks a bunch

[@AlyCatVR]

Thank you for your hard work, Fofa

[@WhispawASMR]

Thank you for making amazing, next-level content!

[@KatsuoAkimoto]

thanks i love you finally i was waiting for it

[@chazilla8615]

Ty for another amazing guide

[@RenegadestickyXXL]

thank you, i've started looking for ways to do vtubing in UE4, your a life-saver. the bit about never using Unity is definitely me.

[@solidv2]

Your stuff is so helpful ! I hope you get thanked enough!

[@DalomarGrimm]

Your tutorials are great. Excellent teacher.

[@resetmatrix]

very good tutorial, thanks for sharing, I hope I can try it very soon !!

[@Smoses_senpai]

Thank you so much for this video^^

[@dabi_]

I seriously love your channel; believe it or not, this is a question I’ve been thinking about for literally the longest time. Thank you!! Watching your channel makes me feel smarter 😂 EDIT: and watched the entire video. There was so much work put into this vid. So respect 🤜🤛

[@TheGladScientist]

heck to the yes! so happy to see this video, i've been in the same boat using unity stuff since last year and wanting to switch it all to UE5 :))))))

[@TheGladScientist]

It took me a second to understand why vSeeFace was still needed in this setup...Is it just to receive the OSC messages from vSeeFace in Unreal? Have you had any luck using the LeapMotion plugin directly in Unreal instead of piping it through vSeeFace? I'm hoping to have it be all in one in UE bc vSeeFace seems to bring my CPU to a crawl no matter what else I'm doing on it :/

[@comble999]

Awesome, thank you fofa

[@WolvesofCrypto]

Great tutorial! Thank you for sharing. I'm just discovering vTubing myself and love the possibilities. Maybe 1 day I'll get the brains to build an UnReal space like you showed.

[@austeria23]

thank you for the tutorials :)

[@ByakkoJ]

OMG thank you, this was amazing.

[@lysgusmao366]

Fofa I love you! Thank you so much

[@Chill.GAT0]

Amazing I’m going to try this!!!

[@earlnuclear]

As someone who gets aneurysm looking at the way unity handles its 3 render pipelins, its asset pipeline and complete lack of interchangeability between them, this is amazing. Thank you so much.

[@RubyVoxx]

AHHHH YES YES YESYESSSS! im so excited ty ty ty

[@zippyholland3001]

Most excellent 👍 Thank you 😊

[@rkaidia]

I knew there was going to be a way of doing this with UE and Live Link Face! Absolutly building this out and finally get to maybe use some of the assets ive been hoarding.

[@dulldusk]

Awesome video!

[@z.maulerant5861]

This tutorial holds up great even in 2022! There was some growing pains as I had to find a couple fixes as plugins have changed since then, but I was even able to build and package from an editor instance of UE4! This is great to get started and JUST what I was looking for! Thanks for your guide, it was a BIG help

[@austeria23]

can you describe the fixes you had to do?

[@z.maulerant5861]

@@austeria23 for one, unreal fixed it's install so you can do it straight from the epic launcher instead of building an install yourself. Next, the creator of most of the mentioned plugins released fix updates since this video has been done that address most of the build errors you can run into doing this process.

[@Mestrei7]

Thank you!

[@sirench.4845]

Pls this is revolutionary 👁👁💕

[@sonicstorm7979]

U r so helpful so amazing so I love you ❤️ thanks

[@Fofamit]

Happy to help

[@CaseyDoes]

It's important to note that when you link the github account, they send an invite email for their github organization. This allows you to see the github page at 3:50 mark.

[@MaximumObesity]

thank you for this

[@user-dy1uq1hw6q]

Thank you for this

[@peterxyz3541]

Definitely watching…in the morning. 4am is bad, passing out

[@supremebeme]

really interesting stuff thnx

[@arch-professorcosmo2285]

What a coincidence. I'm learning learning Blender and Unreal Engine so I can go 3D. Can't wait to dive into the video. (Will be coming back to edit after watching :D) Crud.... I've already got a *lot* via the unreal launcher.... Well, need to clear space anyway. Might as well go do the "pro" method and do UE via a source build. Lookin' good. Going to have to give this a bit of a go when I finally snag mocap. Until then I'm still learning the programs, lol.

[@nonexternal]

Finally. Been looking for something like this for a while for my models, as i despise unity and the current VRM formats

[@MarioScott]

Great tutorial

[@breadbotnik]

This is really awesome, one question, when I tried Unreal Live Link Face before it captured the blendshape info but didn't send the head position with it, did you notice this problem at all or know which element of your workflow here that got around that?

[@Vie37]

If you are trying this after August 19,2021, Unreal has release 4.27 and the VMC4UE file will ONLY work if you have UR 4.26 or UR5. As of today, UR4.27 will not work with this tutorial.

[@hobistinyheartbag]

Why don’t you use Unreal 5?

[@vineshsinel]

This is awesome, I'm gonna work on it to make it work with metahumans

[@aramisbetances572]

glad u fixed ur ava, the shading before was weird now its clear!

[@RockG.o.d]

thanks for the tutorial. for unreal engine 5 main, you need vs 2019

[@paultheslayer2176]

Word of advice to anyone trying this, if the engine isn't building properly in VS. Add a Plugins to the project directory and not the Engine directory. It fixed so many issues Also: If your CPU has a bunch of threads, don't use incredibuild.

[@iHeartDom]

do we copy and paste or just drag? i copied and pasted and the plugins folder was like 12 gigs.

[@Equ1no0x]

Let's GOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO!

[@StevenJohnsonAKASven]

Awesome video - I’m struggling to understand why the Unreal Engine Source + Git Plug-ins + Unity approach is necessary vs doing it entirely in Unreal with Blendshapes, livelink, plugin for the chosen mock-up source, etc. Is it truly that this is the only way to do it or is this an option that works well for specific styles oof Vtubing?

[@crossoverer]

i was gona ask the same question

[@greatideas218]

Is vseeface required to do facetracking within unreal using iphone for vrm models? I would have thought you can independently use the iphone ar kit/live link to use it without any other external programs?

[@Xothika]

YES!!!!!!!

[@GrimGearheart]

Is this superseded by the newest unreal video explanation? Or is this different overall?

[@이팩터]

wow this is very nice...

[@hironyanini]

Nice

[@chengjin565]

Another question: If I had downloaded the 4.26.2 version in Epic Games Launcher, should I download the source code version? Will the source code version conflict with the launcher version?

[@bunbunHD]

OMG my friend AndrewArcade is going to upgrade to Unreal with his new Vtuber model tooo! This is coming at the PERFECT time!

[@LexAstro]

I am grateful you made this however I had a lot of issues getting this to work. Specifically with UE5. You said to use VS 2017 but it didn’t seem to support the necessary components to compile UE5 code + there are issues with the latest versions of VS as well. I spent most of today trying to troubleshoot with no luck.

[@FleischYT]

You found a solution ? Also not working for me trying on UE5

[@cloudvomit]

would this still work if I exported it as a regular game made for windows?? the new complete unreal engine 5 doesn't have a mlt file inside the UE5 folder. i have UE5 already installed.

[@LizardMods]

When linking your account your given two options, which one do you pick?

[@friendlysealstudio4447]

can you make a tutorial on how to connect meow face to unreal engine?? i cant seem to make vseeface transfer shape key values into unreal engine for arkit

[@loopacute]

Jesus you are amazing for sharing all this.

[@FreeManson00]

I consulted with an incubator last week, but he didn't know anything. He was talking about chatting, so I thought I couldn't work with an amateurs. This video is all included. but he cant English. good job & thank you.

[@FreeManson00]

I introduced it to a person at Epic Japan, but it was just wonderful. He Twitter doesn't like it. They only evaluate relatives?

[@Voltraxer1]

when i download VRM4U i haven't folder plugin and releasetool. there are others files

[@chengjin565]

Is the setup speed depends on the internet speed or something else？And generateprojectfile step warn that it can"t find VRM4U plugin

[@fuyuki9608]

Hello, I would like to ask, once the model has been imported into Unreal Engine, can the shaders be changed?

[@xThatAwkwardGamer]

Do you think apple will ever make a camera for people using models, using the same technology in the iPhones? Everyone uses the iPhones for facial capture and I find it strange apple has not jump at the opportunity to sell this tech to game devs, animators, and VTubers. I have been making a lot of different models from VTube models in 2d as well as using meta human but unreal engine EATS my pc’s CPU. I have a pretty good pc so idk what is up with it. I have always wanted to make a 3D model with good facial expression capture but right now I use the Memoji on iPhone cause it captures my expressions and looks cute at the same time. It though is really limited and I wish it could be more. Really enjoyed your video have have watched it multiple times to learn and make new models. Thank you for the hard work you put into your videos!

[@iHeartDom]

This process has changed and the 2017 version has been depreciated with the github plugins. Damn, I am stuck. It says my file is incompatible with 2017. I had 2019 installed and i uninstalled it thinking that may had been a problem. When I went to Generate Project Files it errored out and said I needed 2019 to generate file.

[@Fofamit]

Hey you. If you don't have your GitHub and Unreal linked it some links won't work.

[@hamburger2922]

Hey you.

[@ArtificialLight]

you're finnally awake...

[@Hamshtickfowrsale]

how much storage space?

[@Fofamit]

@@Hamshtickfowrsale 120GB

[@Hamshtickfowrsale]

Wow that's alot, thanks

[@ManikClub]

is there a way to track face and body/hands simply by using multiple webcams?

[@AP-iw6cd]

what are the differences in using UE or Unity for Vtubing?

[@Voltraxer1]

Can I close vs2017 once unreal engine is open ?. Should I always open unreal engine from vs2017?

[@stormr]

I dont need unity if im already trying use an unreal character do I?

[@V_TheCyberKitten]

it says I needed Visual Studio 2019 when I clicked "generate project files" but I got both visual studio 2017 and 2019, confused

[@kerenmendez4482]

If the plug in dont appear at 11:33 how can I add them into the project?

[@Mestrei7]

Unreal enggine or unity? what is the best? which one has best performance? Are there differences between them?

[@enrique7934]

Is this easier/better than the unity one?

[@nebi_neko]

I need some help please. When I go to go download Visual Studio 2017, that download button takes me to another page which had me log into microsoft and then while I do have the option to download stuff theres more than just Studio 2017. It lists multiple options like...Visual Studio Community 2017, Visual Studio Enterprise 2017, Visual Studio Agents 2017, Visual Studio Team Explorer 2017, etc. Theres got to be a dozen at least but none just say "Visual Studio 2017" help? I think they updated or changed things since this video

[@MAMAvsGOD]

Facts. i really despise when i watch tutorials and these details are overlooked causing me major time to find exact VERSION! When i would believe Fofa would have already anticipated that...its sad. Im literally googling everywhere and searching comments because i dont know which version im actually supposed to download. smh

[@nebi_neko]

@@MAMAvsGOD same, then i gave up. I've been trying to find someone to make me one of those really nice and detailed unreal models and finally was like fine i'll do it myself after a year of not being selected when the makers did have commissions.....and I can't get very far if I don't know what programs I'm supposed to use :( its really disheartening that i can't do anything to get the type of vtuber model i want.

[@nbee99]

Finally something more flexible

[@thisisZOA]

Does this work on a MacBook Pro m1?

[@bamboocube]

👍👍👍

[@kyoko.eclipse706]

can someone help me? idk whats a source code and where to download ittttt

[@Will_Is_Coming]

can someone help i got a problem telling me when i try to open my unreal engine it says plugin ueosc faild to load because module ueosc could not be found.

[@slightlyniceron]

YOU'RE AMAZING! ..and maybe you can read minds. 🤔 I've been looking for this for the couple of past weeks and all of the sudden you show up.

[@appliedclinicalvr2359]

I'm going through this video 2 or 3 times so that it makes sense before I jump in. As a complete noob, I do have one question: What's the next step for putting yourself on Twitch or streaming to KZbin? You have a UE runtime file, it captures facial or even body motion, but how do you broadcast yourself? Is another program like OBS needed to complete the process? Thanks!

[@Toto-wu9ju]

obs,

[@appliedclinicalvr2359]

@@Toto-wu9ju Thanks! I did just that not long after I posted. I also found that running OBS on a different computer with a Blackmagic Extreme capture card took some of the stress off the computer running UnrealEngine.

[@GrimGearheart]

Do you feel like something like this could run, stream, AND play a game at the same time?

[@elfiecakes]

I linked my epic games account to github but i still get the error 404 for the link?

[@3polygons]

What is the advantage of using Unreal versus Unity for V-tubing ? I ask it because for me is more convenient to learn Unity as there are way more jobs in my area requesting Unity.

[@ProtoPropski]

Not much, untill Unreal 5 fully releases (if you want large worlds. Otherwise Unity has most of what Unreal Has available through the Unreal Asset Store.

[@3polygons]

@@ProtoPropski Nice to know... As actually for vtubing, nothing about vast large worlds with complex geometry (key in today triple games though, I know) is being needed, I think...

[@FlamyREC]

Great tutorial however I'm stuck after doing the blueprint, I'm sending the data to correct ports, and the character still doesn't move, ocasionally I saw it moving 15 degrees in place still doing the T-Pose, not quite sure where the problem stems from. Any kind of help would be appreciated! Thanks

[@ibraabbas]

Hello, please I have same issue, did you fix that? and how?

[@FlamyREC]

@@ibraabbas yes, my model was actually done by 3rd party. The actuall settings within the model's vrm file were not properly set up. The reason why it also didnt work was because facial features and body movements are being sent by one protocol(one of the numbers that you set up on vseeface) found a friend that actually created a small program that works on top on VseeFace that splits these two facial and body protocols into two different ones. Once I get back home I will get in touch with you... Leave me your discord number here

[@MAMAvsGOD]

Thank you for this guide Fofa, its just difficult to follow when certain things like at 4:44 are skipped leaving me the viewer totally thrown into an abyss of confusion on which version of Visual Studio 2017 to choose to proceed. Thank you though truly, 13

[@will_rcq4264]

Did you figure out which version of 2017 you need?

[@MAMAvsGOD]

@@will_rcq4264 I didn't I kinda paused the operation until I could get help. Ill update u soon as I do bro.

[@kal8965]

3d background tutorial?

[@necromansir6060]

wow

[@popgothika8078]

I keep getting the same build error and I've not been able to find a good answer for why it's happening. Anything will help! MSB3073 The command "..\.?\Build\BatchFiles\Build.bat -Target="UE4Editor Win64 Development" -Target="ShaderCompileWorker Win64 Development -Quiet" -WaitMutex -FromMsBuild" exited with code 6.

[@Kitzoomer]

same!

[@ripulse1839]

same issue. So close yet so far

[@BrandonStewart0]

Were you able to solve this? I've tried almost everything to solve this lol

[@ripulse1839]

@@BrandonStewart0 I've found the same workflow for this one by joining fofa's channel kzbin.info/www/bejne/hYGlpIdmgpWkirM

[@p1nunotv555]

pls make a video using vup on steam.

[@MR3DDev]

I rather do it in engine without packaging tbh xD

[@khrisravelo8196]

Hi good day can i use this to OBS Studio and how. Can you make tutorial. Thanks

[@Fofamit]

Please check my other videos.

[@activemotionpictures]

If this was a game-boss-immunity crack code in a videogame, you'd found the gold mine. How obnoxious to jump through all those loop setups. But thank you so much for sharing this crucial information!!!

[@epm9947]

Yeah...Unity seem like a much quicker setup

[@drjokart3864]

my question is why has it to be virtual production ? is it possible to use the "game" project. Also do i need to make each program for a new model or could i set up for example a key and if i press it the new model loads ?

[@loregodd]

I have the same question regarding virtual production! @fofamit Could I do this in the game project instead? I already have multiple environments created in game projects, and would be great to import my character

[@indieartsmidwest4042]

@@loregodd I too share the same question. I started this project as a vr default template and now I find myself stuck at the point of recompiling. There is no setup.bat file in the root UE5 folder for me to run. I do appreciate this angle in terms of ease of use. I think I may have hit a wall as I can't open the game file now without being asked to manually recompile which I can't do. I can however learn to retarget custom avatars and push the movement to the anim bp to get the same results. I don't want to go that route so hopefully I'll figure it out.