yes you can mix and match those how you want, since they both use base station 2.0 tracking

docs.ultraleap.com/xr-and-tabletop/xr/unreal/getting-started/index.html you should be able to get it here

sounds like you need to change the prebase rotation like I do at 4:10...it might be a combination of 0,90,180 or 270° in one or mulitple axis

kekw

hey! sorry I don't understand the question :D could you explain a bit more what you mean?

@@RikkuVR Sure thing: Imagine a bar and I have to place myself behind the counter on OBS. Is that possible using this method?

@@leogreed you could use a transparency output from UE to key out things and place you in between stuff yeah!

yeees

Hey! Getting that reference for that target point only works if you are using the levelBP, not an actor BP...so I setup the general twitch nodes in levelBP and spawn actors from there

@@RikkuVR we talked earlier in discord, thank you Rikku!

hmm that might be some issue with the rotations, you could try to use more of the wrist instead of the elbow to rotate when you rotate your wrist...it really depends on your model, if you have some twist bones etc

oof that sucks :(

if you want to use a headrig, the iphone could still come in handy! :)

@@RikkuVR I tried iFacialmocap. Everything is working except the mouth and the blinking. Idk what I'm doing wrong. There's literally no tutorial anywhere besides yours that constantly keeps popping out. Hoping it wasn't because it's UE 5.3 or else I may have to downgrade.

@@AceLive_ hmm have you checked if you have all the blendshapes for mouth and blink? sometimes they are driven by bones instead of blendshapes

@@RikkuVR It took me several days and a lot of youtube videos so at least lemme share it or maybe I could make my own tutorial. You can skip below but I have to explain what I'm using this for. Okay so I'm using Daz Studio Characters on Unreal Engine. I have use the DaztoUnreal to export Genesis 8.1 character model to Unreal. I connected iFacialMocap to the source and the head and eyeball movement is working but the entire arkit morphs aren't working at all. So I dived in to all tutorials you can find on youtube to figure out what's wrong and it's making me give up on unreal itself. Then I realized something and here's the skip. SKIP The Morph names on Unreal are named differently. I think it's case sensitive. Even if it's the same name, if it's upper case on unreal, the default names from iFacialMocap won't work. Also it has space so you have to include that. I tried renaming all 52arkit names on ifacialmocap and it's now working. My God, I feel like I wasted 3days of my life. Anyways, I thought I share that. I know you don't do Daz Studio stuffs but just in case you decided to do a CodeMiko vtuber stuff, this is godsend. Anyways, thanks for your initial aid.

Hey Shay! I'm not sure what exactly your issue is rn...do you mean you couldnt create a chat variable?

@@RikkuVR So i did the BP Actor of the last video, and this video is mentioning to do it in the level blueprint. And i just cant seem to wrap my head around how to make it work in the level blueprint.. Can i somehow use this set up with the BP actor instead?

@@ShayTaylor-si3dp you could use it with the actorBP, it should be the same setup. Reason why I used lvlBP instead is because I can reference actors more easily from there, at least for my specific setup...but if you got it working in the actorBP you might need to either cast directly to other objects you want to control or use Blueprint interfaces (way cleaner way and also pretty simple to setup once you understand the concept)

@@RikkuVR OH, right that was my hang up. First, thanks for taking the time rikku wtf your so nice T.T I feel like thats all a little out of my league, may i join your discord and ask for a screenshot as to a level BP you use? Just so i can set up the pre requisites?

@@ShayTaylor-si3dp sure come join! we have a dedicated channel for Unreal stuff so just throw everything in there lol

lmao thats weird

I put a virtual greenscreen into unreal and key it out in OBS

@@RikkuVR can you do it in realtime like when live streaming on KZbin

yes I can turn it on and off with my streamdeck (I have a tutorial how to connect streamdeck)@@sentalogic

thank you! hmmm you would need to create a menu for the player to select their webcam device probably, cause it cant auto recognize but technically that should work yeah

I have no idea unfortunately

@@RikkuVR I’ve figured it out, it’s a program called OculusDowngrader

oh thats good to know thank you!@@RexReality

it is probably because the blendshapes on the metahuman are named not exactly after ARKit conventions / a lot of facial animations are driven by bones as well iirc so you could look more into that...theres a node in the animBP "anim node fix curves" you can use to rename / reroute those blendshapes

Heya! That sounds very similar to the way I set it up...I used a blend per bone starting at the shoulders and then driving the alpha float with a timeline, which gets triggered by the "Left Hand Visible" and "Right Hand Visible" bool in "on Leap Tracking Data" in the Actor

Hey! no idea tbh since apples ARKit stuff is proprietary

Thanks Hana!

🍪🍪🍪

🔥💯😱

thank youuuu

Thanks Kial!

there is a button for that btw

or ooooor you could just use vesee face and not have to deal with any of that lol

true but then you have to run that in the background if you send data to UE@@mk8_it

@@RikkuVR yes you are correct! i use a second computer and transfer data via ethernet because of your channel i will be able to start my own soon and i always wanted to ask are you the same guy that did that hour video on kawaii physics?

sounds great! I don't think I am the same guy, I did a video about kawaii but its way shorter...or maybe someone clipped my stream? no idea lmao@@mk8_it

@@RikkuVR xxerbexx is his name just found it. hes sounds just like you anyway thanks for all you have done for the community and looking forward to more great vids from you

Heya Tenchinu! Thank you for the feedback! You're right it is a lot of custom setup because every skeleton is different. I tried to make it quick because let's be honest, the amount of people who use leap AND want to use it in a custom unreal engine project is very small haha I will see if I find time to make a more comprehensive version but can't promise it because I have a lot of other projects running as well and this one would need a ton of explanation to break everything down. If you still want to go ahead and work on it , you can always ask on my discord if you get stuck, we have a channel dedicated to UE help!

@@RikkuVR yes, thnk u! have been checking on UE5 Vtubing solutions for a while to see wich is the most affordable and user friendly. I was trying to figure a way to incorporate with Unreal directly (bluscripts and environments) so this could be the actually solution. I also checked ur tutorial on Obskur... but that's so expensive, and it doesn't even let you connect to UE5 :((((( this does seem like da way to go, so ill try and research more to see if its worth the cost. Cheaper than full body + glove tracking tho :)

aaah I see! check out XRAnimator then, I used it the other day and you only need a webcam to drive body (with fingers) and face animations with it! It also lets you send the data over to UE to mess with it@@Tenchinu

thats a good question, I havent looked into what data you can manually pull out of the setup

Okay thanks!@@RikkuVR

unfortunately not, there is documentation in the unreal database tho!

hmmm which part is not working for you? I added the live link node in the anim Graph and selected my iPhone then it got picked up...maybe your model doesnt have all blendshapes for arkit?

Yeah I figured. x) I tested some vrm models I found on Vroid to see if I had the right technology to pull off UE5 vtubing and basically they don’t the right blendshapes naming conventions for ARKit x). Maybe You should make an addendum or something like that in your future videos ! Anyway thanks for helping me, your tutorials really helped me.@@RikkuVR

@@zicerrokkae I see hmm you could technically get the values of the blendshape s in the animBP and apply them manually to some of the others, so you can kinda cheat it with "set morph target"...bit hacky but works :D Thank you, im glad the vids help!

I'm not sure what you mean with that question haha

nice

AAAAAAAAAAAAAAAAAAAA

node wrangler is soo good