Unreal Engine 5.3.1 - AR Image Tracking Tutorial

[@yugiohyugiohzebuyugi]

Finally an AR video in Unreal... there is so little of it... added to my playlist. Thank you!

[@thejetshowlive]

Very Happy for this. Thank you. Just a small bit of advice. It would be nice for you to show the end in the beginning so we know what we are making! Thank you.

[@firedragongamestudio]

Thx for the feedback, really appreciate it :)

[@devon9374]

Greatly appreciate you for this!

[@ameenafi9505]

its my first tutorial class i cant unnderstand its videos

[@firedragongamestudio]

Try to follow along, pause the video regularly and try to recreate.

[@claudiosaavedra7522]

muchas gracias llevaba buscando tiempo algo así, eres lo maximo

[@rctrickstipsfun6504]

great video! i have a question, somehow i make a mistake. I would like to add another image which triggers a another event/ object. But where is the connection candidate image to the spawn of the object (your tracked parent). i tried to add the second marker here: D_ARSessionConfig. But that does of course not the job!

[@nodelayfordays8083]

Is anyone having issues with plane tracking on iOS?

[@rachmadagungpambudi7820]

error "PackagingResults: Error: Failed to build augmented image database: No valid input image found. UATHelper: Packaging (Android (Multi:ASTC,DXT,ETC2)): LogGoogleARCore: Error: Texture hiro is not RGBA8 or BGRA8 and cannot be used as a tracking target. PackagingResults: Error: Texture hiro is not RGBA8 or BGRA8 and cannot be used as a tracking target. UATHelper: Packaging (Android (Multi:ASTC,DXT,ETC2)): LogGoogleARCore: Error: Failed to build augmented image database: No valid input image found. PackagingResults: Error: Failed to build augmented image database: No valid input image found."

[@firedragongamestudio]

Check your image settings and try to add a transparent frame around your image(e.g. using Gimp), to make it RGBA. UE5 is a little strange, when it comes to the image handling.

[@rachmadagungpambudi7820]

@@firedragongamestudio thankyou

[@sirnicolas21]

@@firedragongamestudio maybe you should link to a valid image so you don't get this kind of questions all the time

[@blacktecno]

So I got the right lighting, but the mesh appears in the beginning before I even scan the image. I'm also trying to get it to play an animation when you first scan an image and change the location of the house to have the door facing directly at you. No luck so far.

[@firedragongamestudio]

you can disable the mesh in the outliner and activate it e.g. on repositon (right before setting actor location and rotation)

[@ryanclark4649]

Hi, this is a great tutorial except I would really like to be able to see how you set up the AR_Pawn blueprint nodes. Is that something you can share with me please?

[@firedragongamestudio]

These are setup by default, when choosing the template.

[@ryanclark4649]

Ah yeah i noticed that just after lol@@firedragongamestudio

[@blacktecno]

Amazing work man! I was just wonering if you could set the marker to be a brightfuly coloured stick. I need to recreate in VR a celtiberain house, but the area is quite patchy and a flat image might not do the trick. I've been trying to find this online but no cigar so far. If you knew anything or if you could point me in the right direction I would be eternally grateful. Again, amazing tutorial! thanks!

[@firedragongamestudio]

hmmmm... not sure if this works with image tracking, don't think so unfortunately.

[@danieltorresblanco1053]

@@firedragongamestudio I wondering if i clould use a QR code instead?

[@user-vs9se9vf5u]

If the phone does not support ARCore, is there any way to not rely on Google services?

[@firedragongamestudio]

Not as far as I know, except writing everything yourself.

[@SudhaCreative-ux9zx]

Do you know why AR camera is blurry than normal mobile camera quality. my target image look blur so its not detecting properly from the build app. What should i update?

[@benjaminhawklyn]

I'm having the same issue and am trying to find an answer as well. It's not auto focusing. I don't know what to do yet.

[@mynameisludoo]

same here, the detection is working better when the target image is bigger and the camera further!

[@firedragongamestudio]

The only info I found about this is here - forums.unrealengine.com/t/auto-focus-using-android-camera-plugin-is-it-possible/125903/5 but that's all I know, sry :/

[@emmacastillo7616]

Hi, I'm experiencing a black screen when opening the app on my device. What could be causing this issue? I'm using Unreal Engine 5.2 because Unreal Engine 5.3 gives errors when packaging for Android. Thank you!

[@firedragongamestudio]

Hard to say, maybe UE messes with the camera permissions or don't even ask for them...

[@ivenom6740]

This is perfect, ive been looking for a good tutorial on something like this. i do have one question though, i followed your video from start to finish, had the app build and is on my iPhone in Dev mode. but when i launch the app, the box auto generates just behind where my camera is upon startup. so if i step back i see the cube, it doesnt recognize my printed paper with the text on it at all. any ideas?

[@firedragongamestudio]

uhhh, hard to tell. maybe your marker is not recognised. maybe try another marker.

[@rachmadagungpambudi7820]

successfully built the application but there was a problem after installing it on my Android, namely "no google play store key no obb found"

[@firedragongamestudio]

Make sure that the "package game data inside .apk" is checked in the settings. this usually fixes the issue.

[@choragudibandhavi4829]

hello can we become AR creator using unreal engine? if yes, what is the route map and where can i find tutorials like these? why am i asking this is all were saying that unity is better than unreal engine for creating AR content but i learnt unreal engine so i liked to do in this. can we expect future in AR using UE? what do you say?

[@firedragongamestudio]

yes in general, but there are basically no tutorials :/ hopefully there will be more AR content in future, with Quest3 there is quite a good base luckily :)

[@itzyana5799]

I keep getting the same compile error you have in your video. You say you just restarted to fix the issue I also did that but its not working how do I fix it? My blueprint is 100% the same as yours.

[@firedragongamestudio]

Well, good question Oo

[@undiscoveredhouses]

Thank you for the video. There is a problem, it does not download to the phone. Can you share the file you prepared? I want to check.

[@firedragongamestudio]

Make sure your phone allows apps from unknown sources and is in developer mode.

[@victorpenaloza3123]

Hi! There is a way to make the tracking better? I felt that the image tracking is far superior on platforms like vuforia/unity or 8thwall. The tracking is rock solid on those options, but i want to drop unity in favour of unreal.

[@firedragongamestudio]

Totally relateable. There is no way, to improve the tracking afaik. :(

[@YahiyaJasem]

good job sir

[@benjaminhawklyn]

How do you get passed the android not autofocusing?

[@firedragongamestudio]

I didn't, just worked on my phone.

[@TheARStory]

I can't link "for each loop" and "get detected Image" and it says it's not compatible. Anyone got this and know how to fix it ?

[@firedragongamestudio]

Make sure to use the "Get All AR Geometries By Class" Nodes (with GeometryClass set to ARTrackedImage) Return Value as Input for the Array of the "for each loop"! starting at 09:15

[@TheARStory]

@@firedragongamestudio great, thanks. Do you maybe know how i would play a video on an object. i have the material and the player ready but i cant get it to play in BP?

[@charlietempleton9061]

I’ve tried this for iOS and it doesn’t seem to work. The images are not being tracked

[@firedragongamestudio]

I don't have an iPhone for testing, so I can't help here, sry.

[@charlietempleton9061]

Hi I got it working on android except for the cube the debug drawn geometry works fine but the cube is not appearing@@firedragongamestudio

[@kanishkgupta227]

After launching the apk on my phone the camera is focussed to such a long distance that it is not able to recognize the image for tracking, and also the camera is not auto focusing 🙃

[@victorpenaloza3123]

i'm having the same prroblem. was weird bc in the first run the lens just focus near.

[@firedragongamestudio]

You can use CameraFocusMode enum - docs.unity3d.com/Packages/com.unity.xr.arfoundation@6.0/api/UnityEngine.XR.ARSubsystems.CameraFocusMode.html

[@victorpenaloza3123]

@@firedragongamestudio But the link is from unity, no unreal.

[@firedragongamestudio]

@@victorpenaloza3123sry, my bad, got confused while answering lot's of comments 😅 Phu, will have to look into it, not sure about UE5.

[@CYPHERNATURE]

@@firedragongamestudio Any ideas yet? This wasn't a problem in UE4. However I don't think UE4 can package to Android 33 and 34. I'm also facing this issue and have spent a lot of time diving into c++ to try and look into it to no avail. Largely because I don't know c++.

[@christiancaliendo6875]

I copied your process, for soem reason everytime i apply a CandidateImage to to the Config Session the application isnt able to run. I tried with your image and custom images . It still refuses to work. It only stops working once its applied to the Image Tracking index.

[@firedragongamestudio]

hmmm... that's very strange... retried it a moment ago and everything worked. sry, can't tell what's going wrong here :/

[@christiancaliendo6875]

Thought i should mention i finally got it to work. The issue being that both my test image and hiro image didnt work or werent acceptable. Dont know if it has something to do with unreal 5.1.1 but i found an image that worked. @@firedragongamestudio

[@VirtuoVisio]

Same thing. On build i have this : LogGoogleARCore: Error: Failed to build augmented image database

[@SeeNed]

Hello. I'm currently struggling with the AddRuntimeCandidateImage. But the engine has some kind of bug with this, it never works. Could you help? I would be indescribably grateful to you!

[@firedragongamestudio]

Ahhh... yes I know this node and I'm not quite sure how to handle it. Haven't tested it yet, but my wild guesses are, that the ARSession must be already started, to add runtime candidate images and the UE docs state, that you'll have to restart the ARSession to have the change applied. Hope that helps. I may have some time to try it in the upcoming holidays.

[@SeeNed]

@@firedragongamestudio yea, i know. Tried to start adding image and restart. Tried same with delays. Tried creating on 1 session config and manually setting on other config. But no luck. Im sure there is no way to get it work without modifying sources, but I'm not so strong at unreal to even find a problem

[@firedragongamestudio]

@@SeeNed oh no, that's unfortunate... :/ maybe posting a thread in the forums or the discord may yield a solution here.

[@EhsanShamsi-et7vi]

Thank you. Is there any way to get object occlusion somehow?

[@firedragongamestudio]

It's on my list, stay tuned for a video on this :)

[@EhsanShamsi-et7vi]

@@firedragongamestudio That would be perfect.

[@EhsanShamsi-et7vi]

@@firedragongamestudio by the way I was just thinking about matte material for that. You see I'm not an unreal expert but in 3dsmax, there is this special material type called matte mtl. I hope that helps.

[@expectations_9077]

Can you add multiple assets and multiple images to track?

[@firedragongamestudio]

Wrote it on my list, for one of the next videos :)

[@expectations_9077]

@@firedragongamestudio is is there a specific way for the app to track the image? our project revolves around augmented reality and there are only a hand full of videos in which it has a tutorial on augmented reality on unreal engine. if there is a way we can contact you personally for consultation regarding unreal engine augmented reality will be much appreciated. THANK YOU btw love the content.

[@ameenafi9505]

HLO SIR PLSE GIVE ITS USED BP iam an bigginer