Blender for AR/VR Design (Beginner Friendly!)

An in depth tutorial of how to utilize Blender for in spatial thinking and quick iteration in the AR/VR design process. I'm going to show you how I made an augmented reality video walkthrough, and then how to quickly prototype virtual reality content.
===Apps used===
Blender: www.blender.org/download/
Sketchfab Blender Plugin: github.com/sketchfab/blender-...
CamTrackAR: apps.apple.com/us/app/camtrac...
===Assets===
Sketchfab Scene: skfb.ly/6ZQoN
UI Assets: drive.google.com/drive/folder...
===My Gear===
A7Siii amzn.to/3rkwJ3N
Rode NTG mic amzn.to/2NPlkLA
Long C to C cable (great for Oculus Link): amzn.to/3pvbQSI
Reliable A to C cable: amzn.to/3rPhOzg
DJI Mini 2 amzn.to/3ckMgwk
Shirts, swag and stickers www.redbubble.com/people/jake...
The above affiliate links help support the channel with no extra cost to you
===On Social Media===
Twitter @BlakeJakely
IG @BlakeJakely
Sketchfab @Jakely
Medium @Jakely
===Sections===
0:00 Introduction
0:26 Why Blender
1:15 Shoot & Track with CamTrackAR
2:05 Blender Setup
2:55 Importing UI
3:20 Moving, Scaling, Rotating
4:38 Sketchfab Import
7:03 Importing Footage
8:45 Placing in the World
10:30 Constraints
12:00 Compositing & Render
13:45 Animating
15:20 Transparency
17:30 Better Animation
18:50 Final Render
19:08 VR Scene Inspection
===Tags===
Blender, Product Design, Augmented Reality, Virtual Reality, Mixed Reality, UI, UX, vision video, prototype, AR/VR, VR/AR, XR, spatial design, tvori

[@kaleb4256]

Fantastic Jake! Can't wait to try this out.

[@NareshUgaonkar]

This is amazing and it's going to be so perfect for architecture. Thanks a lot for the tutorial.

[@niteeshyadav]

This is great! I have been banging my head in Unity for even quick prototypes :) Thanks Jake!

[@pompidou404]

I'm both upset and happy to have found this tutorial. Months ago I tried prototyping an AR app using After effects and it was such a pain. This is so much easier! Thanks for sharing!

[@matebarkoczi9792]

do you think it's still easier to do in Blender in 2024 than in After effects? I kinda familiar both, but after effects is always so much exhausting sw for me after a while.

[@Stonehenge2.0]

BRILLIANT dream come true, thanks for sharing!

[@damofx]

Incredible work, you’re going right to the top. Brilliant channel

[@zensirdes5157]

Dude!! this is one of the best tutorials ever!!

[@qyetstormasmr6972]

Wow, thank you! You are truly an expert! There's so much information in this video and it's so fast that it was difficult for me to remember everything because I'm new at this. So, thank you for the timestamps also! Great tutorial!

[@lucashyde1164]

Just what I've been looking for! So little people did ui for blender tutorials

[@Datssketchy]

This was an amazing tutorial man. I feel so powerful now.

[@paulacano315]

This is amazing, Ihave been looking for this for long time, thanks!!!!

[@ailisnelis2383]

this is amazing stuff dude!

[@manu.vision]

Great tutorial!

[@ChapitZulkefli]

Amazing, Jake.

[@AR-py4bd]

very helpful! keep em coming!

[@veronicad849]

This is exactly what I needed! Thank you so much!!

[@DXVXD]

Wow this is very useful. Thank you for sharing this workflow. I am going to try building some concepts with this method :)

[@kenkaniffca]

Thanks for the info bro. Great content!!

[@victoronwuzuruike2256]

Great Tutorial!

[@huycuongphan1063]

thanks, this tutorial is so useful for my student project!

[@elad3958]

I instantly became a fan. I must learn how to use blender

[@jingyusun6699]

Subbed! Really AWESOME video!! It really helps me a lot! Look forward your next video!

[@santoshgujar5237]

Thank you, Sir

[@racheldepaz2288]

Thank you!

[@aramisgrey3711]

I'm actually learning Blender for photography and film projects. Steep learning curve but it looks like AR could be a fun portfolio project. Subscribed!

[@ualien1111]

Yooo brooo I really enjoyed you showing me how to do thiss I’ll never forget 💯🎧😃 thank youuuu

[@raffagadafa6737]

good video. thanyk you!

[@pompidou404]

Would love a part 2 to this. I followed the tutorial but found myself getting stuck at certain parts. Would love to see other examples, like how do you stick an object to a scene when your camera is moving around it without it floating all over the place? Great tutorial. It's helping me a lot with my current project! Thanks!

[@sebastianhansen3018]

I have this excact problem, how did u fix it? :)

[@feitingschatten1]

@@sebastianhansen3018 it sounds like your anchor was the camera... try to ensure the object's anchor is in the scene. Take note, at the beginning of the video, he creates an anchor near the top of Arashi

[@moisespineda7886]

Subbed! Thanks Jake 🙏🏽

[@Itsmepanda]

Keren bang, makasih banyak yaaaa

[@vineetkamboj9527]

Great video Jake. I loved the material applied to Jake's VR apartment model. Could you share some details on the material and bake parameters you used in blender. Thanks

[@robertovenditti1515]

Amazing! This is exactly what I was looking for. Thanks a lot. Is there any book / particular resource to use for people interested in designing for AR / VR? I see lots of Blender tutorials out there, but they are mostly for generic 3D modelling.

[@jen5917]

Same! I've been wondering the the same thing!

[@RariYeahh]

Hey Jake, you should definitely go more into animation. Especially with ui's in figma.

[@minhhoangpham5877]

Character In the video It's great, I like it a lot $$

[@fijithecreator564]

Great video! Can you do the same with fully rigged and animated 3D models by importing a .fbx file instead of images as planes?

[@user-uz3ee1up8m]

i really love your video and your dog!!!hahahha

[@scarabe-ing]

Waow ! Great for all you give to us from scratch to the end in a few minutes, so good rythm, I love it ! Question : is it possible to generate android AR app with Blender ? Many thanks !

[@virtualspaceoft3501]

Thanks so much this video could be a bit extended in details of IPad program that you used. I haven't the video finished yet but I appreciate your hard work thanks

[@alirezamohtashami6858]

Thanks great video!! Now how can I go to the same place (in real life) and my phone detects the 3d objects at the fixed positions?

[@MinGuen]

Awesome! Thank you for sharing this! Do you know if there’s a way to save/export from Blender so others with VR could preview it somehow? (It’s for a client work and I assume they don’t know Blender) Something easy to access like a 360 jpeg but for VR?

[@jake-ly]

If you bake out the animations SketchFab is great for this! You can upload it via the same SketchFab plugin we downloaded here. Then in the SketchFab app you can use webXR on almost any headset

[@MinGuen]

@@jake-ly Ahh. Sweet! That's perfect then! Thanks a lot!

[@studiobaxter1242]

Very cool, but the tracking of the models seems a little loose. I used tracking points in blender, and it was pretty accurate, moving my models based on points that you set on your video background. The program recognizes visual cues, and aligns your model to 3D space, based on the movement of those points in the video.

[@RainDogs44]

Great video Jake, thank you! I hope you create more of these. Is there an alternative to CamTrackAR (for Android users)?

[@jake-ly]

I couldn't find one unfortunately. I feel your pain, I have an Android phone so I had to use my iPad

[@user-gy1ky8yt9v]

Is there some soft for Android like cam tracker ar?

[@ivntl]

Hey Jake, thank you for the video, it's very useful and allows someone like me to get started with this brave new world! I have a question. I have blender 2.92 (just downloaded an hour ago) and I downloaded the scene from sketchfab you've suggested we use. The VR info panel, though, says "Built without VR/OpenXR feature". Have you had that issue before? Not sure how to fix

[@jake-ly]

I can think of a few things: 1. If you're running a Mac they don't support openXR unfortuantely 2. Installing from the Microsoft Store version seems to not build with everything if you installed from there 3. Unfortunately I was wrong about SteamVR support. Apparently it doesn't actually support openXR like I had thought. I need to append the video 😞. That's my bad for not doing the full research

[@jake-ly]

There seems to be a openXR dev preview if #3 is the issue store.steampowered.com/news/app/250820/view/2396425843528787269

[@SapiensVirtus]

is it possible to do this but in live camera?I mean trough a filter with Spark AR could work to offer this as advertising for a restaurant? for example.. thanks in advance, great video

[@ankitdas6748]

This might come up as a little stupid doubt, but the 3D animation you did was on a video you filmed using cam track AR. If i plan to make it in a way that whenever i go around that place ,camera detects and identify the similarity between the place and video and automatically shows this animation(basically google maps AR version). Is it possible to do that in blender. I am a noob to this ,so would be really helpful if anyone can clear my doubts here.

[@mansirmuhammed7140]

Shame you never got your answer. That’s exactly why I’m watching this video

[@senoroj]

Love Arashi Ramen

[@tobi6758]

Do I need a iPhone with Lidar for the App?

[@CarlosSantos-qn8oc]

Goodnight. Modeling for AR / VR follows the same flow as game modeling? Does this modeling have to be LowPoly?

[@jake-ly]

Very much yesml. And things like transparency in headset are big performance hits if there a lot of it

[@azizjonjuraev8151]

Hi all. Is there any alternative to CamTrackAR for Android? Thank you/

[@prasadchopade2334]

How to use htc vive pro 2 in blender ?

[@martinsmith7893]

This is great, however, if I create an AR program for a shop, how do I get this to the end user for example, someone walking down the street walks down past the shop, it's obvious that they wont see they signs unless they use something to see this. Are we waiting for AR hardware for people to wear day to day and then these object should automatically show up or am I missing something as the end user isn't explained.

[@xXxIMMORTALxXx]

Yea either users wear HoloLens or have an app on their phone where it shows AR object like the mobile game Pokemon Go.

[@valtabohm]

does that yellow button works?

[@reefdabversenft30]

What laptop did you use ? M1 or m1 pro ?

[@kamiusu2360]

Addon is downloading and installed, but doesn't shown in addons list. What i have to do? Blender 2.91 MacOs Big Sur

[@koaylingxian1296]

same issue here!

[@hansol747]

amazing! i want to put object's shadow on vedio's road. how can l do that?

[@jake-ly]

Search up "shadow catcher material" for Blender. There's a few ways to approach this. In Eevee its a bit harder since its not built in like Cycles, but still easily doable

[@hansol747]

@@jake-ly Thanks for comment!

[@chaeryangahn9553]

i have one question! how can i get anchor ??? i can't find anchor!

[@bplusf3195]

thx. I don't really get the advantage of prototyping AR in blender. Why not build a prototype AR experience and screencapture it with your phone..?

[@jake-ly]

Just comes down to speed. If you can make 3 short vignette videos in the time it takes to make one prototype, you can make decisions faster with stakeholders. Don't get me wrong I love prototypes, but they rarely go as smooth as a linear narrative in a video

[@gumzo2509]

Experimented with this simple 3D AR virtual space for data visualization. Simple animated bar graph. Modelled the scene Applied simple Material Animated 120 frames Export as gltf settings The challenge is to upload to social media like facebook and WhatsApp. Note majority of the users will android users and not the latest smartphone please help. Thank you

[@user-uz3ee1up8m]

hoping u will upload unity arfoundation based on mobile phone!! because most of us don't have a such fancy headset!!!!

[@SHIVAMANOBAL]

I am new to ar i am a 3d artist. add images or 3d models to video is vfx right ? how it can be ar. please explain

[@fabioroncal8763]

this is a nice tutorial, however this is more like a regular comp shot with 3d tracking. AR/AR is more for real time filters or apps where you deal with different types of problems.

[@victoriasimao2715]

Do you work in this area? I'm thinking of studying to work as AR designer but I'm afraid of not earning enough or not being able to do this job well because I'm not (yet I hope) super into coding. Can you give me some inside tips and comments on that?

[@leoeditor]

? But, where the app functionallity with a phone camera?

[@benventura100]

Is it possible to make this in real, walking with your phone along the street and see this sign?

[@Kilimanjaro1]

Hi bro, is more than 3 years since yr Last video Post Are you okay, we need more videos from you

[@DRLZEca]

Why do you have the masonic compass as your icon ? Ngl makes me uncomfortable, idk if that was the intention

[@movetotrash]

Hi Jake, thanks for the tutorial, it's amazing. But I'm stuck at kzbin.info/www/bejne/onzPgXaIo5yKaqM installing a Sketchfab plugin, after installing in Blender it just doesn't appear. Is there any trick?

[@jake-ly]

Make sure you didn't unzip it! you install the .zip. Other issues could be if you're on an alpha/beta it sometimes gets funky with addons

[@jihadariffin2774]

@@jake-ly hello..I got this issue too. Problem is, there is no zip file can be found from the download. I am using MBP

[@denizkudayar6206]

why would you use the freemasons symbol in your logo? Are you a freemason?

[@kaiserslautereropenonlinec215]

but the fitst part of the tutorial is rather VFX, not AR...

[@arshichowdhury9532]

Is your intro suggesting that you are a free mason?

[@deepmindt2811]

WHY NOT USING QR CODE AND MAKE IT AR TO ALL PEOPLE WHO WILL SCAN IT

[@randommemeq5955]

idk what iam watching but ok

[@emeraldvfxtube945]

boowwwwww

[@saadjavedsatti1341]

are you a mason

[@prototype9000]

blender sucks for vr design so slow to develop in it they make vr modeling programs that are much more intuitive and faster than blender ever dreamed of being

[@deepmindt2811]

DALL - E WILL DISRUPT THIS BY QR CODE