How To Use RealityScan

In this tutorial we show you how to use RealityScan and how you can easily create 3D models with your mobile phone.
In this video we cover:
00:05 Choosing the right object for scanning
00:30 How to take images
01:20 How to navigate the capture using AR mode
01:47 How to use a cropping box tool
03:08 How to use Preview mode
04:07 How to export your 3D model
RealityScan is now available for iOS devices download it now: apps.apple.com/us/app/reality...

[@7ielony]

The first time I heard about scanning 3D objects with a camera, I thought to myself: "It's not for me, because there is no live view where the quality is still lacking." What you have done is my dream come true. You did it just like I imagined in a perfect world. Thank you! As the saying goes - Game Changer

[@rafhi]

Excellent explanation, I'm already waiting for it to be released for Android

[@ahmadihsan5652]

ready for android bro

[@balazslendvay7236]

so excited about this!😀

[@ruadeil_zabelin]

I wish this app had an "inverse" feature, where you could mount the phone on a tripod and just rotate the object in-place. This would allow for some great automation where the object just slowly rotates and the camera takes all the pictures. You then just need to change the viewing angle a bit and go again.

[@CapturingReality]

Hi, this is already in the feature requests. Thank you for your note.

[@jonva13]

Wow, just insane technology. The live view / ability to check quality in the field is stunning. Amazing application of AR.

[@srambrero]

@@zvala396 well software IS the technology these days

[@3dd205]

THANK YOU VERY MUCH!!!! thank you thank you thank you

[@Super-id7bq]

Come on boys, let's get that Android version rocking. Looks great!

[@life.by.linus3D]

Looks awesome!!

[@Artemuscroa1]

look insane ! good job :)

[@kingsleyadu9289]

This is awesome 😎👍👍👍👍. I really love u guys woooow. We are waiting for Android version too. Thank you so much wooooow

[@TobiDaJoker]

It would be nice if it worked by just taking one video that captures all sides of the object. Taking that many photos makes it less convenient, but the final result is still pretty cool

[@meskalation]

I agree, but i think the reason for that is, that smartphones usually are taking pictures in a much higher resolution, than they do with videos. Also the data traffic would be huge with 4K or 8K videos instead.

[@glebv]

Will there be a tutorial on cleaning up and exporting models from the point where you stopped now?

[@Fxiques]

Brutal ❤

[@martem000]

Cool 🎉

[@hutcheson3D]

Looks great! Will this work with a small object that is rotated relative to the camera?

[@jakubsl]

Yes it could - we'll do a tutorial how you can use a simple whitebox and turntable for scanning as well. You'd need to make sure the background and base are single colored and featureless so the app doesn't use those to detect features - that would confuse the algorithm and break the alignment. Also the AR is most likely going to get confused if the camera position stays static - you might need to temporarily turn the AR elements off and validate in Preview Mode instead.

[@sunbok.]

Supercool!!

[@cypiongm8698]

Hi and ty for share. Juste wanted to know if i use x10 scale in uR5, the quality will be good or bad?

[@GhostKoffee]

I have been exporting my scans to sketchfab and importing to Shapr3D, but there is some sort of inconsistency with the units. Does reality scan use millimeters or inches in its scans?

[@RTL8139B]

That's great but what about Android phones ?

[@CapturingReality]

The Android version will be available next year :)

[@Vob627]

Yeahh

[@aldolibrian9326]

We wait for android🙏🙏

[@heliohenriquegarcia]

@@CapturingReality thank you!

[@RPxop]

@@CapturingReality thanks 🙏👍

[@RepostCollection]

When will this be released for Samsung?

[@UniversalPioneer]

Android asap please and thanks. I'm using Polycam but they dropped the ball on cropping within the app plus no AR and green and yellow preview. I've spent long times scanning and only after getting it home and rendering there are holes in the model. No way of knowing you have a good model.

[@aussieexpertenglish5885]

Great stuff. Can the app be used with a drone to save the photographer the need to walk round and round? Sound pretty lazy, don't I?

[@CapturingReality]

Hi, if you can provide external shutter to mobile, then probably it can be used also that way.

[@demonindenim]

Are there plans to store the point cloud locally? It would be a huge benefit to offline scanning.

[@CapturingReality]

It could be a feature request. But you can capture the images in offline mode.

[@nand3kudasai]

@@CapturingReality Having an offline pointcloud would be a major help.

[@robob3ar]

Ok now mega cool feature would be to use this with a proper camera somhow - either import photos from a dslr or have like a helper app that determines if you have good coverage

[@CapturingReality]

For this there is RealityCapture application.

[@DarkHeartofBlackmoor]

What about one-sided objects, like a stone wall? For textures.

[@CapturingReality]

Yes, you can also scan walls with the application.

[@H3llHoundd]

Would be nice if we could have a feature that automatically takes photos while turning around without having to stop and press the capture button. I am an android owner do you think something like this could be implemented by next year? :)

[@CapturingReality]

This option was considered, but this was a better way how to capture the images. With that option you had a lot of blurred images.

[@prankfever8877]

is it possible to open a reality capture finished 3d model without installing any programs on your android phone ???

[@CapturingReality]

When you will upload the model to Sketchfab and then check it online it should work.

[@arcadebox]

to me the main issue about reality scan is that the scan feel wrong i wonder if one day we can get option to edit the scan

[@jenelleeliseking234]

Can you use this app to make a 3D model of an outdoor environment or just one object at a time?

[@CapturingReality]

Hi Jenelle, there is restriction for 200 imagers per project, so it is better for just objects. But for the whole environment you can use RealityCapture app.

[@cgrosbeck]

If you have a enterprise license can the app link to your own server instead of cloud

[@CapturingReality]

No, this is not possible now.

[@SuleBandi]

Hi there, do we need to pay to get the model after scanning? I have a Reality Capture enterprise license, do you think it helps here or am I mixing up things?

[@jakubsl]

No need to pay for the model, the results can be freely downloaded from Sketchfab.

[@robob3ar]

@@jakubsl is ther an option where you can download it for yourself without going to skechfab?

[@giuliofaggiani6310]

I often find some alignment issues, like the point cloud shift, is it me that I do something wrong? Is there a way to adjust it while I’m taking photos or do I have always to restart?

[@CapturingReality]

Good idea is to move around the scanned object without taking any images for better "area recognition". After that you can start scanning. But small shift could be there.

[@bybiblen4879]

We really need the app for android

[@JohnLeBaronDesign]

Can’t back out of images screen in app, dead-end once you click here. Have to shutdown the app and reopen. What happens when no prompt to export to SketchFab happens? These images are useless in the app if you can’t force to SketchFab.

[@mikecapson1845]

Hi, i just wanted to integrate this into my company, but wierdly all my photos taken are pitch black.. Anyone with that issue? Any fix or workaround?

[@itsfine5818]

That's pretty wild

[@xxphantom93xx61]

There is an easy way to import this mesh into Maya in order to do a low poly model and then bake the normal maps in Substance Painter?

[@CapturingReality]

After downloading the model from Sketchfab it should be possible.

[@GregorJan]

Are the photos taken stored on the phone and sent over the internet or is everything happening locally? Is it possible to delete photos at the end of the application?

[@CapturingReality]

Hi, it is processed over the network, but images are also saved locally in the phone. After model creation and export to Sketchfab you can delete it if you wish.

[@dimcadmis8085]

Is lidar utilized in the process?

[@NoName-fx3ry]

No

[@ZombieGuyDevelopment]

I’m taking photos all around it and it only captures the front in the final scan

[@CapturingReality]

What kind of object are you capturing? Are all of your images aligned?

[@ZombieGuyDevelopment]

@@CapturingReality I was capturing a cardboard box exactly the same way as your video and all the photos were aligned

[@CapturingReality]

@@ZombieGuyDevelopment It would be better to see (your result). But it also depends on the lighting conditions. It is possible that there were some less features areas which weren't modelled. Are there some points as sparse point cloud? When you add some images, is it the same?

[@WangleLine]

Are there plans to roll out realityscan to android as well?

[@CapturingReality]

Yes, it should be released later this year.

[@xpez9694]

What is the resolution of the textures?

[@CapturingReality]

8k

[@xpez9694]

@@CapturingReality thats amazing!

[@user-ye1nz7xo2t]

wow. This is exciting. Do you think we can reality scan a tree ?

[@CapturingReality]

Hi, RealityScan has 200 images restriction, but it is also used for trees. Mostly for parts of the trees (like sketchfab.com/3d-models/tree-stump-d59a70b3a0794968956c3c6858c2342d)

[@icantdraw4805]

It's use lidar ?

[@CapturingReality]

No, it doesn't.

[@XerazoX]

is there a limit on how many images you can take?

[@jvanko89]

Currently 200

[@cairerocha1004]

I don't wanna export to scatfab. Why I can't export for sd card?

[@CapturingReality]

Unfortunately, there is no such option. But you can download model from Sketchfab then. I will add this as a feature request.

[@cairerocha1004]

@@CapturingReality thanks to answer.

[@HalitHarun]

Why does everything good come out for IOS first?

[@jakubsl]

iOS is just easier test for bugs because the amount of devices is limited.

[@RDD87z]

does it work with android or just iphone?

[@CapturingReality]

Now is also available Android version

[@ronniebaker1917]

so once i scan an object as i would like it,i can then use the file to inject the object straight into a vr game im building?

[@CapturingReality]

After the scan the model is computed and uploaded to Sketchfab. After that you can download it and use as you want.

[@ronniebaker1917]

@@CapturingReality awesome thankyou. are you curently working on any projects?

[@CapturingReality]

@@ronniebaker1917 I am not sure, what do you mean.

[@ronniebaker1917]

@@CapturingReality you dont know if you are working on any projects? vr games or anything?

[@CapturingReality]

@@ronniebaker1917 This is an official RealityCapture application account, not some personal account. So the main project for us is the application :)

[@slothsarecool]

hmm it doesn’t work for me, just unprocessed, and I have the latest app. I also don’t have the point cloud cropping tool or mesh preview.

[@CapturingReality]

Hi TJ, are you online during processing on that phone? Have you minimized the app during alignment?

[@ensutocer58]

how can I get the FBX file of 3d object ?

[@CapturingReality]

Hi, just download uploaded model from Sketchfab which is in FBX format.

[@Llamu]

do you need LiDAR?

[@CapturingReality]

No, you don't.

[@andew7763]

Dang it needs IOs16.

[@embereve-chan]

It's now out for Android in case anyone is still wondering.

[@tobiasrabelink7733]

Hello my name is Tobias and I want to scan a big straw doll of 9 Meters high how Can i do That ? It’s Not small

[@tobiasrabelink7733]

:-)

[@CapturingReality]

Hi Tobias, you can use drone on camera on a pole. When you want to use the application, you need then have some device, which will take you to that height.

[@NinjaMK]

Android version WHEN?

[@CapturingReality]

It is planned for next year.

[@NinjaMK]

@@CapturingReality Awesome, can't wait, thanks!

[@krisx2S]

Sadly no matter what i do, all the pictures i take fail to connect with each other and i don't know if my phone is missing some functions or there's something with the app :/

[@CapturingReality]

What is your overlap between the images? What kind of object are you trying to capture?

[@krisx2S]

@@CapturingReality first try i was trying to overlap like 30% of previous img. On my 2nd try i took picture right next to previous shot ... i had few other tries with different overlaps but never got a green frame. My first pic was a simple plate with a fork. 2nd one was an excercise tool that you squeeze in your hand - donno how it's called. The first one was in a rather bad lighting condition the 2nd one was quite well lit.

[@CapturingReality]

@@krisx2S How many images are you taking? Is there something written in the application? Can you try to capture shoe?

[@krisx2S]

@@CapturingReality Do You guys have discord server or something like that? I could drop some screenshots. I was doing something between 10-20 imgs. I can try with the shoe later.

[@CapturingReality]

@@krisx2S You can try Dev Community forum: dev.epicgames.com/community/

[@ahmadihsan5652]

1:15 how on seven dot icon in android?

[@CapturingReality]

Click on the Arrow, which is up in the centre of the application (next to Projects) and this will open the point cloud option for you.

[@ahmadihsan5652]

@@CapturingReality not work for me,, this icon hidden

[@CapturingReality]

@@ahmadihsan5652 Which version do you have installed? The icon isn't there at all? Do you see the Project and Gear icon?

[@przemysawdybilas7447]

Downloaded on android, photos are red no matter how many I take

[@emagotis]

This is not a offline program. Not a chance to pay for the data costs that this app needs, unfortunately.

[@jvanko89]

The app does work offline as well. There is a switch in the settings. Take photos offline with the position of the photos visible in the AR mode just minus the point cloud and mesh. Once you are on WIFI turn on online mode and process the data.

[@emagotis]

@@jvanko89 Not having the point cloud is a huge disadvantage. Without it you really can't see what angle should be shot again. I do shots with the normal camera app and just hope for the best when I import them to rc.

[@ThirdLife86]

@@emagotis Well, you can't have everything. 😬

[@emagotis]

@@ThirdLife86 yeah would be damn cool if it could do point cloud quality offline too. So this is for the wealthy countries only, or at least technology wise more advanced countries. We lack so much behind in telecommunications in Germany it's crazy.

[@kullenberg]

@@ThirdLife86 I'm confused, why can't the point cloud be stored locally in the app?

[@TechWizeGuy]

This app has a 2.3 rating...

[@ahsannazram9266]

No one cares about Android Users 🤭

[@CapturingReality]

We do care :) The Android version will be out next year.

[@pietromaximoff4365]

My phone is android🥲

[@jvanko89]

Don't worry :) Android will be available next year.

[@pietromaximoff4365]

@@jvanko89 i can't wait