3D Scanning from video with Reality Capture

[@toapyandfriends]

It's so perfect that you put the video of your shot right at the beginning so I knew I had a reference to go back to this video can be a real tool to me now 👨

[@ThaGuyWithCake]

It's always a treat to see a new video of yours on KZbin. Thanks for the content (And the idea) Phil!

[@3DJapan]

Thanks a lot!

[@Akuanite]

WOW. What makes you say this is not the best method for Reality Capture? Looks phenomenal and very quick.

[@3DJapan]

Because moving the camera while shooting will inevitably lead to blur from camera shake so it can't be as detailed as holding the camera still for each shot. Plus video isn't as high res as still photos anyway. This is very convenient though.

[@Akuanite]

@@3DJapan Good point about the motion blur. I will keep this in mind when doing a drone video for a scan. The result you got was jaw-dropping and SO quick. Thanks for posting this.

[@rogelioenns]

​@@Akuanite Hey. It's been a while since your last comment and I was wondering if you have now tried using a drone video for a scan? I want to do an aerial scan but I don't know if I should use photos or video

[@MarvelMaster]

This video actually made we wanna do that now

[@EdmundFaria]

So just do it instead of writing about this. Damn thats type of people irritates me so much. Everything for second of attention. Mr Phil - video is great and very educative. Sorry for this type of comment under your great tutoria.

[@CVEGeek]

Thanks for sharing. Really good quality software from the look of it.

[@NightDocs]

This is amazing

[@MADMOVIESINC]

Very helpful. Thanks a lot!

[@moodswingcafe]

Any Alignment Settings or Mesh Settings that I can use?

[@3DJapan]

@@moodswingcafe I don't think I did anything special. But I did film this 5 years ago. Hard to remember.

[@fxsrider]

That is freaking awesome!! I'm going to try that right now!!

[@jeanneduim]

hello if i want to have better 3d model quality do i need a lot of megapixels or a higher resolution ? please help me

[@3DJapan]

More pictures and closer up, as long as they're still in focus.

[@deeber35]

Is there a limit to the number of images for input? I have 3,000, but it seems to crash even below 1000 or so.

[@3DJapan]

@@deeber35 3000 does seem like a lot. I can't remember the numbers I've used off hand but I'm thinking more like a couple hundred. Why not just try it with some of your pics out of the whole batch and see what happens? It may depend on your computer too, like, more RAM more pics or something.

[@koikarppa]

This is so cool, have to try it out!

[@JB-yb4wn]

Hope you can get a line of credit with your bank, Reality Capture isn't cheap.

[@mwapedaka9677]

can you take multiple videos in a case of shooting a room

[@3DJapan]

It's possible. I haven't tried it.

[@sisosos7683]

This is cool ,Do u think it's possible to use videogrammetry technique for the indoor of archaeological building?

[@3DJapan]

I don't see why not, as long as the walls have texture to them. Either from being rough or having a color pattern like marble. It would be free to try it out.

[@Dongpham393]

I cant import video to that software at 1.0 beta , so how can i do that ?

[@3DJapan]

Make sure you have the latest version. I just drag an mp4 file into the program.

[@Dongpham393]

@@3DJapan thanks you

[@WhatTheRAF]

are you able to save these 3d scans to 3d printer files?

[@3DJapan]

Sure, any 3D scan will print. You just have to make sure it's water tight, no holes in the mesh. In this case I couldn't scan under the stump so there's a hole there and the software will have to fill it in.

[@cgrosbeck]

NICE!!!!!!! BUT try a car, boat, or plane. That stump has millions of unique points, vary easy for the software to track and recreate.

[@3DJapan]

I've done a car with this software, I used it in the video below. I did have to cover the car in dry shampoo, which just washed off with water but for the moment it looked like someone had spray painted all over it. lol kzbin.info/www/bejne/rXnZhoejrc93laM

[@chemistchemist228]

Can you do more tutorials like this one - how to 3D scan from video PLEASE? I checked youtube, this is very new feature and not very much good quality videos like your ones available - plus deeper and closer explanation of every step by step. Kind Regards!

[@chemistchemist228]

Can you make Normal maps, Albedo, displacement roughness etc., + making LOD's like LOD0, and export .FBX - from this video scan ready to import in Unreal Engine or Unity or any another modelling software for game development? if yes, - then please make anothe one tutorial how to from video!

[@chemistchemist228]

which one version of software are this one that provides video scanning?

[@3DJapan]

I'll see what I can do but my other tutorials cover just about everything Reality Capture can do.

[@KOKILAMusicClasses]

how to take photos continuesly in phone? explai.

[@techdiyer5290]

How do you do this in blender ?

[@3DJapan]

I don't use blender so I can't say.

[@vii1866]

With what Windows Machine do you work?

[@3DJapan]

My desktop is getting pretty old now. Here are the specs. Win10 x64, Core i7 3.4 GHz, GeForce GT 640, 16GB RAM

[@Sae-ez3dx]

Thanks for the video. When iam importing geometry to unreal appearing black triangles around mesh bump in the viewport. Only in the viewport with Lit mode. Mesh hasn't any issue in Unlit and mesh editor.

[@3DJapan]

I don't really know anything about Unreal. I did a tutorial on it like 10 years ago. Lol either way I generally wouldn't recommend loading scans directly into any animation project, let alone a game engine. I would recommend using a program like 3D-Coat or something else to retopologize it to a lower resolution.

[@Sae-ez3dx]

@@3DJapan Of course. I have passed through Houdini to lower polycount

[@jonathansgarden9128]

New sub! Simple video but it did the job, also this software is exciting.

[@3DJapan]

Glad you liked it. I have a new scanner video coming up soon. I might start filming today.

[@jatinoham]

This software is amazing thanks

[@Tymon0000]

$4000 for an unlimited license, WOW really nice result, better than meshroom

[@3DJapan]

Yeah it might be a good idea to plan out a bunch of things to scan then get one of the shorter licenses and do them all at once.

[@GiffysChannel]

don't worry, give it a few years and much cheaper software will be able to do the same thing.

[@3DJapan]

@@GiffysChannel Check my other videos and you'll see it can be done for free, just not as easily or as well.

[@GiffysChannel]

sweet, thanks

[@Akoayisangmanok]

I have it for free forever - RealityCapture.v1.0.3

[@the4hunters]

That was freaking awesome

[@StuartDesign]

Is it good for scanning people's heads, for example? What does the untextured mesh look like?

[@3DJapan]

I haven't tried scanning any people. I have some other videos of it on my channel where you can see it with no textures.

[@doaithanh336]

Could you tell me which version did you use

[@3DJapan]

I can't say exactly what version it was. But it was the latest version when I played the video a year ago, so you can definitely do it with the current version.

[@hyohyo78]

Really awesome thanks

[@kostasfassoulas6915]

Awesome! A question please: Since there is always a lens distortion, do you recommend undistorting the footage before?! Would that give better results? And could this avoid any errors when the object's edge in one frame becomes front part in the other frames? Should be worth the efford?! Thanx!

[@3DJapan]

Hmm. Well I've only done it with video this one time and it seemed to come out fine. I suppose if you figured out the size of your cameras sensor. You could probably add it to the database in Reality Capture. Honestly I've never bothered with that, even with my still cameras and my scans seem to come out fine.

[@kostasfassoulas6915]

@@3DJapan Thank you for your response!!

[@mikhaildakloteklevitch159]

That is helpful, thanks

[@3DJapan]

No prob!

how much does this software cost??

[@3DJapan]

It's free! Sort of. The software itself is free and you can use it for free, but you pay when you export your model. The amount basically depends on how many photos you use. Which is actually pretty nice because you can find out if your scan works well before you decide to pay and the price is quite cheap. Some of my scans are under a dollar.

[@devinda634]

super

[@gothmaniow]

could this work by having a fixed camera with a lazy susan style cake plate that you can revolve ??

[@3DJapan]

Maybe but you would need a way to move the lazy susan without getting your hand in the shot. You also wouldn't be able to get all of some detailed objects from one angle, even if it is rotating.

[@gothmaniow]

@@3DJapan how about a motorised revovling platform .??

[@CdoGtheGreat]

Wow this is an awesome video. I have a request, if 8n fact you do requests? 😀 could you do a video on creating a 3d model from old or low res ( 480p ) of loved ones who have passed ???

[@3DJapan]

Sorry I missed this comment. For one thing 480p may not work at all or might look awful. Secondly you'd have to have a video where they're not moving at all.

[@whaszup1]

😳😲 That's amazing!

[@rethonn]

Could you scan a head using a camera on a tripod and a green screen using video importing?

[@3DJapan]

You could do part of the head but the camera wouldn't be able to see everything like under the chin or on top of the head, unless you did multiple passes with different camera angles.

[@rethonn]

@@3DJapan Thanks , ill have somone to take the video for me

[@ExposedChannel247]

This software has come a long way in shortening the processing times. Pretty incredible. What are your PC specs, if you don't mind my asking?

[@3DJapan]

Here you go. Win 10 Home x64, Core i7 3.4 GHz, GeForce GT 640, 16GB RAM

[@DEARRAEDDEAR]

Is it a free software?

[@3DJapan]

The software is free but you pay per scan. It's actually very cheap though. Most scans are under a dollar (USD) and you only pay when you export so you can experiment and try scans out all you want for free. Only pay when you're really happy with the result.

[@DEARRAEDDEAR]

@@3DJapan Have you tried it to scan the inside of a warehouse?

[@dinkodumancic6410]

My reality capture cant recognize mp4 format. When i try to drag n drop mp4 into RC nothing happened

[@3DJapan]

The video option was available as of version 1.0.3.6310 so you need at least that one or higher.

[@chemistchemist228]

Awesome!!!

[@ypsonar]

Thanks sir . . .

[@oracleadmin10g]

Thanks for the video Phil. I would appreciate it if you could answer some questions for me. Could you use this to 3D print a model? If yes, then what would you have to do in order to make a 3D print out of a movie scene, let's say the village from Avatar? Can software generate the "other side" or do you have to have a 360 shot of the subject?

[@3DJapan]

Oh yeah, you would have to have full footage of the scene. It can only process what it can see. If you did have the full object scanned you could 3D print it but you would probably need another 3D program like LightWave or 3D-Coat for example to clean up the model. Closing holes, etc. I actually just did a 3D print of an object I scanned.

[@oracleadmin10g]

@@3DJapan Thanks for the response Phil. I've been watching videos and this looks like a great business opportunity. Am I being a noob or is there real opportunity here? How would you do it? Also, the rate at which printers are evolving, does it make sense to invest in a big 5 figure printer?

[@nicksonchang3301]

Cool I would like to use it for 3d print too. Video to 3d print such a good idea

[@jyothirevanna7931]

Is reality capture free??

[@3DJapan]

The software is free. You can use it as much as you want, but then you pay when you export your model. It's quite cheap though. My last scan used a lot of photos and cost about $1 USD.

[@jyothirevanna7931]

@@3DJapan thanks for your information ❤️

[@alexstark6511]

It requires a nvidia card in order to calculate de model . I don't have it ¬¬

[@3DJapan]

Does it? I didn't even know. I've always used nVidia because so many programs need it so I didn't even notice.

[@phat80]

Buy any used Nvidia card 770 or higher, it's cheap. I have 770 and still it works in all apps that use CUDA.

[@michael86734]

is the program for animation

[@3DJapan]

No it's for 3D scanning objects which you could use in other programs that do animation.

[@LoneKuroRaifu]

Still think this technology needs work. Keep trying to find a good source for taking 3d models from recorded games and making a 3d model of them using scanware

[@3DJapan]

I don't think a scan will ever be game ready with no post work involved.

[@AllyG1967]

this is ridiculous - amazing

[@flamescales7422]

What is your gpu

[@3DJapan]

I've answered with my specs a couple times now. Win 10 Home x64, Core i7 3.4 GHz, GeForce GT 640, 16GB RAM

[@flamescales7422]

@@3DJapan this software isn't gpu intensive? Cool

[@chokeslam1996]

Brilliant video dude! I will be giving this a try. I have one question about my current project. When I create a model it’s comes out perfectly in Reality Capture but it has too many triangles to use for mobile development (around 100k triangles). How can I reduce the amount of triangles and keep the quality? Keep up the great work!

[@3DJapan]

Glad you like it. There is a Simplify tool in the Process section of the Workflow tab. If you click that options will come up at the bottom of the left panel where you can choose the polygon count you want. Another option is to use another software to either decimate the mesh, basically the same as above, or to retopologize it. Which is adding new polygons on top of the high res mesh to replace it. I use 3D-Coat for those options.

[@SIHdW3W]

black magic

[@trgamer3193]

Wow

[@xO_oxDK]

Thats really amazing... but no reason it shouldnt work as well with video as with photos... its basically just 25 photos per second. All boils down to how well you handle the camera :D

[@3DJapan]

Yes, I usually use photos but it's nice to know that video is an option.

[@guritche]

The results are fantastic but the software price is prohibitive...

[@3DJapan]

I agree. They do have rental options at least.

[@Jimmy3dLLC]

$30 a month is too expensive??

[@LocalSlaveHolder]

Jimmy 3D LLC Element 3d Studios it’s actually €750/month

[@jvanko89]

@@LocalSlaveHolder There is a version on Steam for 37€ a month. It has some limitations.

[@dimasadityaparamartha5490]

hey, can we make a 3d print product from this ???

[@3DJapan]

Sorry for the late reply. You sure could print with it. You would just have to make sure the object has no holes. In the case of this video that would mean adding a bottom.

[@allenl9214]

Is it possible to create a textured human face model from a photograph or front profile view video?

[@3DJapan]

Not from a single photograph or single angle video.

[@KOKILAMusicClasses]

how to take photos continuesly in phone? explai.

[@jjanggyo]

Awesome!!!!!

[@KOKILAMusicClasses]

how to take photos continuesly in phone? explai.

[@3DJapan]

Well this is about shooting video. If you did want to shoot photos continuously you usually just hold the button down, but again that's not was this tutorial is about.

[@KOKILAMusicClasses]

how to take photos continuesly in phone? explai.