Ubisoft CandyShop Days 2019 - Photogrammetry use in PBR Material Creation

#photogrammetry #ubisoft #talk #pbr #presentation #scanning
Each year Ubisoft holds a company event dedicated to Material Art and our internal library tool, CandyShop.
In 2019 I was invited to Montpelier to be a part of it and had a privilege to give a talk about basics of reality capture and photogrammetry workflow.
Ubisoft has been kind enough to let me share it publicly with the community and here it is.
Since the time this presentation has happened I have learnt a few more things.
- So I said that metal is black and we can see it when we use crosspolarisation which isnt true. We see it black as we just cut all reflected light with crosspolarisation so we cant see it and metal surface just appears black.
- I used to fix image geometry with the photo editing software which is a mistake. I dont do this anymore.
- Since version 1.6 of Metashape I dont use dense cloud based reconstruction anymore. I use depth maps which are quicker and doesnt need supercomputer.
So I would encourage you to watch my other videos as I learn new things all the time and I do my best to share all my findings.
I hope you enjoy the presentation and find something useful in here.
Big thanks to everyone who helped me with this presentation and to all of you for watching.
Grzegorz Baran

[@plog1805]

You are very wise. Great video. Your workflow is very thorough. A photography turntable could make life easier for the automatic capture portion. Keep up the great work 👍🏻🥇

[@GrzegorzBaranArt]

Thanks Ryan :)

[@iTeleport3D]

Man, what a class, you're the best! Crash course on materials digitization

[@GrzegorzBaranArt]

Thanks :)

[@cescmassanas9835]

Amazing presentation Grzegorz! I can't remember many sources as complete as what you're giving away here. Thanks a lot!

[@GrzegorzBaranArt]

Thank you veeery much :). Really happy to hear that.

[@user-lc3uy7lq5k]

Thank you.

[@Rikwooviz]

Thanks Grzegorz! Amazing stuff as always!

[@GrzegorzBaranArt]

Thanks Riccardo :), appreciated

[@mustafaaltan4501]

Thanks for sharing! :) Thank you so much. I got very good information.

[@GrzegorzBaranArt]

You are welcome :), glad to hear that

[@DanMcLaughlin]

Fantastic talk! Thanks so much for all your videos, please keep them coming. I also enjoy doing this kind of material creating and am really learning how to do it from your videos here.

[@GrzegorzBaranArt]

Thank you Dan, I am really happy to know you have found my videos useful

[@Capitan_muskato]

All this information is pure gold! Thank you very much!

[@GrzegorzBaranArt]

You are welcome :) Cheers!

[@KyleHorwood]

Great video Grzegorz. Thanks for the mention too. I remember when you asked me about that material!

[@GrzegorzBaranArt]

Hey Kyle, good to hear from you mate :).. almost everyone during this talk thought its a scan :) so it was an amazingly well and fast made material... super impressive.. and big thanks for sharing the info with me and for watching this video

[@kirkr]

Thanks for sharing Grzegorz , always enjoyed your videos. Very useful knowledge.

[@GrzegorzBaranArt]

Thanks Kirk, I am always super happy to know when someone finds what I share useful. Cheers!

[@Barnyz]

Very cool to see this again, thanks for sharing!

[@GrzegorzBaranArt]

Thanks Barny :)

[@UnrealVirtualUniversity]

Thanks for existing

[@GrzegorzBaranArt]

Thank you very much for such nice words. Cheers!

[@UnrealVirtualUniversity]

@@GrzegorzBaranArt No, seriously. The stuff you teach about is kind of hidden and poorly explained. Been somebody dreaming about working in big CGI projects finding that I already own most of the equipment and thanks to you a deeper knowledge is really something.

[@mikegentile13]

This was a great presentation! Thanks! I've watched it at 1.5 speed because i can't get this kind of information fast enough! I really like your tricks, workflow and outlook. We have to know the tools and choose the best one for the job. Thanks!.

[@GrzegorzBaranArt]

Thanks Mike, I am really happy to hear that especually that I put really a lot of effort to make this one informative and interesting :). Also I am very happy you got the final message :D. Cheers!!!

[@FelipeTorrents]

Thank you for sharing! I'm getting started in photogrammetry and is surprisingly difficult to find concise information based on professional experience.

[@GrzegorzBaranArt]

Thanks and you are welcome. Feel free to browse my other videos to get even more photogrammetry info or check material section on my arstation profile where I present capture details for almost each material: www.artstation.com/gbaran/albums/86576 Cheers!

[@hamzarhett6942]

dunno if anyone gives a damn but if you are stoned like me atm you can watch pretty much all the new movies on InstaFlixxer. I've been watching with my brother lately :)

[@forestandres5118]

@Hamza Rhett Yup, I've been watching on instaflixxer for since november myself :D

[@RGaB7]

Nice presentation, it was really informative thank you !

[@GrzegorzBaranArt]

Thanks Gabriel, I am really glad you found it helpful :)

[@spamone]

Thanks for sharing your knowledge Grzegorz 👌

[@GrzegorzBaranArt]

You are welcome, I hope you have found something interesting in this one :)

[@mishatokov4610]

Huge thanks!

[@GrzegorzBaranArt]

You are welcome. Hope you found something useful in this video :)

[@dvogiatzis]

Great video!

[@GrzegorzBaranArt]

Thanks Dimitrios, appreciated

[@dainjah]

Dziękować :>

[@GrzegorzBaranArt]

Np :)

[@vrguytokyo]

Brother... I am so glad I happened upon your channel! Without even realizing it watching your polarization video (suggested on William Faucher's channel...) I'm thinking you are one my leading sources of inspiration doing photogrammetry in the first place since a few years ago! TBH... Ive been very failure shy and have done nothing but research (and playing with the odd app netting soso results but nothing remotely close to what I hoped to do) ..waiting ... I don't know what for... maybe procrastinating .. but I wanted to know I could create the best works possible. My dream for over 2 decades has been to get into game dev and lately VR environment design.. Kinda think Im too old for all that now but still obsessed and even spent a wack load of coin on a decent laptop I hope can handle it all.. I've been also been a huge fan of Ubisoft (back in day RSE as well) FPS and ..no lie... would wander around maps just looking at and appreciating/admiring every spec of attention to detail offered (ESPECIALLY the assets!!) !! I was away from gaming for over 15 years when the company started putting more attention on console and I shortly thereafter switched to mac BUT... As mentioning above with new laptop.. well.. it's obviously a PC... What's one of the first things I did? Head over to ubisoft and bought several games! haha NOW.. Im even more obsessed with the environments and am completely dumbfounded at how much work went into them ..with DIV2 being completely off the charts. I won't join any clans because, as much as I have a few buds I like to play with .. I prefer just wandering around solo! I just want to say something in particular in my case.. Some may think Im too old for gaming and I even get the odd sorta laugh when I say I still dream of getting into GameDev.. I have mobility issues and, for one... some of these games allow me to play/compete on the same level as everyone else but I can also ..simply... wander around, climb, jump, swim... whatever! Things I cant easily (or at all) do in real life! The more realistic the environment.. the higher level of immersion/experience! I simply want to give others that truer sense and it's ALL in the details! Going to study all you have graciously shared!

[@GrzegorzBaranArt]

You are never too old or not good enough for anything man.. its a mental trap many falls into. I suggest to ask yourself what you wanna do in your life. .set it as your target and simply.. move towards it until it happens. It might take years, you will fail many times for sure, and get frustrated, and nothing will be as you imagined.. but if you will be patient enough and dont give up, you will get there. Trust me! Its not the matter of 'if' but 'when'. Just dont give up. From my experience I can tell you that the harder and most frustrating it gets .. the closer you usually are to the next big level up. Bear in mind there are many steps and after one hill there are another ones.. but as long you know what excatly you want.. you just can fail :D. So don't live surrounded with excuses but go for it as you have nothing to lose really :) Good luck and trust me.. in most cases, the only difference between these who are where they wanted to be in their lifes to those who are not.. is the the first group didnt give up when it was hard and they struggled and just kept moving forward.

[@TheSatzy6699]

Excellent 👌

[@GrzegorzBaranArt]

Thanks a lot 😊

[@astridrotelli4918]

thanks Grzegorz !

[@GrzegorzBaranArt]

No probs, anytime :)

[@zhouyu7734]

good job

[@GrzegorzBaranArt]

Thanks

[@edgeextrude]

Awesome man, so when do we get to control the weather again? ;)

[@GrzegorzBaranArt]

Cheers! Very soon ;P

[@kilbeeu]

and how about a drone with external camera mounted? maybe such combination would give better quality\price ratio?

[@GrzegorzBaranArt]

This is solution known for a while, to do this you usually use quadcopter as it is strong enough to handle standard camera with heavy lens. But with this approach you often need a co-pilot to control the camera while you fly the drone. Its a bit old solution but I believe is commonly used in movie industry. For photogrammetry seems to be a bit too expensive. Imo new drones evolved from this approach. Mavic 2 Pro is a compromise where we get a very mobile and easy to carry drone with integrated but a bit crappy camera as it has small sensor and plastic fixed lens. Fortunatelly there is a bit more expensive and heavier drone with integrated camera. It is Inspire 2. It has way better Zenmus camera with glass lenses and option to switch them. Unfortunatelly it is more expensive and way heavier to M2P and needs way more space to be carried. Since camera is integrated with a drone, its still quite easy to control by the single operator while flying at the same time. So there are options to consider and you need to pick the right one for the job. I think Inspire is a great one but if you plan to carry full photogrammetry equipment with yourself and hike a lot.. it might be too much to carry. But everything always depends on the kind of job you have to do.. I believe that heavy, good camera with heavy good lens mounted on a big quadcopter controlled by two operators should give you way better results to what you get with Mavic2Pro or Inspire2.. but sometimes you dont need it especially that often its enough to take a few more pictures to comensate the resolution difference.. and .. for photogrammetry.. amount images is more important that their resolution as it gives more height data for reconstrucion. Of course.. as long images are sharp enough. Hope that makes sense :). Cheers!

[@kilbeeu]

@@GrzegorzBaranArt makes a lot of sense, especially part with taking more images to compensate for lower resolution images with a benefit of more height data - i dont know why it never occured to me. m2p i assume outputs raw with full manual control then? how does operating camera settings and controlling a drone at the same time look then? ive been playing around with photogrammetry, but never actually tried with drones, since as you know probably better than me - its quite expensive ;) something i'd like to explore though.

[@Sylwester-Sajdak]

Czy średni format nadaje się do fotogrametrii na zewnątrz np Fujifilm GFX100.

[@GrzegorzBaranArt]

Moim zdaniem nadaje sie tak samo jak kazdy aparat. Pelny rozmiar zdjec moze byc natomiast waskim gardlem ze zgledu na ilosc danych do przeliczenia i moze wymagac poteznej maszyny z ogromna iloscia RAM. Nic nie stoi jednak na przeszkodzie zeby pstrykac w mniejszej rozdzielczosci albo zrobic downsize zdjec. Dla photogrammetrii wieksze znaczenie ma ilosc zdjec i zakres pokrycia obiektu i overlapping pomiedzy zdjeciami niz sama ich rozdzielczosc. Mysle ze 24Mpx to standard i jest zupelnie wystarczajace, wiecej dac moze dobry obiektyw niz sam aparat poniewaz kluczowe znaczenie ma jakosc zdjec. Wieksza matryca pozwala oczywiscie na lepsze zdjecia ale mysel ze cena aparatu nie przeklada sie wprost proporcjonalnie na jakosc rekonstrukcji. Wiec lepiej pstryknac wiecej zdjec tanszym aparatem z lepszym obiektywem w mniejszej rozdzielczosci. Jedyny przypadek kiedy ten aparat ma sens jest pstrykanie jakims bardzo szerokokatnym obiektywem i gdy problem mocy obliczeniowej komputera i czas rekonstrukcji nie jest problemem.

[@RokasKontvainis]

Great video,Thanks. Can You share how did You equalize lighting across multiple photos with DxO as in 43:41 kzbin.info/www/bejne/j4ite5inpMmKr9k

[@GrzegorzBaranArt]

Sure I covered it in my ebook :) page 83, 84 and 85. Basically its Auto Tone for Lightroom or 'Dx0 Smart Lighting' with the Dx0. I am still experimenting with this tho as it might be beneficial to simply equalise it on final texture or.. find a nice balance between before and after adjustments. Hope that helps :). Cheers!