Hololens Plant Maintenance

[@theswedishgirl7400]

2:09 Yes that is how you repair stuff. Just move it from one hand to another behind your back

[@BEAppliedResearch]

:-) It made several people laugh. Of course that was not meant to be in the demo video, we left it there because it was funny...

[@keithjames753]

The Swedish Girl it was a demonstration.. jeesh..

[@erveygarcia4499]

Jajajaja so funny

[@dusterdude238]

WOW! awesome Technology. I like the way your App gives step by step instructions, with verification that each step has been completed. Maint. on high pressure Fluid / Gas lines could result in a Horrific result, if the person doing the Maint. was kind of forgetful, or just Tired , and they were trying to remove the pressure valve, and skipped a crucial step such as closing the supply line or evacuating the back pressure.

[@DrakeDark18]

You could definately change reality per your desire without necessarily understanding what you were doing. At least with the assistance of the machine designed to help maintenance conduct their duties.

[@bhavanis7082]

Hi . Whether we should go for spatial mapping to render the full enviroinment ?. can you please tell me process of doing this. Because this is the solution which i am looking for and also i am very new to unity3d and hololens. Help me please

[@TheGeckoNinja]

starting to think this holo info for workers will be used for when robots take over these jobs, cause all he did was turn some valves and replace a piece, something i see robots being able to do in seconds

[@BEAppliedResearch]

Interesting. This video shows a typical maintenance task - such tasks are known, well described, and could indeed eventually be achieved by an automated system. Augmented reality assistance will likely prove much more valuable when assisting users who need to fix a problem for which no solution is currently known (see our other video kzbin.info/www/bejne/oorTpZ-XhJ6lgdk ) and for which an automated robot would be useless.

[@kawo666]

I think you are right. AR is currently being used to aid the human user and meanwhile location and mapping technology evolves. Once the space context is conquered, the robots can take over. And it does not matter that circumstances may be not pre-determined. Machine learning will deal with that.

[@standardloginname]

Robots are pricey and can't handle unexpected situations. For $3k you get to turn a human into a slow robot that handles it's own maintenance and transit, does the work and takes pay weeks after the task is completed

[@1HololensfansOfNaruto]

are you using markers? just how can hololens detetcs those parts this precisely.

[@BEAppliedResearch]

Very good question. The answer is: no, we are not using markers. The HoloLens is very good at calculating its own position in real time, so no marker is needed for tracking. But then we need to know where to display the augmentations w/r to the pipes. To achieve that, we start with a 3D model of the pipe setup, or a 3D mesh, and the first phase of the augmentation session consists of "aligning" the 3D model with the physical pipe setup. That quick setup step needs to be done only once, since the HoloLens can "remember" rooms it has been in. Therefore subsequent augmentation sessions can automatically re-use the alignment that was done the first time, and still display the augmentations at the right place.

[@1HololensfansOfNaruto]

actually I have not seen this precison yet in other apps yet. the most precised I have seen yet is Lowe's kitchen app and they also used markers for the first use. it is quite brilliant you have achieved it.

[@KymDupuis]

ok so you have to have a library of setups, align them and then start the workorder?

[@BEAppliedResearch]

What do you mean by "library of setups"?

[@KymDupuis]

If I get this right, I have to load the pipe and valve setup and align it with my Hololens with the one I see before starting the maintenance. If I manage a number of installations / setups in my facility, I need to store them somewhere so I can load them when I get in front. Do you use a file system or something like a QR code to load the right one before a maintenance?

[@animalmother4]

is this vuforia sdk or homebuilt with unity?

[@BEAppliedResearch]

We did not use other SDKs for tracking or augmentation - only Unity for the display, and HoloLens for tracking, voice recognition, and hand interaction.

[@animalmother4]

Great job!

[@chisomoandrewmbeza4355]

wow that is impressive to do this with no sdk at all, an chance you could point me in the right direction to start learning how to do that?

[@chisomoandrewmbeza4355]

Thank you!!

[@ovb7]

But how is the manual calibration working? Just dragging the virtual model on top of the real model without recognition? Seems like not accurate enough...

[@sooyeonjung527]

Video 에서 보이는 것은 굉장히 단순하고 실제 설비는 정말 종류가... 엄청 다양한데 부품단위로 Control하는 방법을 저장하면 좀 자동으로 합쳐저서 메뉴얼이 완성되었으면 좋겠다. 그런 SW Tool 을 좀 개발해줘요 ..

[@futuristicentity2417]

Never made it to the price it promised another failed device only for the rich kids....

[@lwisromero1392]

too far away from the reality.

[@djtaylor74]

With this technology, we have to start somewhere to allow us to understand the challenges we'll face in the real world. Sometimes it can look basic, but even basic activity can determine what is necessary to enhance the solution.