Hands-On with Lightform Projection Mapping!

[@Benamax]

For those curious, it's $699.99 for the Lightform LF1, and $1499.99 for a bundle kit that includes the Lightform LF1, a 1080p projector, and some other things like a tripod.

[@Rejinx]

That is a great price point for small business commercial use.

[@jmalmsten]

I'm guessing that if you get the free version of the software (which they keep talking about) and use your own webcam and projector and computer to drive the software this could be very cheap :)

[@AlrezUno]

I want!

[@ryanizer11]

Rejinx during the night time have it project a advertisement/logo onto a big glass window on the store front

[@ryanizer11]

Could be great for a amusement park or anything like that

[@geoffreyschuchardt5350]

I love how the tested person presses for tech details really respectfully. It makes sense the person from light form wants to talk in plain terms but I’m sure others agree it’s really appreciated seeing the specific nuances

[@rmd6502]

I'd love to see medical uses for this - a surgeon could see an xray or MRI superimposed on the body, so they could see exactly what's underneath before making incisions. Blood work and other scans could automatically update colors as they work.

[@plk5520]

This is without a doubt one of the coolest things I've ever seen.

[@hellohogo]

Really want to see this upgraded to incorporate real time tracking for moving subjects

[@UkrainianBazooka]

You should check out the video Box on the channel Creators, it's made by Bot & Dolly. It's not quite RTT, but a very well choreographed video.

[@95TurboSol]

Dang, wish I had this when I was a kid, I could make the floor truly Lava!

[@DowzerWTP72]

95TurboSol Apart from directly below you! Although the top of your head would be lava in that instance.

[@fontirolo]

Even better, you can do it now as an adult!

[@jmchez]

I can imagine presentations and instructional activities, once it becomes truly real-time interactive. Projection on white globes could be used to display geographical or planetary information. Projection on blank human figures could show anatomical details; a larger than life torso could show an operation with depth of field as opposed to flat video imaging. Architects could project renderings of a finished space on an empty room or large space. This will only get better.

[@bradleyj.fortner2203]

To what end though? "Projection on white globes could be used to display geographical or planetary information." That's essentially an inverted planetarium. Those have been around for decades now. Operating Rooms have observatories for teaching, and any projector "could project renderings of a finished space on an empty room or large space". The only practical use for this tech is to make a store's sign more eye-catching, and Amazon is killing the retail store. It could do some cool shit in a nightclub too I guess. But I don't see this taking off. I wouldn't have a use for it in my home.

[@FinalFr0ntier]

It's used extensively in artistic fields

[@REDxFROG]

It has already gotten better using HTC Vive tracking.... kzbin.info/www/bejne/aJjOmpd5a82Hors

[@saagarraavi5236]

Sometimes I just can't come to grips with the world we live in and am left in awe. This is absolutely incredible.

[@TheNewBloodDan]

5:10 His head says no, but his mouth says yes...

[@ReallyWemja]

Yea I noticed too.I guess they are not there yet but hope to be there in the future?

[@saccers]

his mouth says yep*

[@RFC3514]

His head is right, his mouth tried to dodge and spin it. Like he mentioned before, it works with "normal throw" projectors, so anything that is too wide won't work at all, and anything that is too narrow will have low resolution. Professional versions of this kind of system generally decouple the projector(s) from the camera(s); they construct a 3D model of the scene (from multiple cameras and / or LIDAR data), then you select which image you want to appear flat from where (i.e., you define the intended viewer position), and it calculates the deformations necessary for each projector. This means the projectors and cameras can have any focal distance and don't need to be at the same location; if there's no coverage you simply add another camera. Here, you are limited by the camera they chose to use and by its fixed position relative to the projector.

[@Damstraight68]

.... Norm is just straying from the use case which he is unable to respond too without being like, dude I just told you it has to be mounted on a projector. He never even says yes, he just goes back to the topic at hand. He needs more practice in peopling for sure.

[@adamdecoder1]

Despite that glitch, robots have still come insanely far. I think in a few more years this android model will pass the Turing test.

[@JohnMureen]

David would be proud now all he needs is tilt shift and deep learning! This is so cool!!!

[@DrAnim8]

We already pre-ordered the Lightform complete kit a few weeks ago and can't wait to get our hands on it (Have to wait until Nov 2018)... Now , gotta have the Zorg ZF-1.

[@jvanness90]

I don’t see many consumers adopting this, but I think we’ll see big companies using this in really innovative ways

[@Temp0raryName]

Incredible. Tested is keeping us up close and personal with a lot of cutting edge stuff. More please, more!

[@sterlingteaches]

This makes light mapping so much easier. I can't wait to get my hands on one of these to enhance my technology classroom. Thanks for the video showing the great light mapping technology.

[@cook13snip3aa]

As someone who is studying projection mapping its interesting to see where the industry is headed and I'm terrified that with this product, my job will become obselete. :/ curious to see how it handles curved and complex-curved objects.

[@mediagiant1]

your job is safe. no "pros" will use this. this is no match for D3, VYV ect.

[@joshkar24]

can't wait to see this combined with eye/head tracking via ar glasses so that the projections can be in response to where you look, and perhaps the projector/sensor array being worn. Saw some research being done along these lines years ago, not sure where it is now. This would enable high resolution graphical overlays that are shared between the user of the AR system and bystanders, while having the lenses/LCD displays flipped up or somehow removed from the users line of sight, allowing a clear view --- as needed. The user could then flip the displays down and have the projector turn off, while having graphics (of a lower resolution) overlayed as in a traditional AR system. XR (extended reality) I guess is the class of device this would be.

[@thanksfernuthin]

Processing is the same whether you are dealing with a 1 foot cube or a large building. The 1080p projector is the limit. Same number of pixels for both. It's just that the graphics will be really chunky on the massive target.

[@Hector-Ramos]

You can see a projection mapping performance every Tuesday around 8:40 pm in downtown Redwood City at the Courthouse Square. Excited to see this tech in consumer hands.

[@vizon-aryproductions6191]

For my job I have to use multiple projectors to create 4-5th dimension simulation with projection mapping , and you can loop gifs onto the objects that are scanned that creates awesome effects

[@jim1550]

Wow! That subpixel accuracy is bananas.

[@joelface]

real-time projection mapping with automated edge-detection, etc. will be game changing for this tech.

[@RFC3514]

I did not see them select the viewer position at any point, so it looks like this doesn't compensate for actual curvature and 3D shape, it's just a masking system for procedural effects, and they don't even trust the automatic masks (he did the gun totally by hand), which makes it very "meh". Everything it does can be done easily and interactively by hand (I've done it myself for several live shows, drawing the masks and effects while seeing them being projected, which is much more accurate - I _did_ have to render the effects as movies, but once that is done you can play them off sub-$50 hardware, no need to leave a $700 device connected to each projector in the show). It doesn't even seem to have any sensor inputs to change the effect based on external events (like people stopping in front of it, or objects being moved), so being able to render the effects in real time is kind of pointless. It's effectively just recalculating the same frames over and over. Waste of power. I guess this might find a market in shop displays, but it's not powerful enough for professional installations (also, the cost scales very badly with multiple projectors, since they expect you to have one per projector, whereas other systems use a few Kinects or webcams to cover the whole scene, and can then control dozens of projectors) and it's kind of pointless for home use.

[@MarcusHast]

It seems like they have spent more time getting the web frontend working rather than the actual computer vision stuff. It really should be possible to get a much better masking direct from the device. It may depend a bit on the scene though. Putting an arbitrarily shaped object on a shelf close to the wall is kind of a hard case to detect if you have limited depth resolution. It will be hard to get good detection of the edges of the object as they blend into the wall.

[@ahigherorderofart]

Could you share the other systems that use kinects or webcams to cover the whole scene?

[@Blazerfan11]

i also would like to know how this can be done more cheaply. I don't mind spending the time to manually set up the mask. What is the equipment and procedure?

[@minibigs5259]

Extremely cool. Spoiled by him using his buzz words like compelling and Magic. Save that for wholesalers, retailers or press releases so it makes them look stupid instead of the creators.

[@yashicat5950]

Photography and film are always linked to magic tricks. It's the roots of it.

[@SwoleKitchen]

The prices seem a little steep, but I’m absolutely in love with the software and hardware and would love to get my hands on even in lx 1

[@ElectraFlarefire]

"Permanent onboard storage. Unlike an SD card that can fail over time.".. Only has the onboard storage that can fail over time then? And unable to be replaced.

[@chrismofer]

go look at people saying "what's wrong with the raspberry pi" and you'll notice the SD card is a big gripe. people with it was more reliable on-board storage. You're still connecting to the thing with a cable regardless.

[@eleones]

This is BEYOND awesome! Lots of great possibilities for marketing, special events, DJs, weddings, AV gaming, etc. Great price point too!!!

[@kadeemeiland]

yep.

[@christopherho9956]

Nothing goes better w/ tested than a cup of Joe and morning blue summer skies

[@iShockGamers]

This is so cool! Cant wait to see where this technology goes. Great job Lightform!

[@AJDOLDCHANNELARCHIVE]

Very cool, I've been interested in projection mapping for live music applications for a few years, but it always seemed very complex or expensive, will definitely look into buying one of these Lightform devices!

[@chevydew69]

Wow this is amazing! !! The possibility for retail application is mind blowing, you could grab the attention of people with this and boost your sales. Or attract attention to a car in a car show, and have everybody looking at your display to the exclusion of all others.

[@veggiet2009]

I hope that there will be live tracking marker support soon, so that say you have a picture frame on a stage, and you could put your power point on that picture frame, and while you are delivering a talk you could pick up that frame and walk around and still change your slides... for example, I could see other uses for 3D objects and props that you could use in a live show if they could be trackable.

[@nathanchaney86]

It appears that lightform is closing shop. Just came across this video three years later and was hoping their solution had improved.

[@leepalmer373]

I love theses shows, and they are free.

[@ProsandCons106]

I just got one, i can't wait to use & review. thanks for your video

[@corygoodale9768]

Receive it yet?

[@entrepreneur724]

Why are we hand mapping with a pen tool? I thought the entire point of Lightform was to have it done automatically. What am I missing?

[@marceli-wac]

There's still depth information that you can use to apply the shaders to, even when you adjust the map manually.

[@heartbreaktimemachine]

This is crazy awesome could use this in music shows

[@notahotshot]

It's amazing how many comments have been made about how this can be done easily by, coders, hardware gurus, undergraduates. What about, soccer moms, waiters, ditch diggers, and junior high art students? Everything is easy for experts in the field. This device trades complex features for ease of setup and use. In other words, as stated in the video, it makes it accessible to the average person. I. Fucking. Hate. Cynics.

[@hund4440]

Its not exactly rocket science to do this, and they are charging 799 for a device which's harware is less powerful than a phone. And they are calling it magic and shit

[@EmBoLabe]

@2:53 that Las vegas sign is amazing

[@smherczeg]

Looks awesome! You should put the link to their website in the description

[@lukebrown6913]

Why can't you use virtual desk top on this device, same as Oculus vr headset...both use mobile chips etc?

[@KnightsWithoutATable]

This tech is very interesting. I could see adapting it to taking scans of objects and producing 3d maps of them. I could also see tech like this used in robotic vision to replace things like LIDAR, if you could speed up the process and switch to using dual cameras instead of the projector system. Maybe use a near IR projector and camera paired with a pair of visual spectrum cameras so that the robot can see different colors and has a map of the 3d space to work with for planning movement. Very cool tech. This does have a little feel of being an ad, but the tech is unique enough that it is also interesting.

[@MasterCreatorsStudio]

LIVE FOREVER AS YOU ARE NOW!

[@fabiocatapano9570]

With MadMapper and a Camera is possible to achieve the same thing since 2011ish

[@bleckybob]

It must be such a burden being as cool as you

[@Dragn7]

You could also have interactivity based on events rather than physical input. For example, rather than having a dial that changes the speed of an animation or changing color, you could have a change happen when you get an email, text, reminder, or something else. Or different animations altogether to indicate various real-world events. Pretty cool!

[@dougherbert8880]

Like all things tech, there is a place and an application for this. Yes it is low rez, and yes there seems to be plenty of hand work to address mapping, but it does capture some depth information in the scanning according to the Lightform rep. That speaks to potential as it evolves. He also mentioned the availability of warping grids for pre-distortion on complex surfaces. Something more advanced (expensive) existing solutions of course do now... but for $699, it has its place. 1) Don't overlook the fact that there is no such thing as projecting black... so there will be an additive amount of light outside of the areas masked and projected that will show the extents of the projector, regardless of what is used. 2) Closer the projector is to the receiving surface the better the results too I would imagine, as you would be using more of the available resolution of the projector. Ideally the extents of the projector should be coincident with the boundaries of your receiving surface, otherwise you are loosing resolution. Thanks for sharing this overview, looks fun!

[@AmazingSpiderRanger]

This technology could be used to project any fantasy into a white Zentai suit. That could be used in a special place for games in augmented reality, escape rooms, etc.

[@nopparuj]

Tiago Oliveira this will not work since it is not realtime scanning a small movement will cause every masking to unmatch. This only work with infrared realtime scanner.

[@rahulmaron]

this is the coolest gadget i have ever seen.

[@clutchyfinger]

It's 2018 and Jamie Heynaman still doesn't have a channel following the raising of small birds in his mustache called "Nested"

[@lebaohuongtran5762]

or a finance advising channel called "Invested"

[@brooks3racing1]

The bird is the word.

[@saken]

Interesting video, thanks! This guy named Maxin10sity has done some astounding visualizations, projected onto large buildings.

[@dpqbpqbdpqbpqb4754]

So I think his answer is wrong @4:07 This system is not stereo (stereovision), and further, this system does NOT collect depth information. They dont care how far away anything is. They just need to know where the projectors pixels land on the real world, from the cameras perspective. Mic drop.

[@CrusoInc]

does the Lightform works on any projectors? I'm looking for a solution for outdoor projection for a building, what projector does the Lightform work on and what projector do you recommend for outdoor projection

[@SinanAkkoyun]

I wish I would be a team member of Tested, I would gain so much knowledge

[@1982pantro]

I LOVE THE INSERT COIN SHIRT. AWESOME VIDEO TOO,BIG FAN.

[@als_pals]

I would love to see this for menus in shops or more practical uses

[@NebMotion]

This looks amazing! will be buying it one day certainly

[@LeonTrimble]

madmapper has had the scan capability since version 1.0 - with a canon dslr

[@silverstone78]

I am very excited about this tech.

[@Peluche070]

oh man VFX artists have been doing this since 2002 its soo easy!

[@DrTune]

that's really pretty fucking good. With all the lighting on this video shoot it looks ok but not so 'wow', but you know that's gonna look great at night in a store window or whatever

[@iHenryD]

Very cool. Would like to see this in a theatrical application!

[@UnrealVideoDuke]

For those curious, you could probably do the same thing with a RPi and a 1080p webcam paired with a projector. Good Luck!

[@jonocarey]

Expand on this please?

[@EdvardHansson]

its called spatial scanning, the software madmapper has it for example, useable with any canon dslr and any projector.

[@jamesstanley272]

Actually, the scanning of lightform is not used to get an auto mapping. You have to draw each point of your object...

[@rjnash2610]

WOW... just wow... The world will soon start to become slightly more beautiful.

[@lusenator]

I’m surprised they aren’t trying to integrate this with after effects or c4d somehow? I’m an animator and that’s a major major deal breaker Maybe they are and I missed it?

[@hellothango]

Yeah, or make it possible to export scanned objects and import animations or even particles. Maybe it’s possible, but it’s probably limited because they do it with shaders?

[@SThompsonRAMM_1203]

Ryan Luse , that’s exactly why I watched the video. I want to map my house and love the way this maps but want to use my After Effects, Photoshop, and Cinema 4D content. Maybe you can but would love to see the integration.

[@HolyManta]

This thing is awesome! and very good vid on it, I understand how it works and what it can do, thanks Tested!

[@UndercoverFerret404]

How's the bulb life? Would suck having to replace the bulb a couple of times a year.

[@jeromevet007]

very cool , but what about burn-in. the projector is only using a concentrated part of the beamer. wont this lower the projectors life a lot , also seeing that most effects are quite bright. seems a more appropriate technique for laser projectors.

[@christopherpappas7474]

Holy buckets of flaming shit balls Bat Man I want one right now!

[@loomish]

That's one hell of a comment! I love it !

[@jacobdavidcunningham1440]

16:28 dude... like have it read you hand so you can scroll the feed up and down too, allowing people to interact with it, neat... old tech though the sixth sense guy wearing the projector around his necklace

[@photobro]

Can I use a different projector? I'm assuming you may as long as it has the right inputs/outputs etc. But I'd like to use a smaller one to project onto smaller areas. Thanks for the info!

[@Aiello_]

this is awesome! i already know what I would use for!

[@nikitaredko2348]

Late to this party ... aside from the bigger nut to crack - "tracking moving objects"( mentioned in video ) this needs precision (4k, 8k...) and most importantly real world input - this means when I put my finger on a real physical object(or special laser pointer type device) it should scan back to software and allow me to only work in 3d and minimal to no computer screen etc. Use case for me would be in construction : projecting stuff for customers or management etc. Could be used as multiple laser levels , map multiple holes for drilling (as opposed to lifting a cupboard in place to mark holes for drilling).

[@leeroyescu]

23:27 _affect... the effect_ Only old people still know the difference...

[@imalover4011]

Constructively, informative.

[@ffaf0777]

can you export scans as .obj or similar file type?

[@azyryn598]

Does anyone know if you can work on a scene collaboratively across devices? Looking at the feasibility of incorporating it into a new media art course for my students.... --Thinking project one big scene and have kids each have a shadow box they made up on the wall to project to. So one project file but could the kids work on designing their own animation.... Can this work?

[@rhomoreno2564]

this was pretty awesome

[@wingowingo2928]

Can the system render a video file and let the project to display the pre-made effect WITHOUT the Lightform still attached?

[@tysongersh2289]

Can the scans be exported into an editable 3D model for something like SketchUp?

[@hund4440]

Like whats the point of sketchup just use blender lmao

[@ThePandaKingFTW]

Whats the point of the depth perception if you're going to mask it by hand anyway? I feel like you could do the same thing with a camera on the projector and that software

[@drumr828]

this is too cool!

[@gavinsmiyh6218]

The future is coming!

[@denverintranslation]

Dude answers every question by first saying "Yep" For example: Norm: "Where are you guys at in terms of the software and also the hardware?" Lightform guy: "Yep. So we launched three weeks ago..."

[@TomaszSky]

Mark Thomas Yep. The other guy says “Correct” - so what happens when you move objects? - Correct. You have to redraw it.

[@matthewcoleman8267]

I have no need for one of these but I want one desperately!

[@shimlaDnB]

what if i want to write my own shaders, or use the mapping in resolume?

[@jamesstanley272]

HeavyM, Madmapper can do it right now :)

[@Yourfinaltragedy]

I need this for my acid/shrooms trips.

[@pixelasm]

Interesting tool, wonder if they are able to export any file formate usable for After Effects like a depth map or the setup vector masks.

[@Drewsarchus]

Does this allow for real-time interactions with bodies? Say a person moving in front of an interactive wall?

[@raphaelwedd6204]

So, can Lightform track and project onto moving objects or only stationary ones? It would be cool if it did.

[@greekgh0st]

hello, nice video what projector they are use? how many lumen? Thank you

[@twitte0king]

Oh my god the last bit with the laser cut globe! Its like dark magic! Lets have it dynamic track the glove so I can hold it and move it around with projection! And also real-time scan my body and have occlusion so no projections on my hands

[@neilcharfi6377]

really cool , but can this work on a larger scale?? like a stage set, and with people moving in front of it?

[@iwin4985]

do you need a LF1 or lets say the new LF2 for each projector? or could you use one LF2 to do the scanning with a projector and then move just the LF2 to a different projector to scan another projection and have 2 separate projections at the same time or would someone have to buy a LF2 for each projector?

[@BillWhite]

That's very, very cool.

[@4rg3s]

Hmm their products are discontinued on their website

[@jakobhammerbertelsen]

Software looks great! An alternative is Madmapper which is very like this software, maybe a bit less plug and play especially with the camera, but also cheaper in some ways :) I will defiently try Lightform out some day!

[@Orangutanklaus]

madmapper had this basic setup for like 6 years now right? even with the same scanning algorithm

[@realsammyt]

you still need your computer to run madmapper though. With this you can set it up, then just leave the LF and the projector.

[@jamesstanley272]

Or you can simply use HeavyM ah ah Lightform software is close to the idea of HeavyM I think. Simplify the video mapping.

[@supernatishere6578]

This is awesome

[@callumblees8179]

Imagine having this on an ironman suit replica! Not sure if it would go through glass but CAN YOU IMAGINE! it would be like that scene from iron man 2 when he wakes up his workshop. Add a clap turn on mechanism and you are half way there. If I was rich Id have the coolest house ever haha love the video.

[@carlobeltracchi3865]

Very cool! Thank you for this review!