[SIGGRAPH 2019] Local Light Field Fusion (technical video)

[@bruce_luo]

Wow. And this video itself stands out for its quality too.

[@Geddy135]

any chance on someone making an app for this? or even just a more streamlined program to use on desktops?

[@Wiiplay123]

Really wish there was a Windows port :\

[@amoose136]

Possibly as the code is open source and has 100+ stars. Keep in mind it’s a remote possibility and all of these tools typically aren’t even shared.

[@RivenbladeS]

In what subjects is these techniques useful? What do they solve and where will you use them?

[@Wiiplay123]

@@RivenbladeS They didn't really go over the uses of light fields in the video, but it's really good for VR kzbin.info/www/bejne/hYa4Y6x9fcyDh7s

[@jonathanl2757]

Fyuse app is a limited implementation

[@caiguai4966]

It’s soo cool to capture local light field by using just a mobile phone , I tried the google spherical light field before, clearly this has the quality to compere it.

[@lilboi3000]

This is so awesome!!!! Also didn't realize you were at Berkeley until I saw that fern, that's VLSB isn't it haha?

[@polytrauma101]

Very promising results, great work! Is this method potentially applicable to 360° lightfields?

[@alhdlakhfdqw]

really awesome video thank you so much! great work :)

[@shrillcacophony]

Outstanding! Have there been any explorations into how your method would work with camera arrays--perhaps including video camera arrays?

[@benmildenhall3169]

It works very well on the 5x5 camera array data collected by the authors of Soft3D (ericpenner.github.io/soft3d/). We have not found any public video camera array data to try it on yet, theoretically it should work, though practically the size of the output MPIs might become an issue when reconstructing more than 1-2 seconds worth of data.

[@infiniterealities4D]

@@benmildenhall3169 Incredible work. We might be able to supply genlocked high-resolution video data. Can you work with larger arrays? What image resolution would you prefer? And do you have any technical preferences for camera spacing and orientation?

@@infiniterealities4D Wow the fact that IR sees potential in that means it's really as clean of a technic as I thought.

[@BenEncounters]

Could this technique be combined with photogrammetry to be able to represent reflective and plain surfaces as well as people?

[@jonathanl2757]

Please add vertical capture to fyuse for those of us who are passionate about our captures!

[@sheevys]

How does it compare to NeRF?

[@andrews4030]

is it possible to catch instant processes by this method, I mean splash of water or fire??

[@gregkrazanski]

i assume if you had 25 cameras in a semi-regular grid that all took a photo instantly, it would work

[@UTKARSHTIWARI-v4o]

what app is being used to capture images in the correct position/ at 1:30

[@jkickass]

ok but what am i going to do with wobbly 3d images?

[@jcjensenllc]

In about the fourth set of samples there is a dinosaur skull ( on bottom row) that had serious flaws. Please explain why that one failed.

[@importon]

Is there a google colab notebook we can try this out with?

[@Veptis]

Can you capture input data from a video? Would this work with non RGB images? Monochrome or even something like low resolution thermal imaging (320*240)

[@user-vh9kw6gc9y]

the matrix had always been, the only possible goal

[@dylanSmith-r5h]

the project link is currently unavailable. Could you please share it again? Thank you very much.

[@othoapproto9603]

a solution looking for a home, Rick Deckard would approve

[@mauriciopereira4824]

Empolgante! : )

[@chasemarangu]

wow

[@DenisVostrikov]

Impressive demonstration of mathematics knowledge. But it is more practical to shoot video for the best result. Isn't it?

[@games528]

Make this into a phone app and become rich.