Reali̩̥͚͟t̟y͖͈̦̖͞ ͍̯̟̘I̧͈̼̮̘s̠̹͚n'̱̩̤̳̤ͅt̙͠ ̨̮̜̘͚̮ͅḄ̸͓͑r̵̼͌ǫ̵̛͗k̵̀͜ḙ̵͗n̵̢͍̔̀

cnovr 2020-01-06 22 44 28 source material obs raw capture
Everything seems ok now
Reality isn't broken
Josh's channel / axlecrusher
Another video • Augmented Reality

[@goeiecool9999]

And the twist is that everything including the OBS capture was running on an ESP8266

[@CNLohr]

Not ... yet.

[@SinanAkkoyun]

xD

[@reps]

give the windows blue and orange borders and make them portal shaped 🌀

[@altHypothesis]

I had no idea you are subbed to cnlohr. You are both amazing!

[@NourMuhammad]

Then jump through it and see what happens!

[@AzCcc]

but if You see a cake.... RUN like your ESP8266 is on fire

[@CNLohr]

I think I will add some "Decoration" to the windows. That would be neat. But at the same token, it does remove the minimalisitc aesthetic I have rn. Hmm... Maybe I'll make it configurable.

[@miguelangelgutierrezbarcel906]

I’ve waited for so long for an upload. Thanks for sharing with us!

[@JoinUsInVR]

I'm not even sure what I'm looking at, BUT I LOVE IT! ! ! ! !

[@glimpixels]

Same.

[@cali-co6428]

u r the coolest programmer ever!

[@con-f-use]

"On a scale from one to even, I can't"

[@Markfps]

HE'S BACK!!!! YEAH

[@avramitra]

So, once again I'm in the "I don't understand how it's done but I effing love it" zone.

[@CNLohr]

My goal is to always do things which ride the line of what offends people's sensibilities of what is or is not possible.

[@avramitra]

@@CNLohr And this is what inspires me! Since 2015 I watched almost all of your videos (except a few libsurvive streams) and wondered "how the hell is it done!".. To be honest, my target is to raise my skill to that level when I can understand your works easily. Someday, maybe....

[@CNLohr]

@@avramitra Hmm... that does provide more motivation to actually explain what's going on.

[@k1ngjulien_]

Is it even legal to be gone for so long and then drop something this epic? :D

[@CNLohr]

I could always delete the vid. :-p

[@k1ngjulien_]

@@CNLohr noooo please don't :D. I want a follow up video showing how you did this

[@CNLohr]

@@k1ngjulien_ haha ok ok I think it may be worth actually explaining this.

[@Maxjoker98]

This is epic! From the OBS, this seems like it's life. How do you do the tracking for the camera? Is there a controller on the camera?

[@ThereminHero]

Vive tracker I'd expect

[@CNLohr]

@@ThereminHero Indeed. It is a vive tracker with a hotshoe adapter to the camera.

[@altHypothesis]

Did I see a cnping-esque interface buried in there somewhere? I use that software nearly every day, love it! Are you streaming progress on this VR setup somewhere and I've missed it?

[@CNLohr]

Indeed! I can make "rawdraw" canvases in VR now. This is all based around my cnovr project which I haven't published to youtube yet. This is the first post.

[@altHypothesis]

@@CNLohr Thats awesome! I'm excited to see more, thanks!

[@curranh.8328]

I love the engine, but I also have those plad pajama pants 😂

[@crimsoncuttlefish8842]

now if you combine that non-euclidean ray tracer to something like this...

[@yxcvbnmmnbvcxy544]

Pure awesomeness

[@cakeofempire]

Wow. Just. Wow. This is ridiculously amazing, you are awesome

[@alexandergrau887]

Cool idea with the chosen text glyphs in your title :) (I think you are the first with this idea ;))

[@CNLohr]

[@huntersaboo8420]

This belongs on a show called Off the air

[@xecoq]

Having fun with the Index? At some point you occlude the window into the world but the ball does go in front of you. Are you separated from the background based on the camera's view or is there some other depth mapping, like from the stereo cams on the hmd?

[@CNLohr]

There is no depth mapping of the real world going on, though that would be pretty cool - I think it would be possible to mask off based on a static map of the scene.

[@pokonomo]

Your project is one of the coolest thing i've seen in VR. Does the user also see the physical room or just the wireframes?

[@CNLohr]

_at the moment_ just the wire frames.

[@smew_vrc]

you're awesome CNlohr!! :D

[@CNLohr]

And so are you. Keep doing your thing.

[@avejst]

Wow, impressive project you have done Great opportunitys to come I'm Shure Thanks for sharing 👍😀🎆

[@Rouverius]

Cool. Welcome back. Hey, Happy 2020 to ya!

[@CNLohr]

It feels good to be back.

[@nxxxxzn]

a recent sermon by our master here: kzbin.info/www/bejne/gp_UoqmMpcSIkMk

[@yoloswaggins7611]

Thank you for posting another video bananna man!

[@KucharJosef]

So frickin cool. I love your videos man, keep it up!

[@ristomatti]

Beautiful.

[@electronash]

wow. :o Tracking is really spot-on, too. Congrats!

[@CNLohr]

It's actually OpenVR Tracking, this project isn't using libsurvive.

[@electronash]

@@CNLohr Ahh. I thought it was somethinf you guys had bolted onto OBS at first. I like how smoothly it handles the video integration.

[@CNLohr]

@@electronash I am actually experimenting with plugins for OBS, because doing screen cap for this makes the video WAY less smooth :(

[@viniciusnoyoutube]

Awesome!

[@GingerBeker]

Every video it's mindblowing. i miss the old live in front of the fire making pcb and programming esp8266.

[@guatagel2454]

Dude... Wow... Dude...

[@rcelyte]

"whoooooooooooa"...

[@ytfp]

Tron the documentary.

[@bardenegri21]

Good job man! I can see some Twitch people drooling over something like this

[@troylee4171]

This is way too cool!

[@zyxwvutsrqponmlkh]

What does it mean? I thought you had died so long between videos... Then there's this. Is it still the antiquated rpi3?

[@caesecae]

holy shit

[@SinanAkkoyun]

Well imagine this in AR

[@4.0.4]

Is this using all that code you handcrafted to interface with a Vive?

[@CNLohr]

Nope, this is all using the standard OpenVR stuff as part of SteamVR.

[@DiyintheGhetto]

Make the Grid and they will come.

[@chorazytorpeda16]

It takes time to unwrap what's going on on video. Is this still based on HTC Vive ?

[@CNLohr]

Valve Index, but mostly.

[@p95parazzi]

dude, you always come up with the sickest

[@BOLL7708]

Clearly a green screen is too much power, the world as we know it will seize to exist! 😱

[@theengineer9910]

Crazy genius

[@adamo1139]

I may have outdated info. Is this some continuation of Pive (Pilve? Pindex?) or is it SteamVR/OpenVR prototype game?

[@CNLohr]

No, I have begun working with OpenVR. As per the project name "cnovr" on github.

[@kesramansuri1263]

wow you can try to make an infity room of some sort?

[@CNLohr]

Yep. Holding the output view in front of the camera.

[@cinquecento1985]

future is going to be exciting

[@CNLohr]

Going to be?

[@cinquecento1985]

Immagine 20 years from now. Nice job btw

[@AadstaPinwheel]

Super cool!

[@CeleciaFirestorm]

That's pretty cool.

[@BioToa7]

I see you’re having fun messing with Mixed Reality. How exactly are you achieving this?

[@CNLohr]

Using 'cnovr' you can check it out on Github, but I have a camera with a vive tracker on it, plugged in via a mirabox and I'm using openvr.

[@Jack_Wolfe]

wow thats pretty impressive

[@lorforlinux]

😲🤯

[@SinanAkkoyun]

Even has motion blur

[@cvabds]

holy that is awesome, u rock!!! can you teach us some basic VR coding Knowledge?

[@CNLohr]

I will likely use this platform for livestreaming as it allows for live coding. I.e. you can edit the C code that describes how everything works in real time and it continues execution.

[@NourMuhammad]

It is broken!!

[@blindmown]

What am I looking at? Please explain it like I have no tech knowledge because this seems like pure wizardry to me

[@CNLohr]

This is using cnovr to create a sort of mixed/hybrid reality environment like what is afforded by Liv on Windows. It's a kind of retro game I made over the last year and you're seeing the scene rendered from the camera's point of view. The camera is also tracked in the same space. Then I overlay the 3D environment into the camrea image.

[@blindmown]

@@CNLohr I think that makes sense. So you were able to see the scene through the camera viewfinder live while it was happening. But weren't able to see any of this with your bare eyes.. right?

[@CNLohr]

@@blindmown Sort of - the viewfinder itself saw what my eyes saw, but the TV screen, which is what I was watching saw what the camera saw with VR overlaid on it.

[@blindmown]

@@CNLohr Ahhh, that makes much more sense! Thanks for the explanation. Such a cool video!

[@mm168mm8]

????

[@UUTechRU]

How you track camera position ? only by image ?

[@CNLohr]

No, there's a vive tracker attached to the camera.

[@SinanAkkoyun]

This is ARM

[@CNLohr]

Nope, regular desktop OpenVR.

[@msurguy]

What is this?

[@TheMrTape]

Augmented reality done really well.

[@yaelm631]

@@TheMrTape I wouldn't called this "AR", since the player is seeing VR, and not the world But this is "Mixed reality", and is one of the best way to show to newcomers what is it like to be in VR Program used here is probably "LIV", it adds a new render cam in a game, fixed, or tracked if you have a spare controller/vive tracker. The blending is from at least two differents layers, behind the players, and in front of him, then the IRL cam footage is put between these two. Games need to be adapt for this, so the program know what to consider putting in the real word, (weapons and stuff) and not the background

[@CNLohr]

@@yaelm631 It is frustrating that Microsoft used that word for their stuff, now we are left to look for another word to desribe it. But, it's my "cnovr" project. In this case 'ovrball'

[@yaelm631]

When you use the steam vr dashboard and the opaque cam view, does the interface look like fixed to the ground ? On the vive it's a bit floating, maybe 3d view and fov is better adjusted

[@CNLohr]

@@yaelm631 I don't understand the question.