Now THIS is Spatial Computing

We finally got Valve's Gamescope Linux compositor running in Steam VR! This is a big deal and I wanted to explain in full detail why that is
This is basically a follow of a previous video known as "Deckard is Valve's Spatial Computer"
Info on Stardust XR: stardustxr.org/
Support me on bradsmells.com/patreon
Previous Deckard video: • Deckard is Valve's "Sp...
#Valve #Deckard #steamdeck

[@FlorianFahrenberger]

You have no idea how nostalgic and warm and fuzzy it makes me feel to see the classic Linux glxgears running in a VR window. 😢 In the early days of this century, this is what I used to check if 3D acceleration was working on my crappy GPU with my self-compiled Linux drivers... This is so nerdy and so cool.

[@wile123456]

How old are those gears? The smell as aging as that old windows pipes screensaver

[@exodous02]

@@wile123456 I started using Linux in the late 90s and they are that old.

[@RobertLesterDodd]

@@wile123456 I'm still using the flying toasters from After Dark...

[@Trekeyus]

@@exodous02 personally one of my favorite classic Linux demos is xeyes. I tend to use it all the time when testing out a Linux distro for the first time just to see if it actually has it. I remember getting it working in Cygwin with an xserver for Windows XP. If I remember correctly I had to compile xeyes from source as at the time there were no pre-compiled binaries for it on cygwin

[@codygeery9348]

No shit. I had flash backs.

[@Koroto]

Thanks Brad, copium was running low 🙌

[@SadlyItsBradley]

No problem 👍

[@misterk7_-]

I'm so excited for Valve's spacial computer. Honestly the momentum they are carrying for it is so exciting.

[@theshazman]

Love your content, Brad. You're quickly becoming the go-to resource for anything XR/VR/AR. The fact that you care about open source, linux and all of these innovations makes this content doubly more valuable. The future is exciting!

[@SadlyItsBradley]

I appreciate that! I see XR as still a very enthusiast technology. So it's very important for me to get excited about these sorta grassroots things, and get others excited about it too!

[@dawkinshater101]

@@SadlyItsBradley have you heard these rumors about HL3 and gamescom. apparently organizers listed on their website that valve is attending gamescom, and says that they're presenting something half life related. considering how the last half life game released is used to promote steam vr and the index, do you think that they're planning to announce the deckard with a new half life game to support it.

[@Green0Photon]

We stan Stardust XR here

[@psiga]

8:30 Thank you for repping the stereoscopic game output. Something I love about XR headsets is the promise of being able to make older games look more amazing than ever.

[@EmblemParade]

I would have love to have a customizable old-school game room in which I can put a bunch of retro consoles and arcade decks. Make it social and invite your friends over for some fun. Simulate a real "LAN party" where everybody is sitting around a table with their own machine and yelling at each other while virtually drinking and smoking. :)

[@brianvecc]

New Retro Arcade: Neon

[@EmblemParade]

I'd even go so far as to want it to simulate building the setup, cabling and all. And even introduce faults like bad cables or disconnects while gaming. I sure do miss the good old days. :)

[@able_archer_]

EmuVR can get you halfway there today

[@exodous02]

Holy crap, finally. I've been waiting for this video! I hope the Deckard is a stand alone AND can be tethered. Maybe a powerful PC can handle the game, i.e. VR environment and the Deckard can handle the overlayed PC work, or vice versa. So for those of us that want to just go to a VRChat world to do computer work the computer work or VR environment won't take a hit!

[@SadlyItsBradley]

ITS HERE. ITS HERE. ITS FINALLY HERE

[@exodous02]

@@SadlyItsBradley Way back when you said you were going to show how you do computing in VRChat, not quite the exact video but I think this was better!

[@samrincewindx]

@GodhearmyprayerwiththewishingS not going to happen

[@joshuafields3452]

@@samrincewindx Valve are going to have to release a revised steam deck model with replaceable battery in order to sell in the EU in the very near future.

[@zig131]

I just hope the stand-alone functionality is either an add-on or a separate model as I have NO interest in paying for functionality I will never use. A VR HMD doesn't need cameras. Unfortunately Valve are such a small company that I think the idea of simultaneously releasing multiple products is unlikely :(

[@RidgeVR]

Thank you so much for the dose of gamescopium bradley

[@SadlyItsBradley]

anytime ridge

[@user-nt6rr2ys6v]

Thank you for all you do, Brad

[@SadlyItsBradley]

It’s fun for me!

[@luckysevs2583]

I wrote off VR in 2022 as yet another unfulfilled futurist pipe dream. However it’s becoming increasingly clear now that at least some of that dream is becoming a reality.

[@samson143vr]

Back to back days of Brad!! Whooo

[@SadlyItsBradley]

heh heh

[@CognosSquare]

This makes me hopeful also. Id like to build a virtual house where the windows are real webcams. You could show your own or put in something really exotic like someones aquarium, space telescope or himalaya.

[@SadlyItsBradley]

That idea is so wild, I can’t help but adore it

[@MrVRVoice]

That was a good hit, you’re my number one copium dealer Brad.

[@SoggyMicrowaveNugget]

I desperately want Valve to revisit vr home. Treating it like a true social and desktop replacement, allowing friends to visit and play flat screen games and treat the maps more like Vrchat worlds. What they have is already 1000x more compelling to me than the "Metaverse" ™️ plus the user base is built in.

[@WilsonBot]

Saw your tweets and we hoping you would make a video on this. Thank you for my fresh dose of copium.

[@SadlyItsBradley]

no problem. i enjoy handing out the injections

[@FunFreakeyy]

Since I saw "VR-OS" from Matthaeus Krenn I was excited for spatial computing. And if the rumors about all you show about the Deckard, SteamOS and other tech from Valve are true I'll order the Deckard as fast as I can if it gets out. Doesn't matter to me if, in comparison to Apple, it will be only for nerds or tech-enthusiasts, because I am one. 😊

[@hannahkiekens5097]

Is there some sort of a writen guide ? for nerds like me ? I need to see this Plasma in VR thing myself!

[@SadlyItsBradley]

Currently no, but I will look into this

[@BB-qp5xo]

You know what I like about your vids Brad? If you make one, it's at the level that I am interested in. There is a lot of boring stuff that isn't critical enough. Also I like your "I want to believe" poster : )

[@SadlyItsBradley]

hehe, i try to make videos on topics im interested in, myself :D also glad you like it haha

[@GiffysChannel]

Playing flat games in rendered stereoscopic mode is what got me into VR in the first place back when the dk2 had just been released.

[@quantumac]

Speaking of SteamVR for Linux, I wish Valve would fix the overlay colors. In SteamVR 1.26.6, they swapped the red and blue channels on a Valve Index. I pointed it out several times during the beta process... but they didn't fix. This doesn't affect the title being run, just the overlays. There's also an issue with the overlays on the controller avatars. Works fine for Windows 10, but Linux has issues.

[@SadlyItsBradley]

Oh ya. IDK what the hell that bug is all about >_>

[@24wherath36]

Really would love to see some cameras slapped onto the front of the beyond, and try implementing Monado's Visual SLAM and hand tracking as they did for the index and many other hmds.

[@baldr12]

Using a pc without having a monitor its a huge thing The emulation would be also cool for testing applications on different devices For example you could test how your web app is displayed and looks while holding an iPad, without having one

[@mbustin548]

Really enjoy your in-depth knowledge and enthusiasm, keep up the great work!

[@spatialfree]

thx for featuring Nova's stardustxr project ^-^ ✨

[@Tera_GX]

"This is the future!" *promptly emulates CRT TVs*

[@Dawooded]

At this point you could almost make a deckard yourself.

[@VirtualRook]

I want people to bring back the weird looking apps from the early 2000s, like the music player that was just balls of mercury with a play button inside of one and a screen showing the song title in another ball, let's go back to making things look weird /cool!

[@SadlyItsBradley]

honestly, me too

[@exodous02]

Or maybe make 3D representations of them and have them in your environment. Have winamp as a radio to sit on your desk! I don't even know if winamp is a thing anymore, that is what I was using in the 2000s though!

[@MommysGoodPuppy]

this is the way, flat buttons are so 2016, multidimensional metalheart ui in vr is the future

[@BOLL7708]

I'm only half awake, or half asleep, but this sounds awesome. I'm not sure if you ran SteamVR on Linux as well but I expect as much. As someone who relies on Windows I'm wondering what happens there, herpa derp. Even bloody Android, what is this black magic? Right, I will have to watch this again when I've slept for a week. Seems exciting though.

[@SadlyItsBradley]

I think Steam VR on windows will stay, but be a bit behind the standalone functionalities of Deckard. Similar to the new Big Picture mode and Steam Deck's entirety. I think they also want to ensure people can stream/connect to their high end PC anyway.

[@floogulinc]

This idea of running 2D apps directly through the VR compositor without involving your regular monitors is actually something Windows Mixes Reality has had for years because its integrated into the Windows DWM, the compositor on Windows.

[@rvmiv_]

As someone who switched to linux after windows broke for my usecase this is really exciting for me

[@anthonyharrison5366]

thanks for the update!

[@Krackatoa]

The intro got me.

[@yaelm631]

As always, I would love to see the reaction of XR Valve employees to your videos. Also the PSVR team with the iVRy dev. I believe the teams would like to exchange with us, tell us about all their VR progress, give a working PC driver for PSVR2... but can't due to the company interest/rivals

[@Soul-Burn]

I'm on high doses of Gamescopium

[@DMan-ud6bt]

VorpX is nice for some titles, but a built-in way to play non-VR games on whatever size 3D screens would be great.

[@treschlet]

after that initial pun, i literally can't hear it as "GameScope" anymore, and it just sounds like you're saying "Games Cope" every time

[@SadlyItsBradley]

heh heh. im glad to have ruined you

[@elbee2324]

It sure would be nice to run (almost) unlimited monitors in VR. Of course there is an upper boundary to this... your graphics card can only do so much, but having a bunch of documents, static web pages and a few lower resolution videos running simultaneously could really help with productivity, without needing to get a massive multimonitor set up. As far as I am aware something like OVR toolkit can allow you to see your monitors at any time using gestures or 3D placement in a VR environment, but it's bound to the number of physical monitors you run and their outputs, as Bradley talked about. When you need to do tasks like editing or research, it's helpful to have as many active screens running as you can make so you can cross reference and physically sort them easily. That's probably what Apple is aiming for with their "spatial computing" buzzwords - just the ability to physically interact with multiple virtual displays and have them as big or small as you want in any order or position. In theory there is nothing stopping PCVR from doing this apart from the software limitations of the current way things are set up.

[@StubbyPhillips]

Sounds like the opposite of Apple's precious, closed off, locked up stuff. Excellent!

[@Perenbarn]

I don't get why anybody would want a closed ecosystem with something so dynamic and open as VR/AR. Apple is a cult.

[@exodous02]

I think they're working with Apple. Bradly said they had a revolving door with Apple on VR employees. I think whatever Apple has Valve will have, and vice versa. Same optics but Valve will go with Linux/AMD rather than OSX/Apple Silicone(or is it iOS?). Hopefully Valve won't have the Apple tax though. . . Being Valve they'll be more open though, I'm sure they will let this work with any headset that works with SteamVR, if they don't out-right make it open source.

[@StubbyPhillips]

@@exodous02 The thought of Valve working with Apple kind of makes me want to shoot myself in the face because It would only result in Valve becoming more like Apple, not the other way around.

[@lraiden7]

@@Perenbarn Like Sony

[@nakazaki1254]

@@Perenbarn its not that ppl want a closed ecosystem, they want a complete polished system thats easy to use. not linux/windows where a problem will take hours to fix, nobody cares about 300 gimmicky features that ppl created on linux that dont work 80% of the time. there is a reason pcvr is dead and dieng. newsflash valve isnt a charity they arnt doing this out of the good of their heart its just that they cant compete in any other space they have limited options.

[@itsWISHY]

Hello Brad

[@SadlyItsBradley]

hi wishy

[@gesshoku92]

shout out to someone somewhere.

[@pauljones9150]

It's a brad video!

[@SadlyItsBradley]

IT IS

[@tituss_]

Do you think the HDR in the code is for Deckard?

[@SadlyItsBradley]

Absolutely

[@tituss_]

@@SadlyItsBradley hyped

[@mariokotlar303]

Wow! A properly exposed PQ HDR video! Great job, looks awesome! Which monitor did you use to master it?

[@wile123456]

Bradley's voice is kinda higher pitched and more friendly sounding reviewbrah

[@pablowasserman]

nice room upgrade!

[@tempacc9589]

Man is getting VR rings press molded into his eye sockets

[@WMan37]

Of all the things Valve is working on right now, Gamescope, SteamVR on linux, and Proton are the most interesting and important to me personally. I'd take this stuff over getting a proper, top quality sequel to each and every single player game (including Half Life!) any day at this point, because I've used Gamescope on the linux desktop before outside of my steam deck and outside of VR; I'm wondering why this hasn't been a part of the computing desktop philosophy goals day 1 of every operating system including windows and mac. The idea of being able to just simply make a virtual monitor within your physical monitor and do whatever you want with it, including using upscaling solutions and capping refresh rates on de-focus is such a no brainer, especially for older games that have issues displaying their smaller resolutions on larger screens, that I'm surprised nobody standardized this in a user operatable way sooner. This is like a superpower for computers. I wanna see it on literally everything eventually.

[@Belfoxy]

You mentioned it needs HDR to work, and HDR is supposed to be one of the big things for the upcoming SteamOS 3.5 updates. Maybe Deckard might finally show itself after HDR makes its way to SteamOS / Linux?

[@zig131]

A potential harbinger could be the eventual release of a Steam OS image for DIY PCs. Valve clearly want to shrug off their reliance on Windows/Microsoft so it seems strange they haven't enabled gamers to easily switch to Linux earlier. The next Valve HMD is very likely to support Linux so they wouldn't want people to get it all setup on Windows and get entrenched.

[@MooseheadStudios]

Glad to see they are already on top of this. This is metas whole advert and apples. this has been doable for years big screen vr and virtual desktop just built into steam vr os.

[@Nicalay2]

3:01 How did you changed the color of the SteamVR dashboard ?

[@SadlyItsBradley]

Ok, that is not intended. It was a bug that was added to Steam VR Linux in the last big update. It's swapping the red and blue channels XD

[@Nicalay2]

@@SadlyItsBradley So it's actually a bug bruh. It would be cool that it was a actual feature. But to be honest, I'm waiting a redesign of the SteamVR dashboard because the UI feels old (compared to like the Quest UI or regular Steam), and I'm pretty sure they will do it since they already refreshed the UI of the SteamVR binding menus, and also it still use the old Big Picture.

[@dtrjones]

Now THIS is Pod Racing! Haha come on Bradley get is right! I'm guessing you're not much of a film buff.. 😁

[@niko1773]

Fuck yeah

[@DarvonBrown]

My man brad

[@bophadeezgames]

Hype

[@asmolguy]

Quick question; how did you get gamescope to become an overlay in steamvr?

[@CrystallisedEntertainment]

I hope that one day I'll be able to setup a virtual "Acorn RiscPC" in VR and have it connected to a virtual CRT and play games or use the software from my childhood with CRT lines and passthrough for my keyboard and mouse for AR functions if I wanted to... That thought alone makes me very excited! 😄

[@BranVR]

gamesCopium

[@Scrumplex]

Your VR system is NOT reliant on your flat screen. Both Windows and Linux have "direct mode", on Linux it's done using DRM leasing, which means we lease a whole DRM output (CRTC) to an application. This means the application can control that whole output, including color/HDR management and refresh rates. Gamescope doesn't really do anything special here in regard to *running* SteamVR. DRM leasing works the same way on KDE Plasma or Sway as it does on Gamescope. The reason Gamescope needs to be launched first, is that in order to utilize DRM leasing, SteamVR *will* need an upstream compositor to talk to. When I was daydreaming about how SteamOS for Deckard would work, I had two possible ideas: 1. Run Gamescope (DRM master, headless), run SteamVR (leasing), start Steam in gamepadui as an overlay 2. Start SteamVR (DRM master), run Gamescope (headless), start Steam in gamepadui as an overlay In both cases, Gamescope has to run in "headless" mode, as the main output of the Deckard will be driven by SteamVR.

[@handlemonium]

So.....what is "HDR" resolution versus regular/higher framerate KZbin resolutions?

[@ClayTheFoxx]

I wonder how hard it is to port all of this to arm64 and make an open source standalone VR OS for like a pico 4 or quest 2?

[@Lazyazen]

Bro your eyes are rizzing me up

[@WindFireAllThatKindOfThing]

Could we call this the Sourcery engine? Speaking of using HMD's to revive Stereoscopic gaming for 2D games on a virtual display, I still cannot believe that nVidia has not tweaked the old 3DVision drivers for VR headsets as you say, yet they still package it's support for 3d monitors in all new driver updates. *_HOW_* have they not noticed the elephant in that room?!?

[@leafblock7081]

When you say thd beyond is 70-80% as bright as the index, is it the actual steamvr value of 70-80%? Becsuse it does allow you to put the index above 100%, so do you mean 70-80% of the highest brightness of the index? I ask this because it's the deciding factor of if I want to buy the beyond. If you meant the steamvr value of 70-80%, that's too dim for me. Also, are you taking into account the less light leakage (how you see it) or are you comparing number like nits?

[@SadlyItsBradley]

I’m comparing the nits measurement. 100% brightness setting of beyond is like 70-80% brightness setting of index

[@mikeb3172]

Is it possible to use a SimulaVR headset with this?

[@amreamer362]

Awesome

[@zeekjones1]

Just the idea of pulling out a virtualized android tablet sounds great for daily use. I've had to run them on my 2D screen for some region locked apps before. Eventually I'd like to have a custom HMD hacked together with GPS and high enough quality optics for outdoor use. _(Yes I'm one of those folks that'd wear a full borgd out helmet out in public)_

[@user-rj7ks6ik2s]

dummy plugs solve this problem in many ways, with the help of them you can create any virtual monitor that will be perceived by the video card as real (with GPU support) and use it in your virtual space.

[@xguitarist_]

There’s mention of HDR for headsets, but doesn’t X11 and Wayland not have support for HDR currently? I thought the display server had to support HDR before a program could, unless gamesCope is getting around that by being it’s own display server or something like that? I’m not well versed on how gamesCope works

[@SadlyItsBradley]

Valve's gamescope does offer experimental HDR support, yes. From what I understand, It bypasses the display server with DRM tricks

[@xguitarist_]

@@SadlyItsBradley I just read a page on the arch wiki (of course lol) that details the process, but you need an AMD GPU. I have a 3080 💀

[@robot_madness3164]

@@xguitarist_ nvidia oh why nvidia (nvidia still doesn't have async reprojection in their drivers still)

[@xguitarist_]

@@robot_madness3164 I just use single GPU pass vm for vr now, I got sick of fiddling with alvr and things randomly breaking (I have a quest 2💀) even though I’d prefer to just play natively on linux

[@IvanSndr]

how did you make steamvr run so well on linux? the overlay barely works for me

[@nukmuk]

Love how the video is in HDR haha

[@DROOG1E]

8:07 NICE

[@Xanoxis]

Imagine having entire tablet emulator with controller as the stylus, or actual tracked stylus, with a huge HDR screen in front for painting. And you could have AR passthrough for subjects to paint. If it would be good enough, rip Wacom. The whole idea of even just putting cartridges as entire emulator for old games set up inside your VR environment... This whole Linux gamescope compositor sounds more exciting in principle, than what Apple or NotOculus™ are preparing so far. We will see how it works out.

[@pauljones9150]

Im excited for video game mods for 3d mode. Could you imagine playing assassin's creed in 3d? I think it would be much more immersive

afaik HDR will come with KDE 6, which is the desktop Steam OS is using

[@mikegc3816]

Brad, I was expecting the AI version of you!

[@rackneh]

If this works with Unity VR development on Linux I'm actually dual booting it again

[@hailandfire1822]

Elijah in the house

[@SkylerLinux]

With Steam VR 2.0.x using more Deck UI and new Overlays, this could be much better.

[@theDubleD]

XR is gonna be great, looking forward to Quest 3 release, i believe it's gonna be the start of something beautiful! Would be cool to see Valve and Meta compete these hollidays.... just a couple more months.....

[@Sychke]

Thank you for another serving of copium, sir!

[@SadlyItsBradley]

My pleasure!

[@NKCubed]

plz turn the saturation down a lil bit

[@waterflame321]

Upupupu... Haven't seen this one in a video

[@scaree2496]

Imagine if the declared had lighthouse tracking AND build In tracking. That way you can play at home, and take your headset on the go to watch a movie or something.

[@MKwadratPodcast]

GamesCOPE :)

[@HellSpawnRulerOfHell]

Running VRC on Android in the DeckARD 😎

[@SadlyItsBradley]

You mad lad

[@pablowasserman]

who's the guy at 8:30 ?

[@ZarathustraDK]

The obvious usecase here, and the reason it's being added to the Steam Deck's OS in its current incarnation it seems, is so that you can hook up a Steam Deck to a VR-headset and play Steam Deck games in "Really Big Picture mode" using the Deck as a controller. I just hope the thing they're ultimately working on with Deckard is some kind Gamescope-client-HMD that an external SteamOS-device can stream to over the wifi-network. That way the bulk of the processing is moved away from the HMD (= cheaper, less bulky headset), and bandwidth can be kept low by using eye-tracking on the HMD to select a foveated area of the stream to upscale with something like FSR, necessitating only a lower res stream rather than a full 2x 4K. But I didn't quite get your video, did you manage to run SteamVR inside gamescope, or was it "only" gamescope as a SteamVR overlay? If it's the former we need a howto as that would mean FSR+VRChat is back in business (VRChat's currently blocking fholgers modded openvr.dll necessary to run FSR-enabled proton, but I doubt it would detect it if it was the compositor itself doing the FSR as that wouldn't require modded gamefiles).

[@DerSolinski]

So they already have a replacement for x11/wayland noice!

[@runvnc208]

Running Hundreds of libretro (ZX Spectrum) instances on one screen: kzbin.info/www/bejne/eJvIh617hrxneZo

[@complimentaryrandomnessinc3137]

Watching this on my quest, the copium was mitch needed

[@somebodysomewhere3839]

1:50 I was watching this and suddenly I hear my name (at least somewhat close to it) (it’s not me who he’s talking about tho)😂

[@u4f8hfsh498]

Imagine you take out your phone in GTA6 and it has an actual operating system. GTA themed Android or something.

[@vrgamer5045]

这发型帅😊

[@SadlyItsBradley]

Thank you!

[@peanutpomsky520]

Woof

[@micmule3395]

Them trying to get hdr makes me think they may be not using oled panels Unless im mistaken they wouldnt need hdr compatability

[@Patata.Yutube]

hi brad xd

[@SadlyItsBradley]

allo xd

[@vrgamer5045]

也就是说linux下steamvr可以进行显示器的串流了，不知道我理解的对不对

[@MommysGoodPuppy]

stardustxr mentioned 👍✨

[@VR-Fanatic666]

Hi brad xxxx Im Flood6