Resonite Overlay - how Resonite will run over everything in the future

[@owlenderg]

Funni casual void in the bottom left

[@Konecny_M]

This sounds like a very interesting way how to bridge the gap between complex VR tech demos implemented on bare metal and multi-user interaction. Becoming defacto middleware for VR enviroments is closest what I can think of as first steps to actual metaverse that is not inherently platofrm and vendor restricted, but if such is the case, there should be some effort in turning the API into an open standard, otherwise the fragmentation will continue.

[@tailsfan465]

This sounds... kind of crazy! Like, resonite as an overlay is not something i would of thought of.

[@Frooxius]

Oh yeah. I think it's one of those features that nobody is really thinking about, but that has the potential to give "oh shit" once it's there and people realize what it does. I love working on stuff like that.

[@epiceaston197]

So essentially the dash would function similarly to the Steam VR overlay? Just heard more you could theoretically in this situation have Resonite as an overlay on top of VRChat lol That would actually be so cool

[@Frooxius]

Pretty much yes!

[@Cammymoop]

Oh, i thought it was a reindeer, i guess Grandma actually got run over by resonite

[@MadeOfPears]

this is unreal, never once considered this could be a possibility for the future of resonite. this would be so, so incredible! hope this comes to fruition one day.

[@SystemCharizmare]

This will open a gateway of possibilities. Can't wait to see this come to fruition!

[@TwilightVaramek]

thje casual peek from the bottom.. i like weird randoms tuff like that

[@krasnoiark]

For this to work, resonite has to be very low resource demanding since rendering both games together is a big challenge ! I like the idea

[@Frooxius]

Yeah. The original question that prompted this was what features will become possible with some of the planned changes, that are not possible now. The switch to .NET 9 and rework to the multiprocess architecture will significantly reduce the resource usage, which will make stuff like this possible. The other part is - the usage also depends on how much stuff you have. Since the overlay layer doesn't have as much stuff, it tends to be lighter as a result of that alone too.

[@theminecraft4202]

yeah, similar to the concept of a canvas in unity. running it with passthrough to another app in this case

[@Caldoric]

Who's the dark-furred gremlin peeking at the screen in the bottom left?

[@AlphaNeon]

Cyro. The bean.

[@Caldoric]

@AlphaNeon is there a reason why they're doing that? Like, so they contribute to the videos, or are they there just for visual entertainment?

[@exxon47_]

@@Caldoric this is just a clip from the full episode they were actually talking in the other parts of the video

[@ab-wj8yg]

is your pfp the space symbol btw

[@Caldoric]

@@ab-wj8yg correct

[@JimBimBum]

this sounds like compartmentalizing code in a way that it could be modular or unplug this and plug this in easily. of course the coding aspect will always be coding but the applying of that would i assume be easier like loading up a minecraft mod or something.

[@leafmountain]

This is the way to make the ”metaverse”. Don’t lock ppl out of their experiences, but make the new technology enhance the existing ones!

[@crocythecrocodile8843]

Looks interesting to make it all easy and stuff like that

[@crocythecrocodile8843]

Nice

[@troyBORG]

Could we somehow be able to use Resonite overlay to do Finger Photo in other games for screenshots?

[@oskark312]

prob yes

[@Frooxius]

That's unlikely to work without deeper integration with the target application. Finger photo requires rendering a new camera view in the target application scene - which is tricky to do purely externally. If there's a mod/plugin provided for the target application, then it's more likely.

[@bdunderscore]

@@Frooxiusyou could move the VR view to that position for one frame…? This could have side effects, of course.

[@Frooxius]

@@bdunderscore We don't really control where the VR view is. Plus that'd be pretty jarring to the user.

[@bdunderscore]

@@Frooxius yeah, I suppose it’d need a steamer driver hook like space calibrator. Would probably need to suspend rendering until you move back…. Complicated and probably best experimented with as a separate project initially?

[@Ilmari_Hirvonen]

I’d probably run it alongside vrc

[@quadstrike]

this is exactly the idea i've been having, but more of a pipeline for avatar rendering for ALL games, imagine games don't have default avatars, and instead theirs a layer that renders avatars (which could be done on a separate computer even (even cloud), or optimized specifically for the rendering) and have that data be displayed where someone is relative to the game over said game in realtime, and boom you have a cross game universal avatar system that is shared, then that system can be managed and moderated by the community, allowing people to have free expression (changeable whenever mind you). and then possibly have this a part of the rendering pipeline, and allow both the avatar layer renderer and the game to communicate lighting, allowing game lighting to set the lighting on an avatar, and lights on an avatar to effect the game (this could be simulated for the game by having a placeholder that does a similar effect) the major problem with resonite for this use case atm, is it's really REALLY unoptimized on performance, idk what is the hangup for it, but it really runs heavy. and i still think this is the main reason people aren't on resonite as much beyond the ease of use. 40+ horribly optimized vrchat lobbies run better than the default resonite world. idk anything about how resonite is made or game engines used, or even if im just missing some godly frame saver setting

[@Frooxius]

Big performance update is actually what's being worked on right now! The context of this video was a feature that's not possible now, but that will become possible in the future. We are reworking Resonite to a multi-process architecture, which will allow us to use .NET 9 runtime and gain significant performance boost as a result. It'll also allow for the feature described in this video.

[@quadstrike]

@Frooxius that's awesome! that will make the game approachable! but i still am not confident in its ability to be so lightweight it can casually be run on top of existing demanding games, but as it often is, one step creates, and another masters

[@Frooxius]

@@quadstrike Yes, that's the primary reason we're doing this! I'm pretty confident in this helping reduce the usage significantly - from the data we got from the headless (which was already moved to .NET 9), there's a dramatic speedup - some things run like 10 times faster. There's also other aspect - part of the heaviness of the game is because you have entire worlds full of things and avatars loaded in - those are pretty heavy alone. With an overlay, there's significantly less stuff loaded in. As a result, it's also a lot lighter. With these two combined, I'm pretty confident it'll run pretty well.

[@oskark312]

i hope this will work out of VR

[@hexshadow6647]

You gotta pay money just to get storage to have avatars. Just from this fact alone shows that resonate just like all the other "options" aren't going to do anything.

[@Frooxius]

You actually get 1 GB of storage for free! That's enough to save several copies of pretty much any avatar out there.

[@coler154]

@@Frooxius True, however things like voice mesages count against your storage and currently there is no way to easily delete them.

[@Frooxius]

@@coler154 We can add an easy way to clear those out. Generally they should be pretty small though, like a few dozen kB per message maybe, so you'd have to be consistently sending A LOT of these to fill up even that 1 GB.

[@DaxSudo]

Was distracted by the cutie pie on screen sorry can we do this meeting again at a gogo bar.

[@FangsVR]

😯😯😯

[@Flutterwhat]

you know, a real way to sell a product to to build these into features that end users can actually use without having to watch a lecture with bad audio quality

[@Briggsby]

I'm pretty sure this is sharing some cool projects coming down the pipe, as an indie team, being excited about their project. If they were selling something there would be a sales pitch, a call to action, a method of monetization. Given there isn't even a request to like and subscribe, your argument comes across as childish, petty, and spiteful. Do something with your life before you disparage people who are, especially when your channel appears to be full of exceptionally poorly made AI slop.