Immersive Plugins in Unreal Engine (OSC, OpenColorIO, USD file support, and more)

[@nelscanton4907]

Hi, Thank you for this video! I'am trying to control (with touchdesigner) the rotation of a camera (in UE4) but in the editor mode. The "OSC" blueprint only work in "play mode". I tried to overpass it but without success. I guess it's possible to send "live" data in the editor mode because the Vcam (Virtualcamera) plugin works over the network that way... (I don't use Vcam because it's not precise). Do you have any idea? Thank you very much, Nelson

[@Hotberginaa]

in unreal, how to capture with my camera the light of my phone, in order to illuminate the scene in realtime ? like an external light.

[@TheInteractiveImmersiveHQ]

The simplest way to go about this would be to use an app like ZIGCAM (if using iPhone) or a similar app for Android that allows you to send the phone's accelerometer and gyroscope data via OSC to Unreal Engine, which you could then process to manipulate the position of an in-game light. Hope that helps!

[@sylvaindelaine]

Very informative ! Thank you for this video…

[@GilbertoDesign]

Is it possible to create an interactive installation only with unreal? Like I have a room with projectors and I want to touch the walls and dispatch animations or events. Thanks in advance.

[@TheInteractiveImmersiveHQ]

Yup you can absolutely create a whole installation in Unreal. You could use plugins from the marketplace to get sensor info into your project, create your blueprints to react to those events, and then use nDisplay to get your content to the screens. A good way to think about it is that it's essentially a video game with a weird 3rd party controller and a weird possibly-non-standard display.

[@GilbertoDesign]

@@TheInteractiveImmersiveHQ haha thanks for the reply. I was just trying to think on how to approach this weird way. I thought on Kinect, but you gave me an idea. Arduino can work great on this. Thanks man

[@TheInteractiveImmersiveHQ]

@@GilbertoDesign Yup Arduinos are great! There should also be third-party plugins in the Marketplace for working with Kinect cameras. Are you using Kinect 2 or Azure?

[@shooortsasmrvideosforrelax222]

Show smf