Creating AI-Generated Backgrounds for Virtual Production in Unreal Engine 5

In this video, we will explore how to use Unreal Engine 5's virtual production tools to generate AI-powered backgrounds using a short throw projector. See what it takes to set up the projector, create a virtual camera and captre the background, and adjusting the AI-generated background to create a realistic and immersive environment for your virtual production. Whether you are a filmmaker, game developer, or content creator, this talk is about how to leverage the power of Unreal Engine 5, and text to image to bring your virtual worlds to life.
Special thanks to ‪@maciejbronikowski269‬ and
Coursemakers studio in Poznan, Poland where this was shot.
I’m on discord: / discord
www.barlowski.com
www.mepi.pl

[@stingrayschuller8909]

It would be great to see step by step video inside the specific AI you're using with Unreal Engine and all the way through room setup, not just a final product.

[@nikilragav]

So what projectors and screens are you using? How are you dealing with spill and black levels?

[@BartBarlow]

I think these are short throw Xiaomi 4K projectors - also sold under the brand Fengme.

[@nikilragav]

@@BartBarlow great thanks! Glad to see there's no scan lines or weird color bars. What about your screens?

[@pablofigueroacl]

So, with this you will not need an Environment artist, Unreal Artist or simple any artist?... AI is getting strong .. we are going to lose our jobs.

[@BartBarlow]

My hope is that AI tools like this will help us be more creative and focus on storytelling. With AI text to image getting so good in a few months we still need a human to drive it to tell it what you want. For now..