Composure X - Blender Tracking export to Unreal Engine - Real-time Sky Replacement / MR Compositing

[@Stallagmite]

very cool. I've been looking everywhere for an easy was to send tracking info from blender to UE5 but there is almost nothing even though its used so much in vfx. I think it should be even easier to insert the media now to UE5, you can even drop in an mp4 where it used to be image files or exr.

[@miniMasud]

Amazing tutorial

[@snailone6358]

Great job. Really useful tutorial

[@HyperGalaxyEntertainment]

amazing~ thanks a lot

[@augustinonedo2438]

Thanks for this tutorial. It gave me some useful insights. I have a question i will like u to help me with. I have been trying to do some chroma key in After Effects so that i can cut out some garbage and abstracting objects from the green screen area, then import footage as png sequence to Unreal Engine. The problem is i cant seem to get transparency in the image sequence to work in Unreal Composure. Alpha goes completely black and opaque. Is there a way to get png sequence transparency to work in Composure?

[@dpredie]

Yes this can work. In the composure post process material make sure you tick enable alpha channel, also if you are having trouble in your PNG you can try importing a separate image sequence just with alpha information, so you have 2 sets of media, one for RGB seq one for Alpha seq. And premult them in composure accordingly, ive done this before

[@augustinonedo2438]

@@dpredie Thank you very much Sir. I'm the happiest man on earth at the moment. It worked. This is big for me cos now i have total control over my key before comping in unreal. Thanks for the tip.

[@dpredie]

@@augustinonedo2438 yeah you can even rotobrush beforehand its quite good

[@renzocarocajara7071]

Great work and tutorial, How do you solve the lens distortion or add it? Can you do another tutorial like this?

[@dpredie]

Pretty sure if you solve in blender it will calibrate the k1 k2 and cx cy pair. You can also calibrate the lens using 4.27 built in lens calibrator, or polypulse’s 4.24 lens calibrator (free in ue marketplace), or check out greg corson’s tutorials

[@PatrickCharpenet]

Great tutorial, thank you also for giving some directions on how to render a sequence with composure. I encounter a problem when trying to render a comp including a CG foreground element, a camera and a media plate element. My preview is working fine and I see my video playing in the preview, but as soon as I try to render my sequence as Composure Export, the media player for the playing media plate turns off and it even loses the reference to the image sequence that was selected, so I only get my foreground element rendered. Any idea why this would happen? PS I am in 4.27 and my media is an exr image sequence. Any help would be very appreciated!

[@dpredie]

4.27 has some exr issues i feel.. you need them in a certain folder in the project or something like that

[@PatrickCharpenet]

@@dpredie thanks, I will try. I followed the Unreal documentation steps for creating the movie sequence folder… maybe I’ll try with 4.26. Thanks again!

[@dpredie]

@@PatrickCharpenet yeah mp4 works ok with 4.27, exr is a hit or miss depending on folder path in my experience, but i havent played with exr recently so it might have changed

[@moisesdelcastillo6703]

Is there an updated code for github for blender to unreal engine 5 (not UE4)

[@jinpower6505]

I have a question. Can't the real actor record in the sequencer with real-time comspositing? Currently, I am using Black Magic.

[@dpredie]

Do you mean recording the media or recording the realtime tracking? If you have decklink you can select composure output to decklink and record the decklink output externally

[@ngochoaitran3477]

@@dpredie if I want to do with live cam ( SDI input) stage . Can you help me.

[@NPCCrystal]

get it😀

[@JDARRASVP]

So Great ! Thanks a lot