Real-time Conversational MetaHuman AI Agent in Unreal Engine with Voice Interface

[@StevePaulSounds]

when Is this ready for release? will there be something like pi as the ai?

[@Mn8Multimedia]

Sweet! Nice work!

[@isaiahlopez6274]

This is awesome - what plugins are used in the pipeline? I've been trying to recreate using the MetaHuman SDK but struggling with getting retell connected and the latency down overall.

[@nty.studio]

thanks! For this pipeline, we're using GPT4 for the model, Retell for the voice API, Audio2Face to generate the facial animations from the voice audio, and this finally plugs into unreal (via live link) for the real-time agent interaction in the scene < kb >

[@isaiahlopez6274]

@@nty.studioawesome! I’ll look into it

[@yanwang6227]

Cool

[@discorddan]

Time to get that Thor voice mod. jk This was super cool.