Interactive AI Reallusion Characters that Execute your Actions | Convai Unreal Engine Tutorial

[@robot_collective]

A new tutorial!! Thank you, i have been playing with Convai and Reallusion Characters for the past few days and I am so excited about combining AI with game characters :)

[@convai]

Thanks for your comment. Happy developing! :)

[@bobhawkey3783]

Excellent as always. It would be nice to find a 'talking' animation that was non-repeating over maybe 60 seconds and some mechanism for randomly picking the start point.

[@nicolasportu]

Outstanding! Now let's try with Unity 🤓

[@convai]

Hey! Thanks for your comment. We have a detailed tutorial on setting up AI functionalities for Reallusion characters in Unity. You can check it out here: kzbin.info/www/bejne/rJKQoqx8lphkaMk

[@commanderskullySHepherdson]

Its great, I just wish we could guard rail the avatars from referencing unrelated information somehow. We can give them a knowledge bank but then you can ask them about something random and theyll still find a way to respond. If it had this feature wed be using it already.

[@bewyrd-videoanimation]

I'm not prompted the notification "Enable Character Creator & iClone Auto Setup." at importing at timestamp 6:31? Now, my model is missing shaders etc. What coul be the solution? [edited] I found the solution! Good to state that you need to install the auto-setup plugin :)

[@condogFrechette]

I was wondering if you could make the ai attack the player we if the ai gets upset or annoyed long enough

[@convai]

Absolutely! You can create actions like "Defend " and "Attack ." Implement these to make the character enter defense or attack states. Imagine the character attacking because you called him names or he figures out you were lying to him in the story line, it will be the character's decision to trigger the Attack action anytime he wants according to his personality and backstory. To learn more about actions and how to implement those, make sure to check out this tutorial: kzbin.info/www/bejne/ppmknHh8lpuHnsU And for more tips and info, take a tour in this documentation: docs.convai.com/api-docs/plugins-and-integrations/unreal-engine/guides/actions-guide/custom-actions And finally, if you want to trigger the character to talk or do something when the player approaches, or stealing an item, or any other event, check this guide: docs.convai.com/api-docs/plugins-and-integrations/unreal-engine/guides/event-aware-convai-characters

[@condogFrechette]

@@convai That is awesome thank you! I’m planning on making a vr training tool for law enforcement with this.

[@juanbernal9474]

I need my character to blink, but I can't get it to work... What can I do?

[@bogachandundar3049]

Living a problem while packing.5.3.2 Unrealbuildtool fail Do you have any advice. Thank you :)

[@rezahasny9036]

why that lip-sync so smooth

[@ramsaybolton9151]

What is the fastest the AI can respond to the player?

[@jun-fn4lr]

Hi, I am having trouble importing the CC4 fbx mesh into Unreal Engine version 5.4. All seem Ok for version 5.2 and 5.3 using same procedures. So I am not sure why it particularly does not work for 5.4 Does anyone have a solution?

[@artbywaqas]

Is Unreal just crashing every time you try to import the character for you too? I'm getting this error: Assertion failed: OutTangentZ.Num() == NumWedges [File:D:\build\++UE5\Sync\Engine\Source\Developer\MeshUtilities\Private\MeshUtilities.cpp] [Line: 2074]

[@mmoussa94]

This is not working in 5.4, it says "The Environment object does not have any actions added". After manually adding the character actions to the environment object, it calls the action, but still doesn't move. (The nav mesh volume is there, and pressing P shows it's working).

[@convai]

Hi @mmoussa94, make sure you're adding to the environment object that exists on the character and make sure you're not assigning any other environment into the start talking function.

[@rohithp8868]

Can they protect the character or fight for the player. Against enemy. How to make them work for you like show way or tasks to do if a player approaches.

[@convai]

Why not! The sky's the limit at this point. Simply create actions called "Defend " and "Attack ." You just need to implement these actions to trigger the character to enter a defense or attack state. Imagine the character attacking you because you told him he's ugly, haha. To learn more about actions and how to implement those, make sure to check out this tutorial: kzbin.info/www/bejne/ppmknHh8lpuHnsU And for more tips and info, take a tour in this documentation: docs.convai.com/api-docs/plugins-and-integrations/unreal-engine/guides/actions-guide/custom-actions And finally, if you want to trigger the character to talk or do something when the player approaches or any other event, check this guide: docs.convai.com/api-docs/plugins-and-integrations/unreal-engine/guides/event-aware-convai-characters

[@rohithp8868]

@@convai thanks for the reply I will implement this to my game. I just want to know is there any fee if I release the game with convai to steam store publication.

[@ArtNoronha]

I love convai❤❤❤❤

[@convai]

Thank you for your kind words!

[@TheDjscrady]

in ue5 how can i change the UI of chat? could you make a tutorial? pleaseee *w*

[@BolshivaGame]

did u ever find out how?

[@TheDjscrady]

@@BolshivaGame i tried to change the UI component in the folder but nothing happened XD

[@BolshivaGame]

I found out how to do this actually it’s simple, Search for Chat_WB it should be in your engine folder (you can use the filter Widget Blueprint to make it easier). Open it and click on the chatbox (use the hierarchy on the left side to select SB_MainChat), and in the details panel (right side), find the setting called visibility. Set it to hidden. You can also watch a tutorial on how to hide widgets to get a better understanding, but it's very easy.

[@michaelb1099]

im not getting the chat box to talk to character did i miss something?

[@convai]

Hello, We are sorry for the issue you are experiencing. If you wish, please join our Discord server, and our developers will be able to assist you in resolving the problem. discord.gg/Tm9b3FWFJG Thank you!

[@michaelb1099]

i seem to have a problem with following and or going to an object it starts to go but then says something is blocking the path yet there is no obstacle any hint whats wrong?

[@convai]

Hello, We are sorry for the issue you are experiencing. If you wish, please join our Discord server, and our developers will be able to assist you in resolving the problem. discord.gg/Tm9b3FWFJG Thank you!

[@michaelb1099]

@@convai joined thank you for the help

[@ΚωνσταντίνοςΡάντος]

can we attach the animations like the dance to a metahuman

[@convai]

Yes definitely, follow the same steps with a MetaHuman and it will work just the same, the only issue is you need to get an animation that is compatible with MetaHumans, which can be done via retargeting the animation into MetaHuman skeleton. We have a sample project here where we created our own dance animation and added it into the MetaHuman: drive.google.com/drive/u/1/folders/1UWgQMHTTSq4O45PtKCyr8sjZbbkq-2_o

[@HyperGalaxyEntertainment]

can this package to a game?

[@convai]

Yes, just like any other Unreal project

[@HyperGalaxyEntertainment]

@@convai if I send the package to other people, who will pay for the ai?

[@hopsala1]

Move to object and actions like follow me does not work anymore with convai 3.1.4. The videos are several month old, the same with the documantion on the convai site. A dissapointing experience. The conversations are often garbage , seems like a repetition of some text building blocks. The only good thing was the price, so my loss is not so big.

[@convai]

Hi @hopsala1, we're sorry to hear about your bad experience. If you're experiencing repeated conversations and actions not working, it likely means the character isn't able to hear you. Please ensure your microphone is properly plugged in and check its functionality in the F10 settings menu within the game. Additionally, try out this sample project with integrated actions: drive.google.com/drive/u/1/folders/1UWgQMHTTSq4O45PtKCyr8sjZbbkq-2_o There might be an issue with navigation or another aspect preventing your character from moving around in your project.

[@hopsala1]

@@convai Its not the microphone , i am using an realusion character and followed exactly the steps in this video. It seems with the new convai plugin the Realusion Animation Blueprint in the link does not work for action and go to object. the link you gave me is for metahuman and does also not work. it cannot load properly the project key.

[@convai]

Hi@@hopsala1, the animation blueprint is responsible for showing the animations, but the actual movement is governed by the AI controller and the navigation mesh, and of course is triggered through conversation with the AI, I would suggest you join our Discord server, and our developers as well as the community should be able to help with those issues. As for the project key, do you mean the Convai API key? you just need to add yours in Project Settings->Convai->API key field This is our discord link: discord.gg/xbmCBb2vSh

[@hopsala1]

@@convai Thank you for your response. I am new to Unreal engine and the beginning is not easy, so it needs some time to figure out and learning the necessary stuff.🙂

[@convai]

@@hopsala1 Of course, Unreal has a bit of a learning curve unlike other game engines, feel free to ask anything on Discord and the community as well as our developers will be happy to help.