Interactive AI Reallusion Characters that Execute your Actions

No video

Interactive AI Reallusion Characters that Execute your Actions | Convai Unreal Engine Tutorial

Рет қаралды 3,356

Күн бұрын

In this video, we’ll be guiding you on integrating your ‪@reallusion‬ Characters in Unreal Engine 5 with Convai, to add AI functionalities. Using Convai, your Reallusion Characters in UE5 will perceive their virtual surroundings, perform various complex actions, and even interact with you or other AI NPCs within your virtual world. These characters can be interacted with via voice and text, and have real-time lipsync and facial expressions as part of their AI-generated responses. Start building your AI games and virtual worlds using Convai today!
Sign up at convai.com to try it out. Also, stay updated with our latest innovations through our blog at convai.com/blog.
Email us at support@convai.com for any queries, bug reports, collab, or business-related engagement.
GDrive link for the Realusion Animation Blueprint and Extra Convai plugins:
drive.google.c...
Action Tutorial for AI NPCs:
• AI NPCs Take Action fr...
Time-Stamps:
00:00 Intro
00:50 Configure Reallusion Character
03:10 Export Reallusion Character
04:20 Craft the Character's Mind
05:52 Add Reallusion Character to Unreal Engine
06:52 Import Character Animations
07:25 Add AI to Reallusion Character using Convai
09:43 Add Animation to Character
12:48 Add Lip-Sync Component
13:44 Enable Character Movement
15:18 Enable Scene Perception
17:04 Add New Animation
19:54 Outro
Follow us on your favorite platforms to stay in touch:
Discord: / discord
LinkedIn: / convaitech
Reddit: / convai
Twitter: / convaitech
Instagram: / conv.ai
Facebook: / convaiofficial
TikTok: / conv.ai
ArtStation: www.artstation...

Пікірлер: 39

@robot_collective 2 ай бұрын

A new tutorial!! Thank you, i have been playing with Convai and Reallusion Characters for the past few days and I am so excited about combining AI with game characters :)

@convai 2 ай бұрын

Thanks for your comment. Happy developing! :)

@bobhawkey3783 2 ай бұрын

Excellent as always. It would be nice to find a 'talking' animation that was non-repeating over maybe 60 seconds and some mechanism for randomly picking the start point.

@commanderskullySHepherdson 2 күн бұрын

Its great, I just wish we could guard rail the avatars from referencing unrelated information somehow. We can give them a knowledge bank but then you can ask them about something random and theyll still find a way to respond. If it had this feature wed be using it already.

@nicolasportu 2 ай бұрын

Outstanding! Now let's try with Unity 🤓

@convai 2 ай бұрын

Hey! Thanks for your comment. We have a detailed tutorial on setting up AI functionalities for Reallusion characters in Unity. You can check it out here: kzfaq.info/get/bejne/rMddpNx3xpmVYps.html

@user-co1yg1bv5h 2 ай бұрын

I was wondering if you could make the ai attack the player we if the ai gets upset or annoyed long enough

@convai 2 ай бұрын

Absolutely! You can create actions like "Defend " and "Attack ." Implement these to make the character enter defense or attack states. Imagine the character attacking because you called him names or he figures out you were lying to him in the story line, it will be the character's decision to trigger the Attack action anytime he wants according to his personality and backstory. To learn more about actions and how to implement those, make sure to check out this tutorial: kzfaq.info/get/bejne/ps5xnqh3xpy4mJc.html And for more tips and info, take a tour in this documentation: docs.convai.com/api-docs/plugins-and-integrations/unreal-engine/guides/actions-guide/custom-actions And finally, if you want to trigger the character to talk or do something when the player approaches, or stealing an item, or any other event, check this guide: docs.convai.com/api-docs/plugins-and-integrations/unreal-engine/guides/event-aware-convai-characters

@user-co1yg1bv5h 2 ай бұрын

@@convai That is awesome thank you! I’m planning on making a vr training tool for law enforcement with this.

@jun-fn4lr Күн бұрын

Hi, I am having trouble importing the CC4 fbx mesh into Unreal Engine version 5.4. All seem Ok for version 5.2 and 5.3 using same procedures. So I am not sure why it particularly does not work for 5.4 Does anyone have a solution?

@rezahasny9036 27 күн бұрын

why that lip-sync so smooth

@ArtNoronha 27 күн бұрын

I love convai❤❤❤❤

@convai 16 күн бұрын

Thank you for your kind words!

@mmoussa94 28 күн бұрын

This is not working in 5.4, it says "The Environment object does not have any actions added". After manually adding the character actions to the environment object, it calls the action, but still doesn't move. (The nav mesh volume is there, and pressing P shows it's working).

@convai 28 күн бұрын

Hi @mmoussa94, make sure you're adding to the environment object that exists on the character and make sure you're not assigning any other environment into the start talking function.

@michaelb1099 21 күн бұрын

i seem to have a problem with following and or going to an object it starts to go but then says something is blocking the path yet there is no obstacle any hint whats wrong?

@convai 19 күн бұрын

Hello, We are sorry for the issue you are experiencing. If you wish, please join our Discord server, and our developers will be able to assist you in resolving the problem. discord.gg/Tm9b3FWFJG Thank you!

@michaelb1099 17 күн бұрын

@@convai joined thank you for the help

@ramsaybolton9151 2 ай бұрын

What is the fastest the AI can respond to the player?

@michaelb1099 22 күн бұрын

im not getting the chat box to talk to character did i miss something?

@convai 19 күн бұрын

@rohithp8868 2 ай бұрын

Can they protect the character or fight for the player. Against enemy. How to make them work for you like show way or tasks to do if a player approaches.

@convai 2 ай бұрын

Why not! The sky's the limit at this point. Simply create actions called "Defend " and "Attack ." You just need to implement these actions to trigger the character to enter a defense or attack state. Imagine the character attacking you because you told him he's ugly, haha. To learn more about actions and how to implement those, make sure to check out this tutorial: kzfaq.info/get/bejne/ps5xnqh3xpy4mJc.html And for more tips and info, take a tour in this documentation: docs.convai.com/api-docs/plugins-and-integrations/unreal-engine/guides/actions-guide/custom-actions And finally, if you want to trigger the character to talk or do something when the player approaches or any other event, check this guide: docs.convai.com/api-docs/plugins-and-integrations/unreal-engine/guides/event-aware-convai-characters

@rohithp8868 2 ай бұрын

@@convai thanks for the reply I will implement this to my game. I just want to know is there any fee if I release the game with convai to steam store publication.

@TheDjscrady 2 ай бұрын

in ue5 how can i change the UI of chat? could you make a tutorial? pleaseee *w*

@NotFedBait 2 ай бұрын

did u ever find out how?

@TheDjscrady 2 ай бұрын

@@NotFedBait i tried to change the UI component in the folder but nothing happened XD

@NotFedBait 2 ай бұрын

I found out how to do this actually it’s simple, Search for Chat_WB it should be in your engine folder (you can use the filter Widget Blueprint to make it easier). Open it and click on the chatbox (use the hierarchy on the left side to select SB_MainChat), and in the details panel (right side), find the setting called visibility. Set it to hidden. You can also watch a tutorial on how to hide widgets to get a better understanding, but it's very easy.

@user-bs8dn3ch6n 2 ай бұрын

can we attach the animations like the dance to a metahuman

@convai 2 ай бұрын

Yes definitely, follow the same steps with a MetaHuman and it will work just the same, the only issue is you need to get an animation that is compatible with MetaHumans, which can be done via retargeting the animation into MetaHuman skeleton. We have a sample project here where we created our own dance animation and added it into the MetaHuman: drive.google.com/drive/u/1/folders/1UWgQMHTTSq4O45PtKCyr8sjZbbkq-2_o

@hopsala1 18 күн бұрын

Move to object and actions like follow me does not work anymore with convai 3.1.4. The videos are several month old, the same with the documantion on the convai site. A dissapointing experience. The conversations are often garbage , seems like a repetition of some text building blocks. The only good thing was the price, so my loss is not so big.

@convai 18 күн бұрын

Hi @hopsala1, we're sorry to hear about your bad experience. If you're experiencing repeated conversations and actions not working, it likely means the character isn't able to hear you. Please ensure your microphone is properly plugged in and check its functionality in the F10 settings menu within the game. Additionally, try out this sample project with integrated actions: drive.google.com/drive/u/1/folders/1UWgQMHTTSq4O45PtKCyr8sjZbbkq-2_o There might be an issue with navigation or another aspect preventing your character from moving around in your project.

@hopsala1 17 күн бұрын

@@convai Its not the microphone , i am using an realusion character and followed exactly the steps in this video. It seems with the new convai plugin the Realusion Animation Blueprint in the link does not work for action and go to object. the link you gave me is for metahuman and does also not work. it cannot load properly the project key.

@convai 16 күн бұрын

Hi@@hopsala1, the animation blueprint is responsible for showing the animations, but the actual movement is governed by the AI controller and the navigation mesh, and of course is triggered through conversation with the AI, I would suggest you join our Discord server, and our developers as well as the community should be able to help with those issues. As for the project key, do you mean the Convai API key? you just need to add yours in Project Settings->Convai->API key field This is our discord link: discord.gg/xbmCBb2vSh

@hopsala1 16 күн бұрын

@@convai Thank you for your response. I am new to Unreal engine and the beginning is not easy, so it needs some time to figure out and learning the necessary stuff.🙂

@convai 15 күн бұрын

@@hopsala1 Of course, Unreal has a bit of a learning curve unlike other game engines, feel free to ask anything on Discord and the community as well as our developers will be happy to help.