AI for NPC, MetaHuman - Dialog, actions and general intelligence - by Convai

Convai enables NPCs with intelligence such that they can converse naturally with players via text or voice and can carry out advanced actions as an enemy, companion, or filler bot. This Unreal plugin has integrations with all of Convai’s APIs to integrate with your characters and game assets. Check out this overview video to learn more about this plugin, and visit the documentation for tutorials and more details. Feel free to write to [email protected] if you have any issues or questions.

• Intelligent realtime open-ended conversation capabilities, enabling natural and dynamic interactions.
• Multiple languages support.
• Actions: Characters can understand the environment and can perform actions based on conversation, verbal commands, and events, opening up new possibilities.
• Knowledge Base: You can add potentially unlimited knowledge for your characters making them an expert at a topic or grounding them to the lore of the world and their backstories.
• Multiplayer support: Voice chat between multiple players and characters.
• Intelligent Animations: Integrated with Lip-Sync, facial and body animations with conversation flow.

• Check our quick guide for easy steps on adding the latest High-Quality realtime lipsync to AI characters.

• Check our quick guide for easy steps on setting up microphone Pixel Streaming with the plugin.

• Quick start video to help you get started quickly and easily.
• Documentation to guide you through the plugin's features and capabilities.
• Tutorial series to help you master the plugin's full potential.

• Demo project contains a ReadyPlayerMe and a Metahuman to showcase the plugin's features in action.
• Actions Sample Project showcases actions such as picking up items and doing custom actions, made in correspondence to the Actions Tutorial.
• NPC2NPC Sample Project showcases Convai's character to character conversations system, made in correspondence to the NPC2NPC Tutorial.

• The Convai plugin requires microphone access in Unreal Engine (UE) 5.0 and 5.3 on MacOS. Find steps on how to enable microphone access here.

• Compatible with all character and avatar assets. Metahumans, Daz3D, Reallusion, ReadyPlayerMe, and any humanoid or non-humanoid assets can be integrated. 

• Text to Speech (TTS) and Speech to Text (STT) capabilities.
• Update character based on in-game events. Characters' personalities, backstories, and knowledge can be updated in real-time during gameplay.

• Other Platforms (IOS - Linux)
• Long-term memory for characters.

• Compatible with Unreal Engine versions 4.26 and 4.27, check our documentation link for a hassle-free installation process.
• Note that UE 5.0 version is no longer being updated on the marketplace, you can get the latest 5.0 plugin by following this guide.

• If you encounter any issues or have questions, feel free to reach out to us at [email protected] or join the community on Discord Our team is dedicated to providing you with the support you need to make the most out of Convai.

Experience the future of interactive storytelling with our plugin. Sign up today and take your projects to the next level!