LemmoLab: All products 50% off

AI for NPC, MetaHuman - Dialog, actions and general intelligence - by Convai

Convai - Code Plugins - Nov 5, 2022

Convai powers NPCs with human-like intelligence.

  • Supported Platforms
  • Supported Engine Versions
    5.0 - 5.3
  • Download Type
    Engine Plugin
    This product contains a code plugin, complete with pre-built binaries and all its source code that integrates with Unreal Engine, which can be installed to an engine version of your choice then enabled on a per-project basis.

Convai enables NPCs with intelligence such that they can converse naturally with players via text or voice and can carry out advanced actions as an enemy, companion, or filler bot. This Unreal plugin has integrations with all of Convai’s APIs to integrate with your characters and game assets. Check out this overview video to learn more about this plugin, and visit the documentation for tutorials and more details. Feel free to write to support@convai.com if you have any issues or questions.




Highlights:
  • Intelligent realtime open-ended conversation capabilities, enabling natural and dynamic interactions.
  • Multiple languages support.
  • Actions: Characters can understand the environment and can perform actions based on conversation, verbal commands, and events, opening up new possibilities.
  • Knowledge Base: You can add potentially unlimited knowledge for your characters making them an expert at a topic or grounding them to the lore of the world and their backstories.
  • Multiplayer support: Voice chat between multiple players and characters.
  • Intelligent Animations: Integrated with Lip-Sync, facial and body animations with conversation flow.



Lip-Sync:



Resources:



Sample Projects:



Compatibility:
  • Compatible with all character and avatar assets. Metahumans, Daz3D, Reallusion, ReadyPlayerMe, and any humanoid or non-humanoid assets can be integrated. 



Standalone components:
  • Text to Speech (TTS) and Speech to Text (STT) capabilities.
  • Update character based on in-game events. Characters' personalities, backstories, and knowledge can be updated in real-time during gameplay.



Coming soon:
  • Other Platforms (IOS - Linux)
  • Long-term memory for characters.



MacOS Microphone Issue for UE 5.0 and 5.3 only:
  • The Convai plugin requires microphone access in Unreal Engine (UE) 5.0 and 5.3 on MacOS. Find steps on how to enable microphone access here.



Unreal Engine 4 compatibility:
  • Compatible with Unreal Engine versions 4.26 and 4.27, check our documentation link for a hassle-free installation process.



Need Support or Have Questions?
  • If you encounter any issues or have questions, feel free to reach out to us at support@convai.com or join the community on Discord Our team is dedicated to providing you with the support you need to make the most out of Convai.


Experience the future of interactive storytelling with our plugin. Sign up today and take your projects to the next level!

Technical Details

Features:
  • Intelligent realtime open-ended conversation capabilities
  • Lipsync
  • Multiple Languages support
  • Actions
  • Knowledge Base
  • Multiplayer and voice chat
  • Intelligent Animations
  • Speech To Text
  • Text To Speech

Code Modules:

  • Convai - Runtime

Number of Blueprints: 10

Number of C++ Classes: 23

Network Replicated: Yes

Supported Development Platforms: Windows

Supported Target Build Platforms: Windows - Android