MindMaker AI Plugin

Aaron Krumins - Nov 6, 2020

AI Plugin that enables Machine Learning within Unreal Engine

  • Supported Platforms
  • Supported Engine Versions
  • Download Type
    Engine Plugin
    This product contains a code plugin, complete with pre-built binaries and all its source code that integrates with Unreal Engine, which can be installed to an engine version of your choice then enabled on a per-project basis.

Video: https://youtu.be/ERm_pZhAPIA

The MindMaker AI Plugin is an open-source plugin that enables games and simulations within UE4 to function as environments for training autonomous machine learning agents. The plugin facilitates a network connection and subsequent launch of a compatible MindMaker Learning Engine, for instance the Deep Reinforcement Learning Engine(Stable Baselines Algorithms). Agents can currently be trained using deep reinforcement learning, a machine learning approach that combines neural networks with a learning model to sculpt agent behavior. With MindMaker, developers and researchers can easily train machine learning agents for 2D, 3D and VR projects.

Possible use cases include robotic simulation, autonomous driving, generative architecture, procedural graphics and much more. MindMaker AI Plugin provides a central platform from which advances in machine learning can reach many of these fields. For game developers, the use cases for self-optimizing agents include controlling NPC behavior (in a variety of settings such as multi-agent and adversarial), prototyping game design decisions, and automated testing of game builds.

Algorithms presently supported include Stable Baselines : Actor Critic ( A2C ), Sample Efficient Actor-Critic with Experience Replay (ACER), Actor Critic using Kronecker-Factored Trust Region ( ACKTR ), Deep Q Network ( DQN ), Proximal Policy Optimization ( PPO ), Soft Actor Critic ( SAC ), Twin Delayed DDPG ( TD3 )

Technical Details


  • Real-time bi-directional communication with a compatible MindMaker Learning Engine
  • Auto-launch of the MindMaker Learning Engine
  • Enables Cutting Edge Machine Learning Within UE4
  • Direct Access to Neural Networks via Blueprints
  • Two Example Projects Included
  • Modular Design for Easy Integration
  • Socket.IO v1.4+ support

Code Modules:

  • MindMakerBPLibrary - Developer, CoreUtility - Runtime, SIOJson - Runtime, SocketIOClient - Runtime, SIOJEditorPlugin – Developer,

Number of Blueprints: 0

Number of C++ Classes: 18

Network Replicated: No

Supported Development Platforms: Win64

Supported Target Build Platforms: Win64

Documentation: http://www.autonomousduck.com/plugin.html


Cart Pole: Creating a Custom Deep Reinforcement Learning Agent in UE4

Automated Stock Trading: Build a Bitcoin Bot In Unreal Engine 4

Example Project: https://drive.google.com/file/d/1Bs7mVUCt5G3-sBDFPe8oZCv5GZC4V7cj/view?usp=sharing

Important/Additional Notes: Download Learning Engine and Starter Content