MindMaker Machine Learning AI Plugin

Aaron Krumins - Code Plugins - Nov 6, 2020

AI Plugin that enables a variety of python based Machine Learning libraries within Unreal Engine

  • Supported Platforms
  • Supported Engine Versions
    4.27, 5.0, 5.2 - 5.3
  • Download Type
    Engine Plugin
    This product contains a code plugin, complete with pre-built binaries and all its source code that integrates with Unreal Engine, which can be installed to an engine version of your choice then enabled on a per-project basis.


Introduction to MindMaker: https://www.youtube.com/watch?v=ERm_pZhAPIA

Blueprints Overview: https://youtu.be/Tuo423NujEk

Discord Group: https://discord.gg/shxFwtmsHa


Github Documentation: https://github.com/krumiaa/MindMaker

The MindMaker AI Plugin is an open-source plugin that enables games and simulations within UE4 and UE5 to function as environments for training autonomous machine learning agents. The plugin facilitates a network connection between an Unreal Project containing the learning environment, and a standalone machine learning library used by the agent to optimize whatever it is attempting to learn. The standalone machine learning library can either be a custom python script in the event you are creating your own ML tool using MindMaker’s Remote ML Server, or it could be a precompiled learning engine such as MindMaker’s DRL Engine(Stable-Baselines3 Algorithms). Regardless of which option you choose, with the MindMaker AI Plugin developers and researchers can easily train machine learning agents for 2D, 3D and VR projects.

Use cases include robotic simulation, autonomous driving, generative architecture, procedural graphics and much more. MindMaker AI Plugin provides a central platform from which advances in machine learning can reach many of these fields. For game developers, the use cases for self-optimizing agents include controlling NPC behavior, prototyping game design decisions, and automated testing of game builds.

Algorithms currently supported include Stable-Baselines3 : Actor Critic ( A2C ), Deep Deterministic Policy Gradient (DDPG) , Deep Q Network ( DQN ), Proximal Policy Optimization ( PPO ), Soft Actor Critic ( SAC ), Twin Delayed DDPG ( TD3 )

Technical Details


  • Implement python based ML libraries directly in Unreal Engine with the MindMaker Client Server files – See RemoteML Example and Documentation
  • Support for OpenAI Gym custom environments
  • Precompiled Deep Reinforcement Learning Package for production use cases – auto-launches at start of game / simulation
  • Github Support - https://github.com/krumiaa/MindMaker
  • Modular Design for Easy Integration
  • Direct Access to Neural Networks via Blueprints
  • Configurable Example projects included with the MindMaker’s DRL Engine

Code Modules:

  • MindMakerBPLibrary - Developer, CoreUtility - Runtime, SIOJson - Runtime, SocketIOClient - Runtime, SIOJEditorPlugin – Developer,

Number of Blueprints: 0

Number of C++ Classes: 18

Network Replicated: No

Supported Development Platforms: Win64

Supported Target Build Platforms: Win64

Documentation: https://github.com/krumiaa/MindMaker


Cart Pole: Creating a Custom Deep Reinforcement Learning Agent in UE4

Automated Stock Trading: Build a Bitcoin Bot In Unreal Engine 4

Important/Additional Notes: Download Learning Engine and Starter Content