Black Friday Coupon now active through January 31
Content Detail
PoseAI LiveLink
Connect your phone for real-time motion capture input
- Supported Platforms
- Supported Engine Versions4.25 - 4.27
- Download TypeEngine PluginThis product contains a code plugin, complete with pre-built binaries and all its source code that integrates with Unreal Engine, which can be installed to an engine version of your choice then enabled on a per-project basis.
Description
Reviews
Questions
This plugin adds a LiveLink source for connecting with Pose Camera, our full body motion capture app developed for mobile devices. This allows you to use your phone to capture and stream live, low-latency animation data into the Unreal Engine. With a single node in your animation blueprint LiveLink allows you to take an incoming stream and animate rigged characters.
Pair your phone and record animations using Unreal's tools or use motion input from players to generate exciting new gameplay.
In order to effectively use this software you need the Pose Cam app installed on your phone. The app is now available on the iOS App Store. There is a free trial period and then a subscription is required. We recommend an iPhone 8 or later (ideally an Iphone XR/XS or later), or a recent IPad (A12 chipset or better). We hope to release a version for Android in the future.
No meshes, characters or content included in the plugin. Meshes used in project gallery are available from third parties on the Unreal Marketplace.
Beta ChangeLog
v1.01 - Some users reported UE crashes typically during a TArray<Transform> ResizeGrow operation from within LiveLink. We could not consistently replicate the issue but this fix, pre-allocating the TArray size, stopped any such crashes on our systems. Please let us know if you still see an issue post fix.
v1.02 - Plugin now also built for MacOS. Added blueprint category to PoseAILiveLinkRetargetRotations property as lack prevented some builds.
v1.10 - Plugin now provides blueprint events notifying of changes in the subject's visibility in the camera, and some helpful additional data to use the mocap as a character controller for motion. See our updated example project or website for more info on these features.
v1.11 - FIxed a couple issues which were preventing Packaged builds from running.
v1.2 - Enabled a host of gameplay events, added convenience nodes and reduced packet size for lower bandwidth.
v1.3 - Fixed some bugs
To upgrade to the latest version of the plugin, click under your Engine Version from the Epic Games Unreal launcher, where it says "Installed Plugins!", and then click update next to our plugin.
Technical Details
Features:
- Works with simple phone cameras - Our AI uses ordinary camera video. We do not need LIDAR or depth sensors, and we get game ready frame rates even on older phones
- Sandboxed AI - Our AI runs fully on the connected phone: no server queries and no competing with Unreal for desktop or console resources.
- Multiple rigs - Select from different rig configurations (UE4 Mannequin, MetaHuman, Mixamo) in the Source setup menu. We include fully articulated hands.
- Different modes - tailor for different phone camera setups, such as Room (full body standing at a distance), Desktop (upper body seated at your pc), or Portrait (full body in tighter spaces).
- Player Events - simplify game logic by using our motion input events similar to keyboard input, like Footstep, Jump, Crouch, Flap arms and much more.
- Convenience options - stream in third-person or mirror mode (i.e. flipped left/right sides), include lateral motion in root or in pelvis translation, etc.
Code Modules:
- PoseAILiveLink
Supported Development Platforms: Windows
Supported Target Build Platforms: Windows, Mac
Documentation: here
Simple Mocap Animation Project: here
Advanced Mocap Event Gameplay Project: here
Related Content
