6月の無料コンテンツが利用可能になりました!

PoseAI LiveLink

Connect your phone for real-time motion capture input

  • サポートされたプラットフォーム
  • サポートされたエンジンバージョン
    4.25 - 4.27, 5.0
  • ダウンロードのタイプ
    エンジン プラグイン
    この製品には、コード プラグインが含まれており、ビルド済みのバイナリと Unreal Engine に統合される全ソースコードが完備されています。任意のエンジン バージョンにインストールし、プロジェクト毎に有効化することが可能です。

This plugin adds a LiveLink source for connecting with Pose Camera, our full body motion capture app developed for mobile devices. This allows you to use your phone to capture and stream live, low-latency animation data into the Unreal Engine. With a single node in your animation blueprint LiveLink allows you to take an incoming stream and animate rigged characters.


Pair your phone and record animations using Unreal's tools or use motion input from players to generate exciting new gameplay.


In order to effectively use this software you need the Pose Cam app installed on your phone. The app is now available on the iOS App Store. There is a free trial period and then a subscription is required. We recommend an iPhone 8 or later (ideally an Iphone XR/XS or later), or a recent IPad (A12 chipset or better). We hope to release a version for Android in the future.


No meshes, characters or content included in the plugin. Meshes used in project gallery are available from third parties on the Unreal Marketplace.


Newest Changes 

  • Smoother animations with our 1.2 app update - now bringing our improved AI to Desktop mode as well
  • UE plugin v1.33 - supports UE5, added DazUE to rig presets (needs 1.2 update to iOS app to utilize) and corrected sideways motion if player moves in camera (x direction needed to be flipped)
  • Added a demo UE5 project using the more elaborate UE5 mannequins


Keep abreast of other changes in our GitHub changelog file



To upgrade to the latest version of the plugin, click under your Engine Version from the Epic Games Unreal launcher, where it says "Installed Plugins!", and then click update next to our plugin.

テクニカルノート

Features:

  • Works with simple phone cameras - we do not need depth sensors, and we get game ready frame rates even on older phones
  • Sandboxed AI - Our AI runs fully on the connected phone: no server queries and no competing with Unreal for desktop or console resources.
  • Multiple rigs - Select from different rigs (UE4 Mannequin, MetaHuman, Mixamo, DazUE). We include fully articulated hands.
  •  Different modes - tailor for different phone camera setups, such as Room (full body standing at a distance), Desktop (upper body seated at your pc), or Portrait (full body in tighter spaces).
  • Player Events - simplify game logic by using our motion input events similar to keyboard input
  • Convenience options - stream in third-person or mirror mode (i.e. flipped left/right sides), separate root motion etc.

Code Modules:

  •  PoseAILiveLink


Supported Development Platforms: Windows

Supported Target Build Platforms: Windows, Mac

Documentation: here

Simple Mocap Animation Project - UE4: here UE5: here

Advanced Mocap Event Gameplay Project: here