Vive Mocap Kit

Average Rating:  
X Rating Failed

Using SteamVR tools for real-time motion capture

  • Supported Platforms
  • Supported Engine Versions
    4.17

Description


The plugin is intended to retarget real-time human body motion to Unreal Engine’s skeletal mesh by using SteamVR-compatible VR Headset (HTC Vive), Motion Controllers and tracked devices (Vive Trackers). It supports custom skeletal meshes and can be used both for motion capture recording and for in-game player body representation. Transforms of untracked bones are reconstructed by using inverse kinematics.

The plugin supports tracking of feet, knees, flexible spine, shoulders, elbows and hand palms. Demo project includes a level ready to perform motion capture and save result animations in Anim Sequence for future export in FBX. Duration of Anim Sequence assets is limited to 60 seconds.

Prerequisites: UE4 SteamVR plugin, SteamVR-compatible VR Headset, two Motion Controllers, and one or more Vive Trackers.

Video #1 (4 trackers): https://www.youtube.com/watch?v=rotTd9Yx6qA

Video #2 (4 trackers): https://www.youtube.com/watch?v=Qa_wmv4i9n4

Video #3 (full short session with 3 trackers): https://www.youtube.com/watch?v=ZkK5gZBhRLM


Plan for a future updates

* Fix IK-target bones translation bug (current workaround: directly update IK targets in anim blueprint). IK target bones are only valuable if you capture directly to custom skeleton with IK rig. Target release date: 2017/10/10.

* Fix root bone rotation bug. Target release date: 2017/10/10.

* Capture without motion controllers (to have a free hands). Target release date: 2017/10/20.

* Capture without VR headset and controllers (only 2 Base Stations + Link Box + Vive Trackers). Target release date: 2017/10/20.

Technical Details


Features: (Please include a full, comprehensive list of the features of the product)

  • Automatic mesh-to-body calibration
  • Manual calibration
  • Custom skeletons are supported
  • Support of twist bones
  • Skeletal Mesh Pose exported to set of Transform variables for flexible Animation Blueprint setup
  • Skeletal Mesh Pose exported to Pose Snapshot object for easy Animation Blueprint setup
  • Source code is included.

Code Modules: (Please include a full list of each Plugin module and their module type (Runtime, Editor etc.))

  • ViveMocapKit (Developer)

Number of Blueprints: 0

Number of C++ Classes: 2

Network Replicated: No

Supported Development Platforms: Win64/SteamVR

Supported Target Build Platforms: Win64/SteamVR

Documentation: https://drive.google.com/open?id=0B6s-2uvAvszmLVRPOUFhTnVXTE0

Example Project: https://drive.google.com/open?id=0B6s-2uvAvszmVmxEZmhiaDFPNlk

Executable Demo (try before buy): https://drive.google.com/file/d/0B6s-2uvAvszmTHd1c2ZDa3dVQVU (see readme first)

Comments

!

Previous Next
  • Edit
  • Preview
  • Help
Enter
Login to comment
X Report this Comment
Report
X Attention


close
X Edit this Comment
  • Edit
  • Preview
  • Help
Update
X Remove this Comment

Are you sure you want to remove this comment?

Remove
X Attention