Velox Player - Volumetric 3D Video

Velox XR - Code Plugins - Oct 4, 2023
Not Yet Rated

Velox Player is a code plug-in that imports volumetric video files in the VLX format recorded on mobile devices with depth cameras.

  • Supported Platforms
  • Supported Engine Versions
    5.1 - 5.4
  • Download Type
    Engine Plugin
    This product contains a code plugin, complete with pre-built binaries and all its source code that integrates with Unreal Engine, which can be installed to an engine version of your choice then enabled on a per-project basis.

**** UPDATE ****

Velox Player plugin version 0.6b Update:

  • Portrait mode
  • Materials Management 
  • Dither (Default)
  • Full Opaque
  • NEW Chromakey
  • NEW Transparent material 
  • NEW Transparent Edge material 
  • Color Correction Material Properties 
  • TrackActor component
  • iOS Support

Velox Player is a code open-source plug-in that imports volumetric video files in the VLX format recorded on mobile devices with depth cameras. The VLX format allows creators to bring photorealistic appearance of people and environments into Unreal Engine scenes. The video frames are turned into animated geometry with textures which is fully compatible with the real-time rendering pipeline of Unreal Engine. With added benefits of the camera tracking and elimination of the background it makes a perfect tool to virtual production and gaming studios for creating immersive experiences based on real-life performances.

The video recording introduction and tutorial is here.

In order to record a 3D video you need an app installed on a device with a depth camera. For example, there is an official iOS app “V3L Camera '' available in the App Store for FREE. The process is fully mobile and requires:

  • NO green screen
  • NO special studio
  • NO camera calibration

The VLX format contains the following data channels:

  • Camera tracking with world position and orientation - required
  • Video in RGB format (compressed) - required
  • Depth in Grayscale format - required
  • Time code frame synchronization - required
  • Mask channel in Grayscale format (compressed) - optional
  • Normals channel in RGB format (compressed) - optional
  • Human tracking - optional
  • Audio file in the WAV format - optional

To get started open our sample project for UE5.2 with basic features and effects you can create using our sample VLX footages which are available for everyone to download video1, video2, video3, video4.

  • Full frame reconstruction in 3D
  • Filter human subjects from the background with depth using tracking of Region of Interest (ROI) with AI (available in separate Plugin: Velox Neuro)
  • Remove the background with human masks generated by AI (available in separate Plugin: Velox Neuro)
  • Apply UE visual effects with fog, particles, lighting and reflection.
  • Virtual set extension example

Watch these preview videos of the sample project:


Visit our product page.

The plugin is compatible with Windows, Mac and Android platforms and also tested on Android based standalone VR headsets.

Technical Details

The Velox Player plugin implements the Media Player Framework interface to play video files rendering each video frame as a dynamic 3D mesh with video texture. By dropping in a VLX file into your project’s Content folder will create 4 assets:

  • Media Source assets pointing to your VLX file
  • Media Player of VLX media source assets
  • Actor Blueprint asset with components for rendering the media player output
  • Audio asset from your VLX file

Features: (Please include a full, comprehensive list of the features of the product)

  • Real-time dynamic mesh animation based on depth from the camera
  • Video Mesh texture animation 
  • Culling mesh polygons based on the tracked region of interest (ROI)
  • Culling mesh polygons with a Truncation Cube
  • Alpha masks to cull mesh polygons
  • Animated Normal maps
  • Color correction: brightness and contrast

Code Modules:

  • VLXCore
  • VLXVideo
  • VLXCamera
  • VLXOfflineLoader
  • VLXImgMediaFactory
  • VLXImgMediaEngine
  • VLXImgMediaAssets
  • VLXImgMedia
  • VLXEditor

Number of Blueprints: 7

Number of C++ Classes: 40

Supported Development Platforms: Windows, Mac

Supported Target Build Platforms: Windows, Mac, Android

Documentation: Link

Example Project: link

Discord Server: link