The Spring Creator sale is here! Save up to 70% on select products now through April 18.

Luma AI

Luma AI - Code Plugins - Jan 12, 2024
11
4.09 out of 5 stars(11 ratings)
  • 64%
  • 0%
  • 18%
  • 18%
  • 0%

Interactive NeRF and Gaussian Splatting powered by Luma, the 3D AI Company.

  • Supported Platforms
  • Supported Engine Versions
    5.1 - 5.3
  • Download Type
    Engine Plugin
    This product contains a code plugin, complete with pre-built binaries and all its source code that integrates with Unreal Engine, which can be installed to an engine version of your choice then enabled on a per-project basis.

FAQs, Sample Scenes and up-to-date changelog: https://lumalabs.ai/ue .


3D has always been a powerful medium but plagued by the difficulty of creation and sharing. We see it in movies and games, but most of us can never create 3D. Luma changed that once and for all. Today we are changing sharing and where you can experience 3D. Spectacular 3D will now be everywhere.


The Luma AI Unreal Engine plugin allows you to import and render photorealistic captures via Neural Radiance Fields (NeRF) or Gaussian Splatting.


For interactive scenes based on Gaussian Splatting, we recommend to capture them using Luma iOS or Luma Web for best quality and performance. The plugin does support Gaussian Splat scenes exported from other tools (such as the original research implementation) in the .ply format, but does not guarantee feature parity or support for these scenes.


Clean up your scenes using cropping and culling tools, relight them via analytical or sun lights, and craft your perfect shots by combining photorealistic captures with Unreal's vast capabilities in VFX and real-time graphics.


Features

  • Drag-and-drop your .ply or .luma files seamlessly into the editor to instantly create Blueprints that are ready for use.
  • Real-time rendering with Luma's cutting edge renderers based on Gaussian Splatting and NeRF
  • Experimental relighting support
  • Crop and cull support to edit your scenes
  • Implementation based fully on shaders and Unreal's Niagara particle system
  • Demo projects available on the Luma Unreal hub


Limitations

  • Shadows are not supported for Gaussian Splatting scenes
  • Camera previews display incorrectly
  • Large scenes with more than 2 million Gaussians need to be chunked, which can result in visible seams between chunks
  • Ray tracing does not work with translucent materials such as the Gaussian Splat Niagara system
  • Compositing multiple scenes based on Gaussian Splatting might result in objects being drawn in an incorrect order

Technical Details

Features: (Please include a full, comprehensive list of the features of the product)

  • Drag-and-drop your .ply or .luma files seamlessly into the editor to instantly create Blueprints that are ready for use
  • Real-time rendering with Luma's cutting edge renderers based on Gaussian Splatting and NeRF
  • Experimental relighting support
  • Crop and cull support to edit your scenes
  • Implementation based fully on shaders and Unreal's Niagara particle system
  • Demo projects available on the Luma Unreal hub

Code Modules: (Please include a full list of each Plugin module and their module type (Runtime, Editor etc.))

  •  LumaRuntime (Runtime)
  •  LumaEditor (Editor)

Number of Blueprints: 0 (these are automatically generated on import)

Number of C++ Classes: 6

Network Replicated: No

Supported Development Platforms: Win64, Linux (tested on Ubuntu 20.04 / 22.04), MacOS (Apple Silicon)

Supported Target Build Platforms: Win64, Linux (tested on Ubuntu 20.04 / 22.04), MacOS (Apple Silicon)

Documentation: https://lumalabs.ai/ue

Example Project: https://lumalabs.ai/ue (Section: Sample Project Downloads)