Cosmos by Leartes: All products 50% off

Geppetto

X and Immersion - Code Plugins - Sep 19, 2023

Gepetto simplifies the process of creating realistic lip-sync and facial animation for your characters. Easily pre-generate or use it in run time to create expressive and lifelike animations.

  • Supported Platforms
  • Supported Engine Versions
    5.1 - 5.3
  • Download Type
    Engine Plugin
    This product contains a code plugin, complete with pre-built binaries and all its source code that integrates with Unreal Engine, which can be installed to an engine version of your choice then enabled on a per-project basis.

🎬 Youtube presentation video


💡 With its intuitive interface, you can easily input audio or text files and have the tool automatically generate a corresponding lip sync animation. You can also customize the animation by adjusting the mouth shape and timing for your 3D or 2D characters.


🎮 The tool uses advanced AI algorithms to automatically generate facial animations that match the timing and tone of your character's speech, freeing you up to focus on other aspects of your project.


Whether you're creating a game, an animated film, or any other type of interactive content, Geppetto is a powerful tool that can help you bring your characters to life.



✔️ Support

  • Join the X&Immersion discord to chat with the technical support & share feedback with others;
  • Or contact us at contact@xandimmersion.com

Technical Details

🎬 Youtube tutorial video


PLEASE NOTE: The plugin may not work correctly if the Unreal Engine version of the downloaded MetaHuman is not the same as the version of the project. For example, Geppetto doesn't work well with MetaHumans downloaded with UE5.0 or 5.1 imported into a UE5.3 project. You need to download a MetaHuman with UE5.3.


Features:

  •  Generate phonemes based on audio file and sentence
  •  Automate lipsync creation for MetaHuman
  •  Sync audio play time with lipsync animation

Code Modules:

  •  GeppettoRuntime [Runtime] (C++ Blueprint Library and Actor Components)
  •  GeppettoEditor [Editor] (Blueprint Editor Utility Widget)


📓 Documentation link


Number of Blueprints: 4 (Editor Utility widget, Child Actor and Actor Components)

Number of C++ Classes: 4 (1 runtime and 3 editor)

Number of C++ Enums: 1

Number of C++ Structs: 4

Supported Development Platforms: Available for Unreal 5.1, 5.2 and 5.3.

Supported Target Build Platforms: Tested with Windows x64, MacOS and Linux.