Geppetto

X and Immersion - 代码插件 - 2023/09/19

Gepetto simplifies the process of creating realistic lip-sync and facial animation for your characters. Easily pre-generate or use it in run time to create expressive and lifelike animations.

  • 支持的平台
  • 支持的引擎版本
    5.1 - 5.4
  • 下载类型
    引擎插件
    此产品包含一款代码插件,含有预编译的二进制文件以及与虚幻引擎集成的所有源代码,能够安装到您选择的引擎版本中,并根据每个项目的需求启动。

⚠️ Please watch this video for Metahuman integration ⚠️


🎬 Youtube presentation video


💡 With its intuitive interface, you can easily input audio or text files and have the tool automatically generate a corresponding lip sync animation. You can also customize the animation by adjusting the mouth shape and timing for your 3D or 2D characters.


[Version 1.1 new features!]


🎮 The tool uses advanced AI algorithms to automatically generate facial animations that match the timing and tone of your character's speech, freeing you up to focus on other aspects of your project.


Whether you're creating a game, an animated film, or any other type of interactive content, Geppetto is a powerful tool that can help you bring your characters to life.



✔️ Support

技术细节

🎬 Youtube Metahuman integration tutorial


PLEASE NOTE: The plugin may not work correctly if the Unreal Engine version of the downloaded MetaHuman is not the same as the version of the project. For example, Geppetto doesn't work well with MetaHumans downloaded with UE5.0 or 5.1 imported into a UE5.3 project. You need to download a MetaHuman with UE5.3.


Features:

  •  Generate phonemes based on audio file and sentence
  •  Automate lipsync creation for MetaHuman
  •  Sync audio play time with lipsync animation

Code Modules:

  •  GeppettoRuntime [Runtime] (C++ Blueprint Library and Actor Components)
  •  GeppettoEditor [Editor] (Blueprint Editor Utility Widget)


📓 Documentation link


Number of Blueprints (without demo): 4 (Editor Utility widget and Actor Components)

Number of C++ Classes: 12 (8 runtime and 4 editor)

Number of C++ Enums: 2

Number of C++ Structs: 9

Supported Development Platforms: Available for Unreal 5.1 (old version), 5.2, 5.3 and 5.4 (new version).

Supported Target Build Platforms: Tested with Windows x64, MacOS and Linux.