Image courtesy of HBO

HBO’s Westworld turns to Unreal Engine for in-camera visual effects

Ryan Mayeda |
July 30, 2020
HBO’s hit sci-fi series Westworld explores the technological landscape of the near future, from lifelike robots and advanced artificial intelligence to autonomous vehicles and the blockchain. In season 3, showrunners Jonathan Nolan and Lisa Joy and VFX Supervisor Jay Worth also turned to futuristic techniques behind the camera, with help from Unreal Engine.
 
 
Always eager to push the limits of the latest production technology, the production team had been brainstorming about how to leverage in-camera visual effects and virtual production processes into the series since the show’s first season. Because the show is captured on film, incorporating the real time performance of Unreal Engine required an extra level of planning and customization. 
 
In Season 3 of Westworld, the iconic City of Arts and Sciences complex in Valencia, Spain stands in for Delos headquarters. Exterior shots were captured on location, however the interior shots that the Westworld creative team envisioned – with the elaborate complex seen out the window of Charlotte Hale’s (Tessa Thompson) office – were impacted by physical space limitations on set. Epic Games, Fuse Technical Group, Profile Studios, and Spanish-based VFX studio El Ranchito stepped in to help HBO create the desired environment on a 50 by 22-foot LED wall on a stage in Los Angeles.
 
Epic worked closely with El Ranchito, who captured photogrammetry of the City of Arts and Sciences and recreated it as a dynamic Unreal Engine scene; Fuse Technical Group, who handled construction and integration of the LED wall, including mapping of the scene through Unreal Engine’s nDisplay tool; and Profile Studios, who managed streaming the Unreal scene to the LED wall and the camera tracking.
 
Hale’s office was designed to have imposing floor-to-ceiling windows that overlooked the main artery of the City of Arts and Sciences complex. Using the LED walls and Unreal Engine for real-time in-camera visual effects enabled the Westworld team to capture physically accurate lighting from the environment coming through the glass, with accurate reflections on the sleek interior furnishings – all with the right parallax as the camera moved throughout the scene.
Image courtesy of John P. Johnson/HBO
“Using an LED wall was the perfect solution to many of the challenges faced on set, which was mainly a lack of available space to get the camera angles desired in this limited interior,” explained Connie Kennedy, Head of the LA Lab at Epic Games. “We were able to use the LED wall to track the camera angles needed, in the limited interior set on stage. Another unique challenge was optimizing this process to work with film, which is Jonathan’s preferred way of shooting. Fuse Technical Group was able to source hardware that allowed us to sync the shutter of the film camera to the content on the LED wall.”
 
The unique needs of the Westworld shoot required some custom optimizations from the Unreal Engine team including a rotated render output feature for LED walls. This is now available to everyone in the current Unreal Engine 4.25 release.

To learn more, visit our Virtual Production hub for more case studies, podcasts, and insights.

    Get Unreal Engine today!

    Get the world’s most open and advanced creation tool. 
    With every feature and full source code access included, Unreal Engine comes fully loaded out of the box. 
    News
    August 19

    Unreal Engine 4.27 released!

    Creators across all industries have something to celebrate with this release: In‑camera VFX goes next-level with a slew of efficiency, quality, and ease-of-use improvements, while other highlights include path tracing for stunning final images, out-of-the-box access to Oodle and Bink, production-ready Pixel Streaming, and much more.
    News

    Unreal Engine 4.27 released!

    Creators across all industries have something to celebrate with this release: In‑camera VFX goes next-level with a slew of efficiency, quality, and ease-of-use improvements, while other highlights include path tracing for stunning final images, out-of-the-box access to Oodle and Bink, production-ready Pixel Streaming, and much more.
    Event
    October 5

    Build: Architecture

    Build: Architecture 2021 is coming! Join us on November 2 for architectural configurators, digital twins, open worlds, and more. Registration now open. 
    Event

    Build: Architecture

    Build: Architecture 2021 is coming! Join us on November 2 for architectural configurators, digital twins, open worlds, and more. Registration now open. 
    Event
    September 28

    Join us at Autodesk University 2021

    Our activities at this year’s Autodesk University, October 5-7, will be all about connectivity—connecting data, technology, and people to make better experiences through real-time technology. Join us at our virtual booth, at the AU Media and Entertainment Keynote, or at one of our many product demonstrations and sessions.
    Event

    Join us at Autodesk University 2021

    Our activities at this year’s Autodesk University, October 5-7, will be all about connectivity—connecting data, technology, and people to make better experiences through real-time technology. Join us at our virtual booth, at the AU Media and Entertainment Keynote, or at one of our many product demonstrations and sessions.