From Thanos to She-Hulk: How Digital Domain Brought the MCU's Latest Superhero (and Attorney) to Life

From Thanos to She-Hulk: How Digital Domain Brought the MCU's Latest Superhero (and Attorney) to Life

Brie Clayton November 8, 2022

0 Comments

AI-Powered Facial Capture and a First-of-its-Kind CG Body Manipulation Tool Used to Create the She-Hulk: Attorney at Law Title Character, Along With a Droid Named K.E.V.I.N.

To help bring Marvel Studios' latest superhero to life in She-Hulk: Attorney at Law, Oscar-winning VFX studio Digital Domain sought inspiration in the Marvel Cinematic Universe's (MCU) greatest villain: Thanos. Building on the technology it developed for the Avengers' foe, Digital Domain transformed the five-foot-four Tatiana Maslany into a six-foot-seven green giant, without sacrificing the nuance of the Emmy-winner's performance. But despite some similarities, She-Hulk is a character unlike anything seen before, requiring machine learning facial capture, face swapping and a handful of tools created specifically for the show that will redefine how CG characters and clothing interact.

If you have enough time and resources, a VFX studio can generally come up with a way to create even the most incredible effects for any medium, including TV. But in the case of She-Hulk: Attorney at Law, the first thing we had to do was determine if the project was even possible, said Jan Philip Cramer, Digital Domain VFX supervisor. Nearly every aspect of creating She-Hulk required us to do something that had never been done before, which made it really exciting as an artist.

Before Digital Domain could even begin working on the series, the VFX studio spent months testing the technology to determine how it could deliver such an ambitious character on an episodic schedule. Thanos appeared on screen in Avengers: Endgame for just over 12 minutes and had hundreds of artists working on him for years, but for the nine-episode season of She-Hulk: Attorney at Law, the VFX team was asked to create 43 minutes of screentime for the title character. In one episode alone, She-Hulk gives a deeply emotional monologue lasting nearly two solid minutes without cutting away.

To bring the ambitious project to life, Digital Domain determined that it would need to approach the character on multiple fronts, starting with a handful of practical filmmaking tricks and its own machine learning-powered facial capture systems. The rest - including a new way to create CG clothing and muscles - would need to be invented along the way.

Introducing: She-Hulk

In total, Digital Domain contributed nearly 1,000 VFX shots to She-Hulk: Attorney at Law, including 660 shots of She-Hulk alone. The filmmakers began with the live-action performances from Maslany, who wore a head-mounted camera and a full set of active markers. She also routinely performed on a series of elevated risers to give the CG She-Hulk the proper eyeline. In the scenes where risers were not possible, Maslany wore a backpack containing a eyeline marker above her head.

Digital Domain was then able to analyze that footage using its proprietary machine learning powered tool, Masquerade 2.0, a facial capture system. As Masquerade's precursor did with Josh Brolin, Maslany's nuanced mannerisms were analyzed by the software to generate a 3D, photorealistic CG mask, down to the pores in the skin. But where the older system required Brolin to record several high-resolution training data sets, Masquerade 2.0 was able to generate its own, giving artists the ability to continually edit and alter the results, while the machine learning smoothed out the rough edges. A process that used to take months, even years for each sequence, was instead done in days and weeks.

With She-Hulk's CG face built, artists began adding the finishing touches, including her hair. Where Maslany's brunette hair is relatively short and curly, She-Hulk's jet-black hair is long and silky. She also sported multiple hairstyles throughout the season - from business casual to date-night formal - requiring the VFX team to create multiple versions in Houdini. In another first for the Digital Domain team, the green-skinned She-Hulk wore several different applications of makeup. Given the character's unique skin tone, artists went through countless variations to find looks that fit. All scenes were then animated in Maya and rendered in V-Ray.

Along with Masquerade, Digital Domain also employed its face-swapping tool Charlatan to help capture the transition from Jennifer Walters to She-Hulk, as well as creating digidoubles for both Maslany and Jameela Jamil's Titania. For scenes where stunt teams were required - such as the courtroom battle between She-Hulk and Titania - the production filmed the trained stunt professionals, and Digital Domain then swapped their faces out with Maslany (as She-Hulk) and Jamil.

Body Moving & the All-New ShapeWear System

Along with She-Hulk's face, Digital Domain also needed to create her body, which presented challenges unique to this series. The team began by using a PolyStrip system - containing several smaller segments that form the body's contours - then employing Houdini to create the muscles and skin. To capture her movements, Maslany frequently wore an inertial Xsens mocap suit, and also spent a significant amount of time under Vicon optical cameras. Next came the clothing, and that's where things became a little more complicated.

Creating a superhero costume for a CG character is a significantly different process than creating everyday clothes, especially women's clothes. Where Thanos, for instance, wore a single, form-fitting outfit (with a few variations) meant to show off his physique, She-Hulk wore 12 outfits that adjusted to her body. Women's clothes, however, are often meant to accentuate certain areas and even exert influence over the body. Pants and skirts, for example, are

LINK:	https://creativecow.net/from-thanos-to-she-hulk-how-digital-domain-bro...
	See more stories from creativecow

Most recent headlines