Working with HBO and Sister Productions, Framestore used cutting edge technology to bring to life The Baby
Brie Clayton July 7, 2022
0 Comments
Providing VFX work on over 350 shots Framestore used machine learning and detailed environment work to create a photorealistic baby and stunning scenes for the offbeat HBO show
In this eight-episode dark comedy viewers are pulled into the world of protagonist Natasha who acquires a baby she does not want. On top of this the infant holds dark powers which leads to destruction and torment for not only Natasha but those around her. Tasked with helping build the world of The Baby, Framestore dug into their expertise in working on digi-doubles, face replacement and invisible environment effects.
The main question was: if one of the main cast members is a baby, how can we use VFX to help the show work, with all the limitations that entails? said Owen Braekke-Carroll. As a base, we had to find a practical method of approaching things as much as possible whilst leaning on VFX only when needed.
With babies involved on set things were never predictable and shoot days could rapidly change at any point. At times there could be over five babies and a dog present, so the team built a bespoke and adaptable pipeline to complement the creative vision for the show.
Because we wouldn't know how these performances would link up, we had to treat the baby like a CG creature in every take. There was a potential that any shot could become a VFX shot, said Owen Braekke-Carroll. In post it really became about getting the best outcome based on each individual shot's needs. We'd end up having different workflows per shot and across each sequence. So, for one shot we might have a partially CG body over a prosthetic baby torso with a plate baby's head, and the next only replace the arm and add a machine learning face replacement. It was never really a consistent process; it was always about getting the best outcome from the inputs that were available.
The script often called for the baby to be asleep which turned out to be one of the biggest challenges the team faced. You can't shoot a baby asleep on a film set with a guarantee of the correct lighting and camera time, said Owen Braekke-Carroll. It might come together for some scenes, but you can't rely on a whole shoot day doing that.
To approach this problem, the babies on set were photographed at high frame rates in story context and played back at this slower speed. We then took those plates and digitally closed their eyes, before using a machine learning layer to give them a realistic look on top, added Owen Braekke-Carroll. This was trained on a closed eye data set, and that created a very effective and photographic output to add.
The ethos behind their approach however remained - to support the story invisibly rather than being the point of the story. The team tried not to completely replace the baby unless they had to, so they leant on real performance wherever possible, replacing only where it was necessary, or the script called for something eccentric or unconventional. They used a lot of reference, performance photography and video with the intent of creating additional material to use after the fact, whilst leveraging machine learning.
It was difficult to keep control of the facial elements because the team would have multiple shots of the babies which were also changing and growing over the course of the shoot. The same baby often looked different from shot to shot, let alone when they were trying to replace them or change their likeness or performance. Consequently, they had to work with ever-shifting boundaries about what a likeness actually is.
While it wasn't always the solution, machine learning was crucial. It worked really well especially when combined with more traditional methods to help sell a photographic likeness and performance, said Owen Braekke-Carroll. On set we captured specific elements for the purpose of machine learning to drive those models, in addition to the regular capture of the 3D scans and other usual reference. It was very exciting to be able to work to integrate new and developing tools into the Framestore pipeline.
The team also made good use of KeenTools, which are effectively smart tools for VFX and 3D artists, as a head tracking software to control facial performances such as closed mouths or smiles.
In the penultimate sequence of the series the Baby is seen drifting underwater. To achieve this safely with the cast, the VFX team used a combination of dry-for-wet photography combined with an underwater shoot, and CG digi-doubles.
With the mother holding the baby we had a blue screen stage which we then lit with polarised lights, cross polarised with the camera. This enabled us to remove much of the specularity off the face. We then shot it in high frame rate with a watery effect light, and that gave us the performance with the correct lighting of the baby, said Owen Braekke-Carroll. We used fans, so their hair and clothing moved, making it look like they were underwater. We then took the head of the performance to place on our digi body. The performances from the cast babies were so fantastic and it was a great way to keep them and still get the shots.
The show also involved some detailed environment work including a digital ocean, digital matte painting skies and split location work on a dilapidated cottage.
We had a recurring story location which involved an impossibly large cliff on the Southeast coast of England and at the bottom of it was a dilapidated cottage fronting straight onto the water, said Owen Braekke-Carroll. This location can't exist in reality, so we used a secondary location in Southeast Kent for the cottage set, which we were able to combine with a combination of CG, DMP and plat
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
06/05/2026
Gravity Media Chief RF Communications Engineer Glenn Willems uses Wisycom RF over Fiber and wireless solutions across major cycling events and international mar...
06/05/2026
A Sennheiser Spectera module is now available in Bitfocus Companion and Buttons, enabling direct integration of Spectera with the two software platforms. The mo...
06/05/2026
Ted Turner, the visionary media entrepreneur whose appetite for disruption helpe...
06/05/2026
Peacock is going all-in on the beautiful game - streaming all 104 FIFA World Cup...
06/05/2026
New pricing tiers for vocal/dialogue restoration tool
NoiseWorks Audio's AI-powered vocal and dialogue processing plug-in is now available in three diff...
06/05/2026
Popular mixing & routing software overhauled
Following a recent public beta test, RME have launched the final release version of the powerful mixing and rou...
06/05/2026
New SOS Video Feature
Focusrites ISA C8X is a milestone product that brings together the companys analogue heritage and their expertise in digital audio. Yo...
06/05/2026
Polands Miecznik-class frigates are part of the largest contract in Polish shipbuilding history. (Image Credit: PGZ Stocznia Wojenna)...
06/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/05/2026
Riedel Communications today announced the expansion of its leadership structure as part of a strategic initiative to strengthen both its operational management ...
06/05/2026
For nearly three decades, Veteran Production Sound Mixer and Five-time Emmy Award Winner Dirk Sciarrotta has helped define the sonic identity of the long-runnin...
06/05/2026
ZEISS CinCraft LensCore: Cinema Lens Looks for Compositing
Brie Clayton May 6, 2026
0 Comments
ZEISS announces the launch of CinCraft LensCore, a nove...
06/05/2026
Wisycom Solves Extreme RF Challenges Across Miles of Live Action for Gravity Med...
06/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/05/2026
Narrative Entertainment has partnered with Encompass to deliver high-quality subtitling of its Great! network content using the Altitude Intelligence AI assiste...
06/05/2026
SipRadius, widely recognized for making content processing and connectivity secure and seamless, is proud to launch a dramatic new approach to AI content creati...
06/05/2026
When the broadband and media industry gathers at ANGA COM in Cologne from May 19 to 21, Big Blue Marble will be at the forefront. The international broadcast an...
06/05/2026
Cinegy GmbH, a leading developer of software-defined television technology, is proud to exhibit at MPTS for the first time. Visitors to the stand will discover ...
06/05/2026
Val Jeanty Receives 2026 Doris Duke Artist Award Jeanty, a composer, percussionist, and turntablist, is the fourth Berklee recipient of the prestigious award ...
06/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/05/2026
When live cycling races and international marathons stretch for miles across cities and countryside, there is no margin for RF failure in live broadcast. As Chi...
06/05/2026
Oberkochen/Germany, May 5, 2026
ZEISS announces the launch of CinCraft LensCore, a novel solution for creating physically based cinematic lens looks for visual...
06/05/2026
06 May 2026
VEON's Kyivstar Authorized to Resell Starlink for Businesses & ...
06/05/2026
UKTV has secured the exclusive rights to the early back catalogue of iconic Australian drama series Neighbours, following a landmark content deal with Fremantle...
06/05/2026
Wednesday 6 May 2026
Sky commissions feature documentary to mark 10th anniversa...
06/05/2026
Wednesday 6 May 2026
Sky and Formula 1 agree long-term partnership across UK, Ireland and Italy
Sky in the UK & Ireland to remain the home of Formula 1 until ...
06/05/2026
Sky Zero Footprint Fund-backed TV campaign launches nationwide, supported by new...
06/05/2026
Wuppertal May 6, 2026
Riedel Expands Leadership Structure, Appoints Marc Engro...
06/05/2026
SAN JOSE, Calif. - May 6, 2026 - Harmonic (NASDAQ: HLIT) today announced its latest broadband innovations for ANGA COM 2026, highlighting its vision for a new e...
06/05/2026
Statement from Rupert Murdoch, Chairman Emeritus, Fox Corporation on Ted Turner&...
06/05/2026
Friday 8 May on RT One and RT Player
Meet the NSPCA team caring for and protecting animals in need in this six-part series
Fly on the wall, six-part series...
06/05/2026
The race to build the world's most powerful AI factories demands networking ...
06/05/2026
How changes to proteins can alter drug interactions for new precision therapies Scripps Research team maps how chemical modifications to proteins affect drug bi...
05/05/2026
Experts from the world of academia, tech, business, politics and media convened for a Thomson Talks at the Cambridge Disinformation Summit in April. It's th...
05/05/2026
Three phones were hardwired for power and transmission to the truck; camera feat...
05/05/2026
The creative studio behind campaigns for the NBA, Fanatics Sportsbook & Casino, ...
05/05/2026
Nielsen has announced results from a co-viewing pilot program covering February&...
05/05/2026
viztrick AiDi, an on-device AI solution developed by Nippon TV, delivered global...
05/05/2026
ARRI has announced Omnibar, a battery-powered, IP65-rated multi-color LED linear...
05/05/2026
Imagine Communications has announced that France T l visions is the first broadc...
05/05/2026
The Women's National Basketball Association (WNBA) and Bell Media today announced a multiyear agreement to broadcast and stream WNBA games in Canada beginni...
Working with HBO and Sister Productions, Framestore used cutting edge technology to bring to life The Baby 
