Working with HBO and Sister Productions, Framestore used cutting edge technology to bring to life The Baby
Brie Clayton July 7, 2022
0 Comments
Providing VFX work on over 350 shots Framestore used machine learning and detailed environment work to create a photorealistic baby and stunning scenes for the offbeat HBO show
In this eight-episode dark comedy viewers are pulled into the world of protagonist Natasha who acquires a baby she does not want. On top of this the infant holds dark powers which leads to destruction and torment for not only Natasha but those around her. Tasked with helping build the world of The Baby, Framestore dug into their expertise in working on digi-doubles, face replacement and invisible environment effects.
The main question was: if one of the main cast members is a baby, how can we use VFX to help the show work, with all the limitations that entails? said Owen Braekke-Carroll. As a base, we had to find a practical method of approaching things as much as possible whilst leaning on VFX only when needed.
With babies involved on set things were never predictable and shoot days could rapidly change at any point. At times there could be over five babies and a dog present, so the team built a bespoke and adaptable pipeline to complement the creative vision for the show.
Because we wouldn't know how these performances would link up, we had to treat the baby like a CG creature in every take. There was a potential that any shot could become a VFX shot, said Owen Braekke-Carroll. In post it really became about getting the best outcome based on each individual shot's needs. We'd end up having different workflows per shot and across each sequence. So, for one shot we might have a partially CG body over a prosthetic baby torso with a plate baby's head, and the next only replace the arm and add a machine learning face replacement. It was never really a consistent process; it was always about getting the best outcome from the inputs that were available.
The script often called for the baby to be asleep which turned out to be one of the biggest challenges the team faced. You can't shoot a baby asleep on a film set with a guarantee of the correct lighting and camera time, said Owen Braekke-Carroll. It might come together for some scenes, but you can't rely on a whole shoot day doing that.
To approach this problem, the babies on set were photographed at high frame rates in story context and played back at this slower speed. We then took those plates and digitally closed their eyes, before using a machine learning layer to give them a realistic look on top, added Owen Braekke-Carroll. This was trained on a closed eye data set, and that created a very effective and photographic output to add.
The ethos behind their approach however remained - to support the story invisibly rather than being the point of the story. The team tried not to completely replace the baby unless they had to, so they leant on real performance wherever possible, replacing only where it was necessary, or the script called for something eccentric or unconventional. They used a lot of reference, performance photography and video with the intent of creating additional material to use after the fact, whilst leveraging machine learning.
It was difficult to keep control of the facial elements because the team would have multiple shots of the babies which were also changing and growing over the course of the shoot. The same baby often looked different from shot to shot, let alone when they were trying to replace them or change their likeness or performance. Consequently, they had to work with ever-shifting boundaries about what a likeness actually is.
While it wasn't always the solution, machine learning was crucial. It worked really well especially when combined with more traditional methods to help sell a photographic likeness and performance, said Owen Braekke-Carroll. On set we captured specific elements for the purpose of machine learning to drive those models, in addition to the regular capture of the 3D scans and other usual reference. It was very exciting to be able to work to integrate new and developing tools into the Framestore pipeline.
The team also made good use of KeenTools, which are effectively smart tools for VFX and 3D artists, as a head tracking software to control facial performances such as closed mouths or smiles.
In the penultimate sequence of the series the Baby is seen drifting underwater. To achieve this safely with the cast, the VFX team used a combination of dry-for-wet photography combined with an underwater shoot, and CG digi-doubles.
With the mother holding the baby we had a blue screen stage which we then lit with polarised lights, cross polarised with the camera. This enabled us to remove much of the specularity off the face. We then shot it in high frame rate with a watery effect light, and that gave us the performance with the correct lighting of the baby, said Owen Braekke-Carroll. We used fans, so their hair and clothing moved, making it look like they were underwater. We then took the head of the performance to place on our digi body. The performances from the cast babies were so fantastic and it was a great way to keep them and still get the shots.
The show also involved some detailed environment work including a digital ocean, digital matte painting skies and split location work on a dilapidated cottage.
We had a recurring story location which involved an impossibly large cliff on the Southeast coast of England and at the bottom of it was a dilapidated cottage fronting straight onto the water, said Owen Braekke-Carroll. This location can't exist in reality, so we used a secondary location in Southeast Kent for the cottage set, which we were able to combine with a combination of CG, DMP and plat
Most recent headlines
09/11/2025
Dalet today announced a transformative leap forward for media operations: Agentic Artificial Intelligence (AI) that unifies the Dalet ecosystem under one natura...
22/10/2025
Prime Video Inks Deal To Present NFL Black Friday Game Worldwide By SVG Staff
Wednesday, October 22, 2025 - 10:06 am
Print This Story | Subscribe
Story ...
22/10/2025
NBA Tip-Off: ESPN Goes 1080p HDR End-to-End, Flipping HDR Switch on REMI and REM...
22/10/2025
FloSports Empowers Division II, III Athletic Departments With Turnkey Production...
22/10/2025
Wall Street Video Summit Debuts, Bringing Together 200 Financial Enterprise Vide...
22/10/2025
Dueling Pianos: International Chopin Piano Competition Is as Competitive as a Ba...
22/10/2025
In 1995, a young Colombian artist released an album that would change Latin pop ...
22/10/2025
Over the past few months, a photovoltaic system has been installed on a three-he...
22/10/2025
The Orion spacecraft for NASA's Artemis II mission is stacked on the Space Launch System (SLS) rocket in High Bay 3 of the Vehicle Assembly Building at Kenn...
22/10/2025
L3Harris' Hybrid SATCOM is resilient by design, offering path diversity that eliminates vulnerabilities by routing data across the best available networks i...
22/10/2025
WASHINGTON, D.C. Organizers of NAB Show New York said they are expecting more than 12,000 registered attendees from about 100 countries along with 260 exhibitor...
22/10/2025
WASHINGTON, D.C The organizers of The 2025 NAB Show New York have announced that they are expecting more than 12,000 registered attendees from about 100 countr...
22/10/2025
Masque Sound, a leading theatrical sound reinforcement, installation and design company, supplied an extensive gear package of professional-grade equipment for ...
22/10/2025
Lightware, a global leader in signal management and AV connectivity solutions, is seeing strong market momentum for the UCX-3x3-TPX-RX20, a compact transmitter-...
22/10/2025
MELVILLE, N.Y. Chyron has released PAINT 10.2, the latest update for its telestration platform, adding support for SMPTE ST 2110 IP workflows, expanding brandin...
22/10/2025
WASHINGTON Run3TV today said NBCUniversal is joining as an investor in the ATSC 3.0 Framework Authority, which develops the Run3TV NextGen TV application platfo...
22/10/2025
ATLANTA swXtch.io will feature two new networking solutions extending the company's reach across more cloud and on-prem workflows at NAB Show New York, set ...
22/10/2025
The Warner Bros. Discoverys HBO Max streaming services has increased prices for all its streaming tiers effectively immediately for new customers. Existing cust...
22/10/2025
LOS ANGELES OpenDrives has signed a new distribution partnership deal with Versatile Distribution Services (VDS) to strengthen its channel and streamline how it...
22/10/2025
WASHINGTON, D.C The organizers of The 2025 NAB Show New York have announced that they are expecting more than 12,000 registered attendees from about 100 countr...
22/10/2025
Samora Pinderhughes Brings Immersive Sound to Berklee's Signature Series The artist and composer, who's worked with Herbie Hancock, Robert Glasper, Co...
22/10/2025
BMI Day at Berklee Celebrates Composer Fil Eisler and Awards Scholarship to Stud...
22/10/2025
October 22nd, 2025 TRIBECA ANNOUNCES STAR-STUDDED LINEUP OF MEMBERSHIP EVENTS F...
22/10/2025
Rohde & Schwarz and TRUMPF cooperate in drone defense Rohde & Schwarz and TRUMPF partner to deliver a comprehensive drone defense solution combining Rohde & S...
22/10/2025
European Broadcaster Upgrades To Grass Valley's NativeIP LDX 135 Cameras And...
22/10/2025
Everyone Gets a Better Deal on Verizon with New FOX One Perk The $15 FOX One streaming service perk is yet another way Verizon continues to add savings for cu...
22/10/2025
First Look Hidden Assets Series 3
Premieres on 9th November 9:30pm on RT One & RT Player
WATCH HERE Promo Link: Hidden Assets Series 3 | RT
The Crimin...
21/10/2025
NAB New York 2025: Although AES Show Is on Its Own, Audio Will Be a Major Part o...
21/10/2025
NAB New York 2025: Business of Broadcast and Media,' Future of Content'...
21/10/2025
SVG All-Stars: Ethan Folz, Senior Director, Digital Operations and Quality of Ex...
21/10/2025
NBA on NBC/Peacock: Livestream Offers Graphic Overlays, Predictive Gaming, Ancil...
21/10/2025
NBA on NBC/Peacock: At the Front Bench With Producer Frank DiGraci and Director ...
21/10/2025
NBA on NBC/Peacock: NBC Sports, NEP Build Ultra-Flexible Production Plan That Se...
21/10/2025
Indigenous storytelling has been at the heart of the work of the Sundance Instit...
21/10/2025
Top L-R: Mysterious Skin, American Dream Second Row L-R: Little Miss Sunshine, D...
21/10/2025
Last week, Spotify and Columbia Records transformed Pier 4 at the Brooklyn Army ...
21/10/2025
SBS Learn's Dharug Ngurra resource empowers classrooms to meaningfully celeb...
21/10/2025
As global operators simplify and evolve their digital platforms, NPS improvement...
21/10/2025
Critical Design Review completion is a key milestone on the path toward Wideband Global Satellite Communications certification for the network in 2026, opening ...
21/10/2025
New Australian undersea training range to implement and improve warfighting tactics, proficiency and safety; enable joint/allied training that contributes to pr...
21/10/2025
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...
21/10/2025
September, the beginning of autumn, brought an expected revival to the TV market, largely due to the new fall TV schedules. The time spent in front of the TV sc...
21/10/2025
Broadcast Booms with 20% Uptick vs. August, Achieving Largest Monthly
Increase ...
21/10/2025
During September, streaming's share of TV viewing in Mexico settled at 24.5%, a marginal shift of -0.5 share points from the previous month.
Disclaimer: YU...
21/10/2025
RENNES, France BBright and GlobalM have conducted a technical trial validating Ultra HD interoperability across the entire contribution chain in the cloud, achi...
21/10/2025
Kokusai Denki Electric America will mark the U.S. debut of a new 4K camera at the 2025 NAB New York, Oct. 22-23. Now available, the Z-HD6500-S1 UHD/HD productio...
21/10/2025
Triveni Digital, a trusted leader in ATSC 1.0 and 3.0 service delivery, data broadcasting, and quality assurance solutions, will showcase its entire NEXTGEN TV ...
21/10/2025
Radio Azzurra FM, longest-running radio station in the province of Novara, northwest Italy, has invested in an DHD SX2 audio routing and mixing console for inte...
21/10/2025
Globecast, the leading provider of broadcast, media and entertainment managed services, has announced the appointment of G Morgan as Executive Vice President of...
Working with HBO and Sister Productions, Framestore used cutting edge technology to bring to life The Baby 
