Sony Pixel Power calrec Sony

How The Crown used deepfake technology

16/11/2020

TVBEurope talks to the team at Framestore about their work on season four of The Crown.

By Jenny Priestley

Published: November 16, 2020

TVBEurope talks to the team at Framestore about their work on season four of The Crown.

target=_blank title=Share on LinkedIn class=share-linkedin> TVBEurope talks to the team at Framestore about their work on season four of The Crown.

https://www.tvbeurope.com/production-post/how-the-crown-used-deepfake-technology title=Share via Email class=share-email>

The brand new season of The Crown has employed deepfake technology for the first time on a sequence involving Erin Doherty's Princess Anne.

The sequence involved replacing the face of an equestrian athlete who stood in for Doherty. For several shots in which Anne is taking part in a show jumping competition, the team at Framstore, who worked on the sequence, employed a deep fake technique to achieve the replacement.

Framestore's deputy head of 2D and the project's 2D Supervisor Ollie Bersey tells TVBEurope they opted to use deepfake because it was going to do the best job in the in the shortest time.

He adds, The deep fake isn't suitable for everything, but it seemed to fit the bill. We had lots of images that we could feed into the machine learning computer. There was no shortage of reference of the faces we were replacing and the faces we wanted to regenerate, so it seemed the best approach. It's quite an exciting new approach that we wanted to test.

Bersey adds that he thinks deepfake technology will continue to develop for film and TV productions. When we first started looking at this, there were a number of limitations in resolution available, and these were kind of improving as we went along, he explains. There is no reason why this isn't going to become a much bigger thing. We're using it on on other projects, we've used it in commercials. It's quick, and it's successful. It's going to be used and it's an important part of the future. In The Crown, we did actually have to get in there with good old fashioned 2D comping and make further adjustments to the face because the performance of the stunt double wasn't quite going to achieve the correct output.

Framestore once again worked on multiple shots and sequences for season four providing VFX work on 230 shots, from creating digital environments and crowd work to a photoreal CG stag. Back in 2006, the company created the stag featured in The Queen. However, for The Crown it was a whole new piece of work. Internally we didn't have a stag asset that we could kind of lean into or pick up and work up from there, says Ahmed Gharraph, Framestore's head of CG.

I think partly what helped win us the job is that last year we delivered a commercial with a photoreal reindeer in it. Reindeers and stags are roughly of a similar ilk, antlers and furry and whatnot. I guess that project kind of gave the client faith that we can make these photo real creatures, as well as our history of creature work in projects such as His Dark Materials. Creating photoreal creatures is in our blood. When this sequence came in we were particularly excited about it, because The Crown is not a visual effects heavy show. It's embedded in history and embedded in the real world so there was no room for error. That made it a really exciting challenge because ultimately we were aiming to create something that should hopefully fool the audience into thinking what they're looking at is real footage.

In order to create the stag, some of the Framestore team visited Richmond Park in London to hang out and observe the animals. Really it was endless amounts of reference, just constantly finding pictures and videos. It's not something that you just study at the start and you go, right, I know what the stag looks like, now I'm going to go off and make it work, adds Gharraph. As the shots and the asset develops, we seek out new references and find little subtle nuances of how that anatomy is put together, how the stag might step in a certain way. It's an iterative and subtle process.

If you look at it in terms of the workflows, it's storyboarded, and then there's a reference pass of that, and then there's an animation block of that where you develop animation cycles, and you put them in the shot, adds Ross Burgess, head of animation. Then you speak to the client to see if that's what they were thinking for pacing and timing. It's like a piece of sculpture, you just chipping away at the blocks until you finally get there. On this project it was actually a very organic process, there was lots of iterations, but it only got better as we chipped away at it.

There's a particular shot that kept me awake at night, says Burgess. It's when he gets shot. We were battling with the idea that what usually happens when stags get shot is that they go down, they collapse and never get back up again. Obviously, that would just ruin the story of what we're trying to do because our stag gets up and runs off. So we were asking ourselves how we were going to take the realism of what a stag would actually do, and giving it a sense that it could get back up again. What we had to do in animation to kind of force that was a real challenge, because it's not something that there was any reference for. We had to traditionally keyframe it and it was very difficult.

Other sequences the Framestore team worked on that they found challenging include turning 21st century Manchester into 1980's New York. New York was quite a challenge, says Standish Millennas, Framestore's VFX producer. There was a lot going on in our new New York scene. We had to make the streets of Manchester look like New York. The set dressing was very good, up to a certain level, but we'
LINK: https://www.tvbeurope.com/production-post/how-the-crown-used-deepfake-...
See more stories from tvb

Most recent headlines

09/11/2025

Dalet Unveils Agentic AI Media Workflows at IBC2025

Dalet today announced a transformative leap forward for media operations: Agentic Artificial Intelligence (AI) that unifies the Dalet ecosystem under one natura...

20/10/2025

Inside TAMS: How Time-Addressable Media Stores Could Redefine Sports Workflows

Inside TAMS: How Time-Addressable Media Stores could redefine sports workflows By Paul Markham Friday, October 17, 2025 - 08:57 Print This Story A penalty...

20/10/2025

Transformational Production: Inside TVN's Remote Production Push for the DFL's Bundesliga 2

Transformational production: Inside TVN's remote production push for the DFL...

20/10/2025

How NBC Sports Transitioned Stamford Facility to One Format: 1080p HDR

How NBC Sports Transitioned Stamford Facility to One Format: 1080p HDRMulti-year plan harmonizes workflows, simplifies operationsBy Ken Kerschbaumer, Editorial ...

20/10/2025

NBA on NBC' Studio Production Team Is Ready for Tip-Off With Coast-to-Coast Tuesday'

NBA on NBC' Studio Production Team Is Ready for Tip-Off With Coast-to-Coast...

20/10/2025

Under Pressure: TVN CEO Markus Osthaus Considers the German Sports Broadcasting Market

Under pressure: TVN CEO Markus Osthaus considers the German sports broadcasting ...

20/10/2025

Carmen Emmi's Plainclothes Evokes the Rawness and Sensuality of New Queer Cinema

(L-R) Maria Dizzia, Carmen Emmi, and Russell Tovey attend the Plainclothes pre...

20/10/2025

Search and Follow Your Favorite Venues on Spotify

In March, we launched Concerts Near You to help listeners find concerts from their favorite artists. Since then, more than 3 million people have used it to disc...

20/10/2025

Arte Preta Brasileira Destaque No Dia AMPLIFIKA 2025

Em diversas cidades do Brasil, um movimento tem se fortalecido para celebrar o poder, a beleza e a profundidade da criatividade negra. O Dia AMPLIFIKA, agora em...

20/10/2025

Black Brazilian Artistry Takes Center Stage During AMPLIFIKA Day 2025

In cities across Brazil, a movement is growing that celebrates the power, beauty, and depth of Black creativity. AMPLIFIKA Day, now in its fifth edition, return...

20/10/2025

The Republic of Korea Selects L3Harris for Airborne Early Warning and Control Aircraft Program

Airborne Early Warning and Control aircraft rendering...

20/10/2025

Imagine Communications Acquires Pixel Power From Rohde & Schwarz

DENVER and MUNICH Imagine Communications today announced its plans to acquire Pixel Power Ltd., a wholly owned subsidiary of Rohde & Schwarz. Financial terms of...

20/10/2025

Globecast Appoints G Morgan as EVP of Sales, Globecast Americas

LOS ANGELES G Morgan has joined Globecast, a provider of broadcast, media and entertainment managed services, as executive vice president of sales, Globecast Am...

20/10/2025

Heartland Video Systems, Zixi Partner on IP Networking for Broadcasters

PLYMOUTH, Wisc. Heartland Video Systems and Zixi have partnered to enable broadcast-quality live video delivery over any IP network....

20/10/2025

A. R. Rahman on Facing Fear and Finding the Divine

A. R. Rahman on Facing Fear and Finding the Divine In an interview with Berklee President Jim Lucchese, the Oscar-winning composer reflects on how courage and...

20/10/2025

Sky unveils thrilling trailer of Original film Nuremberg, starring Russell Crowe, Rami Malek and Michael Shannon

Monday 20 October 2025 To view this content, please enable our use of cookies. ...

20/10/2025

Rohde & Schwarz transfers Pixel Power to Imagine Communications

Rohde & Schwarz transfers Pixel Power to Imagine Communications Companies work collaboratively to ensure continuity and ongoing support for existing customers...

20/10/2025

RT Prime Time to host final Presidential Debate

RT 's Prime Time is set to host the final Presidential Election Debate this Tuesday night, October 21, providing an opportunity to hear directly from Irelan...

20/10/2025

NVIDIA and Google Cloud Accelerate Enterprise AI and Industrial Digitalization

NVIDIA and Google Cloud are expanding access to accelerated computing to transform the full spectrum of enterprise workloads, from visual computing to agentic a...

19/10/2025

Sins of Kujo' Comes to Life in New Live-Action Series Set for Spring 2026

Back to All News Sins of Kujo' Comes to Life in New Live-Action Series Set for Spring 2026 Entertainment 19 October 2025 GlobalJapan Link copied to cl...

18/10/2025

NESN Taps Harmonic for Primary Live Sports Distribution

New England Sports Network (NESN) has chosen Harmonic, working with Astound Business Solutions, as its enterprise technology partner to transform primary distri...

18/10/2025

DirecTV Launches Gray's Gulf Coast Sports & Entertainment Network

NEW ORLEANS, La. In the run-up to the start of the NBA season, WVUE-TV and Gray Local Media have announced a deal with DirecTV that will greatly expand access t...

18/10/2025

Berklee Celebrates 40 Years of the Fall Together Concert

Berklee Celebrates 40 Years of the Fall Together Concert Faculty composers Bob Pilkington and Greg Hopkins are among the featured artists for this year's ...

17/10/2025

NEP Group Receives New Equity Investment From 26North Partners LP, Co-Investors

NEP Group Receives New Equity Investment From 26North Partners LP, Co-InvestorsCarlyle remains the largest shareholder as the company prepares for the futureBy ...

17/10/2025

Apple Lands Five-Year Deal for F1 Distribution in the U.S.

Apple Lands Five-Year Deal for F1 Distribution in the U.S.Besides airing on Apple TV, the sport will be amplified on other Apple servicesBy Ken Kerschbaumer, Ed...

17/10/2025

SVG Sit-Down: Marshall Electronics' Bernie Keach on the Future of PTZ Cameras

SVG Sit-Down: Marshall Electronics' Bernie Keach on the Future of PTZ Camera...

17/10/2025

L2 Productions' REMI Facility in Austin Can Produce Content From Anywhere

L2 Productions' REMI Facility in Austin Can Produce Content From AnywhereMusic festivals, sports events are produced via flypacks and remote control roomsBy...

17/10/2025

Give Me the Backstory: Get to Know Sarah Dowland, the Filmmaker Behind Sue Bird: In The Clutch

By Lucy Spicer One of the most exciting things about the Sundance Film Festival...

17/10/2025

Cooper Raiff Returns to the Sundance Film Festival With His Independent Series Hal & Harper

(L-R) Christopher Meyer, Addison Timlin, Cooper Raiff, Lili Reinhart, Alyah Chan...

17/10/2025

Ferramenta de arte da capa de playlists do Spotify chega ao Brasil com uma noite de autoexpresso

M sica e arte se uniram em uma noite especial na semana passada na ZIV Gallery, ...

17/10/2025

Spotify's Custom Playlist Cover Art Tool Arrives in Brazil With a Night of Self-Expression

Music and art came together for one special night last week at ZIV Gallery, an i...

17/10/2025

Spotify and FC Barcelona Extend Partnership Through 2030

Spotify and FC Barcelona are extending our partnership through 2030, continuing a collaboration that's redefining how fans, players, and artists connect. Th...

17/10/2025

Sports Fishing Championship Deploys DigitalGlue Storage Platform

MURRIETA, Calif. The Sports Fishing Championship (SFC) has deployed DigitalGlue's creative.space storage platform to streamline video production by centrali...

17/10/2025

TV Ad Impressions for Football Spiked in Q3

BELLEVUE, Wash. Football continued to cement its reputation as a bulwark of TV advertising in Q3 2025 with new data from iSpot that showed both the NFL and coll...

17/10/2025

Reeling in the Chaos Sports Fishing Championship Simplifi...

The Sports Fishing Championship (SFC), the premier competitive saltwater fishing series, has transformed its production workflow by adopting creative.space, the...

17/10/2025

QuickLink Unveils StudioPro Version 4 With Major Enhancem...

QuickLink, a leading provider of award-winning multi-camera video productions and remote contribution solutions, announces the release of StudioPro Version 4, ...

17/10/2025

Westcoast Pixel dazzles with dynamic 3D video projections

Although the annual Grammy Awards celebration is best known for recognizing achievements in the recording industry, the show often proves a visual spectacle as ...

17/10/2025

Alex Dunfey Promoted to CTO at OpenDrives

OpenDrives, Inc., a leading provider of software-defined data storage and data services, has promoted Alex Dunfey to Chief Technology Officer (CTO) from his for...

17/10/2025

University of Arizona Scales Up Broadcast Capabilities Wi...

The University of Arizona (UofA) has significantly upgraded its broadcast communication infrastructure with the integration of Riedel Communications' advanc...

17/10/2025

NESN Redefines Regional Sports Video Delivery with Harmon...

Harmonic (NASDAQ: HLIT) today announced that New England Sports Network (NESN), owned by Fenway Sports Group and Delaware North, has selected Harmonic as its en...

17/10/2025

Austin PBS Expands Facility-Wide Production Communication...

Austin PBS has recently upgraded its facility-wide communications infrastructure, deploying Clear-Com 's Eclipse HX, FreeSpeak II beltpacks, and V-Series ...

17/10/2025

ZEISS Opens BETA Registration for CinCraft Virtual Lens T...

ZEISS announces an open call for the closed BETA testing phase of CinCraft Virtual Lens Technology, the innovative digital tool that brings authentic lens chara...

17/10/2025

Lightware powers hybrid learning transformation at Centri...

Situated in the town of Kokkola, Centria University of Applied Sciences offers higher education across five core fields: engineering, business, social and healt...

17/10/2025

Pebble to automate CobbTV

Public information channel in Georgia, USA, to implement a powerful, simple, and cost-effective playout automation platform. Pebble, the leading automation, co...

17/10/2025

HBO Maxs Global Expansion Surpasses 100 Market Milestone

HBO Max is reporting that it has launched in 15 new markets, including Bangladesh, Cambodia, Macau, Pakistan, Sri Lanka and Ukraine, boosting the streaming serv...

17/10/2025

Netflix Expands Into Video Podcasts With Spotify Deal

Netflix said it will make a major push into video podcasts, inking a wide-ranging deal with Spotify through which it will offer 16 podcasts in the U.S. starting...

17/10/2025

Viamedia Rebrands as Viamedia.ai

Lexington, Ky. As part of a push to highlight its advanced advertising capabilities, Viamedia has launched a new AI-powered ad tech platform and officially rebr...

17/10/2025

QuickLink to Showcase StudioPro Version 4 at NAB Show New York

NEW YORK QuickLink has announced the release of StudioPro Version 4, which the company is calling the most significant upgrade yet to its flagship video product...

17/10/2025

Apple, NBCU to Launch Apple TV, Peacock Streaming Bundles

NEW YORK and CUPERTINO, Calif. Apple and NBCUniversal said they will sell Apple TV and Peacock streaming bundles to U.S. subscribers starting Oct. 20....