TVBEurope talks to the team at Framestore about their work on season four of The Crown.
By Jenny Priestley
Published: November 16, 2020
TVBEurope talks to the team at Framestore about their work on season four of The Crown.
target=_blank title=Share on LinkedIn class=share-linkedin> TVBEurope talks to the team at Framestore about their work on season four of The Crown.
https://www.tvbeurope.com/production-post/how-the-crown-used-deepfake-technology title=Share via Email class=share-email>
The brand new season of The Crown has employed deepfake technology for the first time on a sequence involving Erin Doherty's Princess Anne.
The sequence involved replacing the face of an equestrian athlete who stood in for Doherty. For several shots in which Anne is taking part in a show jumping competition, the team at Framstore, who worked on the sequence, employed a deep fake technique to achieve the replacement.
Framestore's deputy head of 2D and the project's 2D Supervisor Ollie Bersey tells TVBEurope they opted to use deepfake because it was going to do the best job in the in the shortest time.
He adds, The deep fake isn't suitable for everything, but it seemed to fit the bill. We had lots of images that we could feed into the machine learning computer. There was no shortage of reference of the faces we were replacing and the faces we wanted to regenerate, so it seemed the best approach. It's quite an exciting new approach that we wanted to test.
Bersey adds that he thinks deepfake technology will continue to develop for film and TV productions. When we first started looking at this, there were a number of limitations in resolution available, and these were kind of improving as we went along, he explains. There is no reason why this isn't going to become a much bigger thing. We're using it on on other projects, we've used it in commercials. It's quick, and it's successful. It's going to be used and it's an important part of the future. In The Crown, we did actually have to get in there with good old fashioned 2D comping and make further adjustments to the face because the performance of the stunt double wasn't quite going to achieve the correct output.
Framestore once again worked on multiple shots and sequences for season four providing VFX work on 230 shots, from creating digital environments and crowd work to a photoreal CG stag. Back in 2006, the company created the stag featured in The Queen. However, for The Crown it was a whole new piece of work. Internally we didn't have a stag asset that we could kind of lean into or pick up and work up from there, says Ahmed Gharraph, Framestore's head of CG.
I think partly what helped win us the job is that last year we delivered a commercial with a photoreal reindeer in it. Reindeers and stags are roughly of a similar ilk, antlers and furry and whatnot. I guess that project kind of gave the client faith that we can make these photo real creatures, as well as our history of creature work in projects such as His Dark Materials. Creating photoreal creatures is in our blood. When this sequence came in we were particularly excited about it, because The Crown is not a visual effects heavy show. It's embedded in history and embedded in the real world so there was no room for error. That made it a really exciting challenge because ultimately we were aiming to create something that should hopefully fool the audience into thinking what they're looking at is real footage.
In order to create the stag, some of the Framestore team visited Richmond Park in London to hang out and observe the animals. Really it was endless amounts of reference, just constantly finding pictures and videos. It's not something that you just study at the start and you go, right, I know what the stag looks like, now I'm going to go off and make it work, adds Gharraph. As the shots and the asset develops, we seek out new references and find little subtle nuances of how that anatomy is put together, how the stag might step in a certain way. It's an iterative and subtle process.
If you look at it in terms of the workflows, it's storyboarded, and then there's a reference pass of that, and then there's an animation block of that where you develop animation cycles, and you put them in the shot, adds Ross Burgess, head of animation. Then you speak to the client to see if that's what they were thinking for pacing and timing. It's like a piece of sculpture, you just chipping away at the blocks until you finally get there. On this project it was actually a very organic process, there was lots of iterations, but it only got better as we chipped away at it.
There's a particular shot that kept me awake at night, says Burgess. It's when he gets shot. We were battling with the idea that what usually happens when stags get shot is that they go down, they collapse and never get back up again. Obviously, that would just ruin the story of what we're trying to do because our stag gets up and runs off. So we were asking ourselves how we were going to take the realism of what a stag would actually do, and giving it a sense that it could get back up again. What we had to do in animation to kind of force that was a real challenge, because it's not something that there was any reference for. We had to traditionally keyframe it and it was very difficult.
Other sequences the Framestore team worked on that they found challenging include turning 21st century Manchester into 1980's New York. New York was quite a challenge, says Standish Millennas, Framestore's VFX producer. There was a lot going on in our new New York scene. We had to make the streets of Manchester look like New York. The set dressing was very good, up to a certain level, but we'
Most recent headlines
04/08/2024
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet, a leading technology and service provider for media-rich organizations, a...
06/05/2024
It's almost go-time for the Holly Springs Salamanders! The season opener is ...
05/05/2024
A special evening performance by multiplatinum singer Becky G will provide a memorable conclusion to TeievisaUnivision's Casa Cultura upfront event on May 1...
05/05/2024
Giant media buyer Publicis is telling network sales executives that it does not think Nielsen's new panel-plus-big-data currency is ready for this upfront....
05/05/2024
WASHINGTON Glenn Kirschner, legal analyst at NBC News, blasted the media for referring to the New York trial of former President Donald Trump as a hush-money ...
05/05/2024
Catchy Comedy's weekend marathon sees The Beverly Hillbillies on the weekend of May 4-5. The event kicks off Saturday, May 4 at 11 a.m. ET, and runs through...
05/05/2024
NBC Sports has the 150th Kentucky Derby Saturday, May 4. The coverage begins at 2:30 p.m. ET on NBC and Peacock and the feature race at Churchill Downs in Louis...
04/05/2024
NEW YORK As the Asian Pacific American Heritage Month kicks off in May, Nielsen has released an extensive new report diving into their media habits with data sh...
04/05/2024
PHILADELPHIA As National Military Appreciation Month gets underway, Comcast has announced several new initiatives to help veterans, service members, and their f...
04/05/2024
WASHINGTON, D.C. Federal Communications Commission chairwoman Jessica Rosenworcel has announced a tentative agenda for the May Open Commission Meeting scheduled...
04/05/2024
The Broadband Forum has announced major enhancements to key 5G convergence standards that the group said will help advance next-generation applications, improve...
04/05/2024
Spotify Wrapped Campaign Spot Graded With DaVinci Resolve Studio
Brie Clayton May 3, 2024
0 Comments
Blackmagic Design today announced that Colorist M...
04/05/2024
Three Boston Conservatory at Berklee Alums Nominated for Tony Awards An additional eight alums and two current students performed in nominated productions.
...
03/05/2024
An innovative learning tool to help media and civil society better understand ho...
03/05/2024
PARK CITY, UTAH - JANUARY 21: (L-R) Actors K stutis Cic nas and Greta Grinevi i t , Director Marija Kavtaradze and Producer Marija Razgute attend the 2023 Sunda...
03/05/2024
If you aren't familiar with Danny Ocean's music, it's only a matter ...
03/05/2024
Spotify has an unwavering commitment to supporting emerging artists across all genres, to helping them launch and thrive in their careers, and to connecting the...
03/05/2024
Como uno de los sonidos de mayor expansi n en el mundo, la M sica Mexicana va m ...
03/05/2024
As one of the fastest-growing sounds worldwide, M sica Mexicana is more than jus...
03/05/2024
NEW YORK FuboTV reported that it lost 110,000 subs in Q1 2024 but it exceeded its guidance for the quarter with double digit year-over-year increases across key...
03/05/2024
Only 3 Weeks Left To Enter The Creative Industries Most Award
Brie Clayton May 3, 2024
0 Comments
Creativepool is giving a last call to the creative i...
03/05/2024
WePlay Studios Transforms the Future of Live Event Storytelling with AJA Gear
Brie Clayton May 3, 2024
0 Comments
By 2032, the esports market is expec...
03/05/2024
WASHINGTON Shannon Bream, Fox News Sunday anchor and chief legal correspondent, sat for a keynote chat at The Business of TV News, with Tom Umstead, senior co...
03/05/2024
WASHINGTON Asked how important is local news, Martha Raddatz, who has covered foreign conflicts for decades and moderated presidential debates for ABC News, s...
03/05/2024
Sony Pictures and Apollo Global Management have made a $26 billion cash offer fo...
03/05/2024
CBS announced its 2024-2025 primetime schedule, which features the new dramas NCIS: Origins, Matlock and Watson, and new comedies Poppa's House and Georgie ...
03/05/2024
Sports-focused streaming service Fubo said it reduced its red ink in the first quarter, despite losing 110,000 subscribers since the end of the year....
03/05/2024
Walmart is reportedly about to release a new 4K streaming box/smart speaker hybrid device for Google TV that could retail for as low as $50, according to a repo...
03/05/2024
Enhancements to its Delivery Workspace solution provide increased content delivery robustness and security
By Matthew Corrigan
Published: May 3, 2024
Enha...
03/05/2024
According to reports, if the bid is successful, Sony would be the significant majority shareholder of the new private company
By Jenny Priestley
Published: M...
03/05/2024
Located in Manchesters Spinningfields district, the course aims to equip students with the skills, knowledge and industry insight for a career in the creative s...
03/05/2024
Lightbridge has created a new Cine Reflect Lighting System kit, dedicated to enabling artistic lighting with consideration of today's productivity practical...
03/05/2024
Broadcast media systems integrator BeckTV and Lawo worked together on a large-scale AES67 build of radio control rooms at KPBS, San Diego's NPR and PBS memb...
03/05/2024
Raleigh, NC, April 12, 2024 SmallHD announces PageOS 6, a powerful software update free for owners of SmallHD monitors, featuring increased functionality, exp...
03/05/2024
SmallHD announces the Quantum 32 a new 31.5 OLED monitor designed to provide reference HDR/SDR images for post-production final color grading, as well as cri...
03/05/2024
By 2032, the esports market is expected to grow to $9.29 billion, bolstered by a global player count and fan following that both continue to climb. The 2023 Lea...
03/05/2024
Amagi, the global leader in cloud-based SaaS technology for broadcast and connected TV (CTV), today announced that the 11th edition of the Amagi Global FAST Rep...
03/05/2024
Riedel Communications today announced that Westdeutscher Rundfunk (WDR) is relying on a media and intercom network based on Riedel technology for the renewal of...
03/05/2024
Broadpeak , a leading provider of content delivery network (CDN) and video streaming solutions for content providers and pay-TV operators worldwide, announced t...
03/05/2024
Media technology innovator Limecraft will exhibit the latest updates to its online platform on stand G79 at the 15-16 May 2024 Media Production & Technology Sho...
03/05/2024
Audio interface specialist Prism Sound is partnering with console manufacturer Solid State Logic, professional monitor manufacturer PMC and acoustic panel and d...
03/05/2024
Intinor, Sweden's leading developer of products and solutions for high-quality video over the internet, is set to join forces with its UK partner Zest Techn...
03/05/2024
NAKIVO Inc., a fast-growing software company dedicated to protecting physical, virtual, cloud, and SaaS environments, announced its Q1 2024 financial results to...
03/05/2024
Hiltron Communications announces an addition to its range of satellite communication products and systems: a field-upgradable motorisation kit specifically desi...
03/05/2024
Visit LiveU at Stand D30
With this year an exceptional one for major sporting events alongside multiple, key elections, the power and flexibility of LiveU'...
03/05/2024
Agile Content, the leader in the development of technology and solutions for the provision of television services over the Internet, announces Koldo Unanue as i...
03/05/2024
Eight co-signers representing streaming services, pay TV operators and public interest groups have sent a letter to Congressional leaders urging their Committee...
03/05/2024
BOSTON Brightcove has announced that it has implemented Amazon Q Business, a new generative AI assistant on Amazon Web Services (AWS)....
TVBEurope talks to the team at Framestore about their work on season four of The Crown.
