Sony Pixel Power calrec Sony

The impact real-time technology is having on VFX

14/05/2021

Martin Izzard, head of media and entertainment at Red Lorry Yellow Lorry takes a look at the rise of virtual production

By Contributor

Published: May 14, 2021

Martin Izzard, head of media and entertainment at Red Lorry Yellow Lorry takes a look at the rise of virtual production

target=_blank title=Share on LinkedIn class=share-linkedin>

The last few weeks have seen both the Real Time Conference and FMX take place; albeit virtually. The first is a technology-focused event that covers a number of different industries (VFX included) and the latter a VFX-specific show with panels and sessions that are increasingly being dominated by talk about the deployment of real-time technology. That is, engine technology that can render digital assets, whether it's environments, characters or animation in . well, real time.

Talk to any VFX studio or supervisor about the biggest cinematic or episodic projects from the last few years and you'll find the use of real time technology. It's also increasingly being deployed for smaller productions and has long been the basis for mixed reality experiences which arguably set the scene for some of the techniques that are now becoming standard in the real time-enabled VFX toolkit.

I spoke to some of the experts within technology vendors, VFX studios and service providers about the impact that real time is having on today's VFX industry. Like any emerging technology, it's in a constant state of change and development, but one thing that real time has quickly become synonymous with is virtual production, or VP.

The rise of virtual productionEver since Jon Favreau and the ILM StageCraft team tackled the latest trip into a galaxy far, far away with a lot of LEDs and cameras that respond to digital environments in real-time, filmmakers everywhere have wanted to use this so-called virtual production on their next project.

But Ben Lumsden from Epic Games, the company behind the Unreal Engine, says that it's important to make a distinction between in-camera visual effects, and other forms of virtual production. Thanks to its background, he says Unreal Engine has been set up to do all sorts of forms of virtual production for about eight years, but it just keeps getting better and better at accommodating film, TV, and animation workflows.

As everyone is now realising, there's much more that VP can offer other than just this particular technique. Pascal Achermann is the CEO & technical director at VRFX Realtime Studio, a Swiss studio which uses the Unity engine to create mixed reality content and deliver virtual production services. According to his definition of VP: any time you are using real-time to support your animation, film or commercial production or storytelling, you are producing virtually.

That means, depending on how you deploy real-time technology, the impact it has and the benefit it provides to your project will differ. Ed Thomas, the head of real-time and virtual production for volumetric video capture studio Dimension, says that VP allows filmmakers to create living, breathing worlds at much earlier stages in development than has previously been possible.

He adds that it means each filmmaking discipline has access to key decision-making moments much earlier in the process and in a more collaborative environment [which] democratises the creation of this content.

This interesting prospect that technology innovation doesn't just benefit the filmmakers but everyone around them shows how widely real time technology can be deployed. This might be a production designer who can test colours on the wall of a set without needing to get out a paint brush, or a lighting gaffer who can see different lighting configurations at the touch of a button. It also means that actors can now better visualise a world or a digital character that they otherwise wouldn't have seen until the premiere.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-726x484.jpg alt= width=413 height=275 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-726x484.jpg 726w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-353x235.jpg 353w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-768x512.jpg 768w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-1536x1024.jpg 1536w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-2048x1365.jpg 2048w data-sizes=(max-width: 413px) 100vw, 413px />The Bourne StuntacularIn recent times, VFX studios' worlds have expanded far beyond film and TV screens to include attractions and immersive experiences where real time is really widely used. For example, Cinesite recently won a VES award for its work on The Bourne Stuntacular live show at Universal Studios, Hollywood, which takes place in front of a 130-foot-long LED screen. Unreal Engine was used to render 3D environments throughout production, providing real time feedback and the flexibility to adjust timings and layouts on-site. Without a real time engine in the mix, Cinesite's Salvador Zalvidea said the project would have been a painful and frustrating experience.

Benefits and challengesWhat real-time technology allows is for creatives to experiment with ideas and make decisions early on that would otherwise take weeks to visualise with traditional VFX rendering. On The Bourne Stuntacular project for example, the use of real time for previs meant the team could use a headset to review their work as soon as it was completed in Unreal.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/05/15_The-Bourne-Stuntacular-Technology-726x545.jpg alt= width=416 height=313 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/0
LINK: https://www.tvbeurope.com/production-post/the-impact-real-time-technol...
See more stories from tvb

Most recent headlines

04/08/2024

Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation

Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....

03/06/2024

Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives

Dalet, a leading technology and service provider for media-rich organizations, a...

28/04/2024

Mediahaus delivers the first SRT live-streaming sports production over 5G with URSA Broadcast G2

Mediahaus delivers the first SRT live-streaming sports production over 5G with U...

19/04/2024

Thank You for visiting us at NAB 2024!

Thank You for visiting us at NAB 2024! Thank you for joining us at the ToolsOnAir booth during NAB Show 2024! We were delighted to showcase our latest inno...

19/04/2024

Stress Positions Mines Health Anxieties for Comedy

PARK CITY, UTAH - JANUARY 18: (L-R) John Early and Theda Hammel attend the 2024 Sundance Film Festival Stress Positions premiere at Library Center Theatre on ...

19/04/2024

Give Me the Backstory: Get to Know Julian Brave NoiseCat and Emily Kassie, the Filmmakers Behind Sugarcane

By Lucy Spicer One of the most exciting things about the Sundance Film Festival...

19/04/2024

Mexico City Watchlist: 7 Documentaries About Working in CDMX

Pictured: Midnight Family By Stephanie Ornelas A great way to get to know a city as culturally unique and rich as Mexico City is to listen to the stories tol...

19/04/2024

SNS Dominates NAB Show 2024 With Triple Win For MOD

St. Louis, MO - April 18, 2024 - Studio Network Solutions (SNS) announced today that MOD won three prestigious industry awards at NAB Show 2024 held this week i...

19/04/2024

How Spotify Approaches Safety With Sarah Hoyle, Global Head of Trust and Safety

Spotify's mission is to unlock the potential of human creativity by giving a million artists the opportunity to live off their art and billions of fans the ...

19/04/2024

Spotify and Taylor Swift Create a One-of-a-Kind Library To Celebrate THE TORTURED POETS DEPARTMENT'

It's a beautiful day to be a Swiftie. Today, Taylor Swift dropped her 11th s...

19/04/2024

L3Harris Announces Quarterly Dividend

MELBOURNE, Fla., April 19, 2024 - The Board of Directors of L3Harris Technologies (NYSE:LHX) declared a quarterly cash dividend of $1.16 per common share, payab...

19/04/2024

Intel Lays Out 8K Production, AI Tech Plans for Paris Olympics

PARIS Intel has announced that its plans for the Olympic and Paralympic Games Paris 2024 will include using artificial intelligence technology powered by Intel ...

19/04/2024

Tech Advances Boost Adoption of 8K Production

LAS VEGAS Technologists working on all aspects of the 8K media production chain offered an optimistic update at the 2024 NAB Show on the state of 8K in video pr...

19/04/2024

OpenDrives New Software-Defined Platform Atlas Wins 2024 NAB Show Product of the Year Award

OpenDrives New Software-Defined Platform Atlas Wins 2024 NAB Show Product of the...

19/04/2024

Grass Valley Showcases Next-Generation T3 Series 4K/HD Digital Recording and Playback for Venues and Stadiums

Grass Valley Showcases Next-Generation T3 Series 4K/HD Digital Recording and Pla...

19/04/2024

NiTRo's M-CUBE Studio Levels Up Esports Productions with AJA Gear

NiTRo's M-CUBE Studio Levels Up Esports Productions with AJA Gear Brie Clayton April 19, 2024 0 Comments Esports' rapid rise to popularity can...

19/04/2024

Blackmagic Design Announces DaVinci Resolve 19

Blackmagic Design Announces DaVinci Resolve 19 Brie Clayton April 19, 2024 0 Comments Major update adds new DaVinci Neural Engine AI tools, new color ...

19/04/2024

Sony Considering Bid to Acquire Paramount

Sony Pictures Entertainment is reportedly in talks with Apollo Global Management to make a bid to acquire Paramount which itself is currently discussing a merge...

19/04/2024

How 1185 Films created the VFX on new horror, All You Need Is Death

Simon Wilkinson, head of VFX at 1185 films, talks about the technology behind the newly-released horror By Matthew Corrigan Published: April 19, 2024 Simo...

19/04/2024

Could Sony be preparing a bid for Channel 5's parent company?

The global electronics company is said to be considering joining forces with investment firm Apollo Management to bid for Paramount Global By Jenny Priestley ...

19/04/2024

EBU report highlights contribution of free-to-air sport broadcasting

The report broke the economic footprint of EBU member sports broadcasting into three main areas By Matthew Corrigan Published: April 19, 2024 The report b...

19/04/2024

CBS Stations Launches CBS News California Investigates' Segments

CBS Stations has launched CBS News California Investigates , with Julie Watts named regional CBS California correspondent. She will uncover and raise awarenes...

19/04/2024

MediaCo Acquires Estrella Media's Spanish-Language Network, Content Assets

MediaCo Holding, which owns radio stations WQHT (Hot 97) and WBLS in New York, said it acquired Estrella Media's Spanish-language video, audio and digital c...

19/04/2024

Season 5 of The Witcher' Will Be Final One

Netflix has ordered season five of fantasy drama The Witcher, which will be the final season. Production has recently begun on season four, and the two remainin...

19/04/2024

DirecTV Stream To Carry Eight More The CW Affiliates

DirecTV Stream said it added eight more The CW affiliates to its lineup on Thursday....

19/04/2024

CBS Orders More Elsbeth'

CBS has renewed Elsbeth for the 2024-2025 season. The drama, with Carrie Preston in the lead role, debuted February 29....

19/04/2024

With Bears on the Clock. NBCU Local Chicago Plans Extensive NFL Draft Coverage

With the Bears picking first, NBCUniversal Local's properties in Chicago plan extensive coverage of the NFL draft next week....

19/04/2024

Comcast Launches NOW

PHILADELPHIA As government subsidies for broadband services come to an end, Comcast has launched NOW, a new product portfolio of lower-cost Internet, mobile and...

19/04/2024

DirecTV Stream Adds CW Affiliates

DirecTV Stream has added more local CW stations for its streaming customers in Boston, Charlotte, Cincinnati, Cleveland, Hartford-New Haven Conn., Phoenix, San ...

19/04/2024

MediaCo Acquires Estrella Media's Content and Digital Operations

NEW YORK & LOS ANGELES MediaCo Holding Inc. has announced that it has acquired all of Estrella Media's network, content, digital, and commercial operations....

19/04/2024

Adobe Launches New Adobe Express Mobile App with Firefly AI

SAN JOSE, Calif. Adobe has announced that the all-new Adobe Express mobile app is available to all users, bringing features powered by Adobe Firefly generative ...

19/04/2024

Netflix Adds 9.3M Subs in Q1

LOS GATOS, Calif. Netflix reported another blockbuster quarter by adding 9.33 million new subscribers in Q1, 2024 as global paid memberships hit 269.6 million, ...

19/04/2024

The Current State of the Industry and the Future Impact of AI

The Current State of the Industry and the Future Impact of AI Hillary Lewis April 18, 2024 0 Comments The Entertainment Industry: How did we get here ...

19/04/2024

After Effects Tutorial Text Blur Reveal

After Effects Tutorial Text Blur Reveal Andy Ford April 18, 2024 0 Comments Here's a way to do a quick blur reveal for your text layer. Start by...

19/04/2024

Hollyland Mars M1 Enhanced Wireless Transmitter / Receiver

Hollyland Mars M1 Enhanced Wireless Transmitter / Receiver Colin Smith April 18, 2024 0 Comments This tutorial shows the new wireless transmitter rece...

19/04/2024

Resolve Fusion: Writing Expressions with Lua

Resolve Fusion: Writing Expressions with Lua Simon Ubsdell April 18, 2024 0 Comments The answer to the very frequently-asked question: what is the pro...

19/04/2024

B+C,' Next TV' Announce Winners of Best of Show Awards at NAB Show

B+C and Next TV have announced the winners of Best of Show Awards for the 2024 NAB Show. The awards were judged by a panel of industry experts at the convention...

19/04/2024

Cate Blanchett Narrates Nature Series on Netflix

Cate Blanchett narrates the Netflix series Our Living World, which premieres April 17. The four-part series looks at the extraordinary creatures around the glob...

19/04/2024

For All Mankind' Spinoff Is in the Works at Apple TV Plus

Apple TV Plus has a spinoff of For All Mankind in the works. It is called Star City and details the cosmonauts, engineers and intelligence officers working behi...

19/04/2024

Jacquie Walker, Longtime Buffalo Anchor, Stepping Down From Desk

Jacquie Walker, longtime anchor at WIVB Buffalo, will step down from the anchor desk. She has spent over 40 years at WIVB and her last day as an anchor is May 2...

19/04/2024

Bob Hearts Abishola' To Make Syndicated Debut This Fall

Bob Hearts Abishola will premiere in broadcast syndication this fall on such station groups as Nexstar Media Group, Sinclair, Hearst Television, Tegna, E.W. Scr...

19/04/2024

Live With Kelly and Mark' Celebrates One-Year Anniversary

Live With Kelly and Mark remains TV's top entertainment talk show as Kelly Ripa and her co-host and husband Mark Consuelo celebrate their one-year anniversa...

19/04/2024

Sean McLaughlin Named VP of News at Graham Media Group

Sean McLaughlin has been named VP of news for Graham Media Group. He had been senior VP of local news at E.W. Scripps. He will will be responsible for developi...

19/04/2024

Netflix Shares First Peek at Long-Awaited One Hundred Years of Solitude'

Netflix has shared the first trailer from One Hundred Years of Solitude, a series based on the esteemed novel by Gabriel Garc a M rquez. The streamer is on boar...

19/04/2024

NAB 2024 Draws 61,000+ Attendees With More Than Half Attending the Show for the First Time

NAB 2024 Draws 61,000+ Attendees With More Than Half Attending the Show for the ...

19/04/2024

Rohde & Schwarz and VIAVI support European OTIC in Berlin for O-RAN conformance certification

Rohde & Schwarz and VIAVI support European OTIC in Berlin for O-RAN conformance ...

19/04/2024

Riedel launches Bolero Connect for seamless integration with PunQtum

Wuppertal April 19, 2024 Riedel launches Bolero Connect for seamless integration with PunQtum A pioneer in the field of digital intercom, Riedel has recently ...