Sony Pixel Power calrec Sony

The impact real-time technology is having on VFX

14/05/2021

Martin Izzard, head of media and entertainment at Red Lorry Yellow Lorry takes a look at the rise of virtual production

By Contributor

Published: May 14, 2021

Martin Izzard, head of media and entertainment at Red Lorry Yellow Lorry takes a look at the rise of virtual production

target=_blank title=Share on LinkedIn class=share-linkedin>

The last few weeks have seen both the Real Time Conference and FMX take place; albeit virtually. The first is a technology-focused event that covers a number of different industries (VFX included) and the latter a VFX-specific show with panels and sessions that are increasingly being dominated by talk about the deployment of real-time technology. That is, engine technology that can render digital assets, whether it's environments, characters or animation in . well, real time.

Talk to any VFX studio or supervisor about the biggest cinematic or episodic projects from the last few years and you'll find the use of real time technology. It's also increasingly being deployed for smaller productions and has long been the basis for mixed reality experiences which arguably set the scene for some of the techniques that are now becoming standard in the real time-enabled VFX toolkit.

I spoke to some of the experts within technology vendors, VFX studios and service providers about the impact that real time is having on today's VFX industry. Like any emerging technology, it's in a constant state of change and development, but one thing that real time has quickly become synonymous with is virtual production, or VP.

The rise of virtual productionEver since Jon Favreau and the ILM StageCraft team tackled the latest trip into a galaxy far, far away with a lot of LEDs and cameras that respond to digital environments in real-time, filmmakers everywhere have wanted to use this so-called virtual production on their next project.

But Ben Lumsden from Epic Games, the company behind the Unreal Engine, says that it's important to make a distinction between in-camera visual effects, and other forms of virtual production. Thanks to its background, he says Unreal Engine has been set up to do all sorts of forms of virtual production for about eight years, but it just keeps getting better and better at accommodating film, TV, and animation workflows.

As everyone is now realising, there's much more that VP can offer other than just this particular technique. Pascal Achermann is the CEO & technical director at VRFX Realtime Studio, a Swiss studio which uses the Unity engine to create mixed reality content and deliver virtual production services. According to his definition of VP: any time you are using real-time to support your animation, film or commercial production or storytelling, you are producing virtually.

That means, depending on how you deploy real-time technology, the impact it has and the benefit it provides to your project will differ. Ed Thomas, the head of real-time and virtual production for volumetric video capture studio Dimension, says that VP allows filmmakers to create living, breathing worlds at much earlier stages in development than has previously been possible.

He adds that it means each filmmaking discipline has access to key decision-making moments much earlier in the process and in a more collaborative environment [which] democratises the creation of this content.

This interesting prospect that technology innovation doesn't just benefit the filmmakers but everyone around them shows how widely real time technology can be deployed. This might be a production designer who can test colours on the wall of a set without needing to get out a paint brush, or a lighting gaffer who can see different lighting configurations at the touch of a button. It also means that actors can now better visualise a world or a digital character that they otherwise wouldn't have seen until the premiere.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-726x484.jpg alt= width=413 height=275 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-726x484.jpg 726w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-353x235.jpg 353w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-768x512.jpg 768w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-1536x1024.jpg 1536w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-2048x1365.jpg 2048w data-sizes=(max-width: 413px) 100vw, 413px />The Bourne StuntacularIn recent times, VFX studios' worlds have expanded far beyond film and TV screens to include attractions and immersive experiences where real time is really widely used. For example, Cinesite recently won a VES award for its work on The Bourne Stuntacular live show at Universal Studios, Hollywood, which takes place in front of a 130-foot-long LED screen. Unreal Engine was used to render 3D environments throughout production, providing real time feedback and the flexibility to adjust timings and layouts on-site. Without a real time engine in the mix, Cinesite's Salvador Zalvidea said the project would have been a painful and frustrating experience.

Benefits and challengesWhat real-time technology allows is for creatives to experiment with ideas and make decisions early on that would otherwise take weeks to visualise with traditional VFX rendering. On The Bourne Stuntacular project for example, the use of real time for previs meant the team could use a headset to review their work as soon as it was completed in Unreal.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/05/15_The-Bourne-Stuntacular-Technology-726x545.jpg alt= width=416 height=313 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/0
LINK: https://www.tvbeurope.com/production-post/the-impact-real-time-technol...
See more stories from tvb

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

15/06/2026

The New Discovery Stack: AI, Metadata and Audience Intelligence

Insights from NAGRAVISION's latest industry webinar featuring One Hungary, Liberty Global and Media Press Group In this blog, Laura Rognoni explores the k...

15/06/2026

Fox Corporation to Acquire Roku, Inc.

Fox Corporation to Acquire Roku, Inc. Combination Creates a Scaled Media and Technology Platform with Superior Reach, Engagement and Monetization Capability ...

14/06/2026

Detroit Drums from Iconic Instruments

Library captures 1960s R&B/pop drum sound Following on from their recent wave of plug-in effects, Iconic Instruments have just launched an all-new virtual d...

13/06/2026

Rhythmic Filters for Devious Machines' Infiltrator

Latest expansion pack includes 252 presets Devious Machines have recently introduced another expansion for their powerful multi-effects plug-in, Infiltrator...

13/06/2026

MetaGrid Pro gains AI Builder

Create custom DAW/plug-in controllers using prompts MetaGrid have recently introduced an all-new AI Builder function to their touchscreen-based control surf...

12/06/2026

GearExpo UK: Home Studio Acoustics Talk

Simple Steps to Better Acoustics - Taming The Small Room Most of us mix in spare rooms and small spaces, where the acoustics fight us at every turn. At Gear...

12/06/2026

Meris introduce the Ottobit X

Latest addition expands vintage-inspired effects palette Meris' Ottobit pedal range draws its inspiration from vintage gaming consoles, and the latest a...

12/06/2026

Sonora Cinematic release Movimento Strings Inflections

Soundbox-based chamber strings series expanded Sonora Cinematic have just announced the launch of the second instalment in their Soundbox-based chamber stri...

12/06/2026

The Future of Studio Grading. Tokyo. 23 June 2026

With John Daro, DI Colourist at Warner Bros. Water Tower Color Tuesday 23 June, 10am-1pm or 3-6pm Restar Corporation Tokyo Register here John Daro is the ...

12/06/2026

New animated series The Grumpy Onion available in English and as Gaeilge on RT KIDSjr, RT2 and RT

Meet The Grumpy Onion Ireland's newest online sensation, all he wants is to ...

12/06/2026

RT stays Up All Night with brand new daily 2026 FIFA World Cup Vodcast

RT stays Up All Night with brand new daily 2026 FIFA World Cup Vodcast Adding to the fun around 2026 FIFA World Cup tournament, RT has launched a brand new d...

11/06/2026

Introducing a New Standard for Podcast Plays and Upgraded Creator Analytics Experience

As podcast formats evolve in the streaming era, podcasting needs updated, transp...

11/06/2026

RADAR Italia Unveils 6 New Artists and a New Approach for 2026

As Spotify's global RADAR program enters its sixth year in Italy, a new class of artists is stepping into the spotlight. Today, we're announcing the six...

11/06/2026

5 Audiobooks that Amplify and Celebrate Queer Voices

Pride Month is a time for celebration, reflection, and amplifying the diverse stories and perspectives from the LGBTQIA+ community that enrich our world. To hel...

11/06/2026

VSL introduce Synchron Solo Violin 1 & Cello (sordino)

First in new line of muted string libraries VSL have just announced the launch of two new string libraries that represent the first two instalments in a new...

11/06/2026

Novation reveal the Launchkey 61 MK4 White

New colour option for 61-key Launchkey MK4 At Superbooth 2025, Novation introduced the Launchkey Mini 37 White and Launchkey 49 White, bringing an additiona...

11/06/2026

Arturia announce the MiniLab 37

Larger, but still compact! Arturia's popular compact MIDI controller keyboard is now available in a, well, slightly less compact version! The new MiniLa...

11/06/2026

Eurosatory 2026: Rohde & Schwarz shapes the new-generation battlefield

Eurosatory 2026: Rohde & Schwarz shapes the new-generation battlefield Rohde & Schwarz unveils next generation SIGINT/EW and CUAS solutions on uncrewed system...

11/06/2026

Rohde & Schwarz unveils NEMACS - Directional, ultra secure connectivity for the future battlefield

Rohde & Schwarz unveils NEMACS - Directional, ultra secure connectivity for the ...

11/06/2026

Daisy May Cooper rallies the nation ahead of ICC Womens T20 World Cup

Thursday 11 June 2026 Daisy May Cooper rallies the nation ahead of ICC Women's T20 World CupTurn on cookies to view this content. Go to Privacy options and...

11/06/2026

RT Radio 1 and Irish Lights mark RT 100 with special broadcasts from Ireland's Lighthouses

Summer solstice shows from C il House and Late Date from 9pm on Saturday 20 Jun...

10/06/2026

GearExpo UK: Interfaces & Mic Preamp Update

Get Hands-On with Interfaces & Mic Preamp Brands If youre after a new interface or preamp, then GearExpo UK is the place to be! Well have a whole host of au...

10/06/2026

MONO Music Conference 2026

November 13-14 2026, The Midway, San Francisco Following their recent rebranding, MONO Music Conference (formerly Music Expo) have officially announced thei...

10/06/2026

ebbandflow launch with deFORM

Debut instrument free for limited time deFORM is the debut release from newly founded developer ebbandflow, and it's being offered as a free download fo...

10/06/2026

Rohde & Schwarz and TRUMPF advance laser-based drone defense with THORIS LCS

Rohde & Schwarz and TRUMPF advance laser-based drone defense with THORIS LCS Rohde & Schwarz is showcasing THORIS at ILA 2026: A sovereign, end to end counter...

10/06/2026

MAHLE and Rohde & Schwarz develop application for sensor testing of modern driver assistance systems

MAHLE and Rohde & Schwarz develop application for sensor testing of modern drive...

10/06/2026

VEON's Banglalink Brings Every World Cup 2026 Match to Football Fans in Bangladesh on Toffee

10 Jun 2026 VEON's Banglalink Brings Every World Cup 2026 Match to Football...

10/06/2026

How to watch every ICC Womens T20 World Cup 2026 match live on Sky Sports

Wednesday 10 June 2026 How to watch every ICC Women's T20 World Cup 2026 match live on Sky Sports Where is the ICC Women's T20 World Cup 2026 availabl...

10/06/2026

PRLA brings first-ever Beautifully Clean Oral Care TV campaign to screens nationwide with Sky

Wednesday 10 June 2026 P RLA brings first-ever Beautifully Clean Oral Care'...

10/06/2026

Sky reveals pulse-pounding first teaser trailer for upcoming crime drama Fightland

Wednesday 10 June 2026 Sky reveals pulse-pounding first teaser trailer for upco...

10/06/2026

Riedel Artist at the Heart of the 14th World Live Neurovascular Conference

Wuppertal June 10, 2026 Riedel Artist at the Heart of the 14th World Live Neurovascular ConferenceAt the 14th World Live Neurovascular Conference (WLNC) in Li...

09/06/2026

Watch LE SSERAFIM's PURE FLOWERS LIVE Performance Videos and Fan Q&A, Only on Spotify

Last month, Spotify hosted PURE FLOWERS LIVE, a special event celebrating the re...

09/06/2026

Watch RADAR UK Artist Skye Newman Perform Live in London for Her SE9' Album Launch

Last month, RADAR U.K. artist Skye Newman took the stage in East London for a sp...

09/06/2026

Announcement from Wayne Jones Audio

Company to cease operating on 30 June 2026 Australian loudspeaker and amplifier manufacturer Wayne Jones Audio have announced that after much consideration,...

09/06/2026

bigBASS from fedDSP

Increases low-end weight and character The latest plug-in release from Sheffield-based fedDSP aims to offer an all-in-one solution for users in search of mo...

09/06/2026

Fender Studio Pro 8.1 arrives

Introduces AI Studio Assistant, Moises Studio integration & more Fender Studio have just announced the launch of a significant update that brings an array o...

09/06/2026

BBC Casts Edward Bluemel As Poirot In Hercule,' As BritBox Boards Agatha Christie Remake In U.S.

The BBC has found its Hercule Poirot. After Deadline revealed last month that t...

09/06/2026

Brian Conley to front love letter to the world's longest running sitcom with The Last Drop of Summer Wine on U&GOLD

Filming to take place in Holmfirth 9th June 2026, London: U&GOLD is heading bac...

09/06/2026

X-Rite Pantone Launches Offset360 to Modernize Color Control Across Existing Presses

X-Rite Pantone Launches Offset360 to Modernize Color Control Across Existing Pre...

09/06/2026

VEON Appoints Serkan Ozturk as Chief of Staff & Strategy Officer

09 Jun 2026 VEON Appoints Serkan Ozturk as Chief of Staff & Strategy Officer Dubai and New York, June 9, 2026 - VEON Ltd. (NASDAQ: VEON), a global digital oper...

09/06/2026

Katie Price: Nothing to Hide, a candid and unfiltered account of three decades in the spotlight, coming to Sky and NOW on 8 July

Tuesday 9 June 2026 Katie Price: Nothing to Hide, a candid and unfiltered accou...

09/06/2026

ENNI Will Be Using AEP.EnerS4 Billing Solution

Enni Continues to Rely on Arvato Systems - And Will Be Using AEP.EnerS4 Billing Solution Arvato Systems to implement transformation project for SAP S/4HANA Ut...

09/06/2026

RT Radio 1 is bringing Arena and Cil House to London celebrating 100 years of RT

These special programmes will highlight RT 's connection with the Irish diaspora This year, RT is marking 100 years of public broadcasting in Ireland with...

08/06/2026

Meet the New GLOW Ambassadors Leading Spotify's Global Pride Celebration

At Spotify, our commitment to the LGBTQIA community is year-round. Through GLOW, our global music program, we celebrate and amplify the contributions of queer ...