Sony Pixel Power calrec Sony

The impact real-time technology is having on VFX

14/05/2021

Martin Izzard, head of media and entertainment at Red Lorry Yellow Lorry takes a look at the rise of virtual production

By Contributor

Published: May 14, 2021

Martin Izzard, head of media and entertainment at Red Lorry Yellow Lorry takes a look at the rise of virtual production

target=_blank title=Share on LinkedIn class=share-linkedin>

The last few weeks have seen both the Real Time Conference and FMX take place; albeit virtually. The first is a technology-focused event that covers a number of different industries (VFX included) and the latter a VFX-specific show with panels and sessions that are increasingly being dominated by talk about the deployment of real-time technology. That is, engine technology that can render digital assets, whether it's environments, characters or animation in . well, real time.

Talk to any VFX studio or supervisor about the biggest cinematic or episodic projects from the last few years and you'll find the use of real time technology. It's also increasingly being deployed for smaller productions and has long been the basis for mixed reality experiences which arguably set the scene for some of the techniques that are now becoming standard in the real time-enabled VFX toolkit.

I spoke to some of the experts within technology vendors, VFX studios and service providers about the impact that real time is having on today's VFX industry. Like any emerging technology, it's in a constant state of change and development, but one thing that real time has quickly become synonymous with is virtual production, or VP.

The rise of virtual productionEver since Jon Favreau and the ILM StageCraft team tackled the latest trip into a galaxy far, far away with a lot of LEDs and cameras that respond to digital environments in real-time, filmmakers everywhere have wanted to use this so-called virtual production on their next project.

But Ben Lumsden from Epic Games, the company behind the Unreal Engine, says that it's important to make a distinction between in-camera visual effects, and other forms of virtual production. Thanks to its background, he says Unreal Engine has been set up to do all sorts of forms of virtual production for about eight years, but it just keeps getting better and better at accommodating film, TV, and animation workflows.

As everyone is now realising, there's much more that VP can offer other than just this particular technique. Pascal Achermann is the CEO & technical director at VRFX Realtime Studio, a Swiss studio which uses the Unity engine to create mixed reality content and deliver virtual production services. According to his definition of VP: any time you are using real-time to support your animation, film or commercial production or storytelling, you are producing virtually.

That means, depending on how you deploy real-time technology, the impact it has and the benefit it provides to your project will differ. Ed Thomas, the head of real-time and virtual production for volumetric video capture studio Dimension, says that VP allows filmmakers to create living, breathing worlds at much earlier stages in development than has previously been possible.

He adds that it means each filmmaking discipline has access to key decision-making moments much earlier in the process and in a more collaborative environment [which] democratises the creation of this content.

This interesting prospect that technology innovation doesn't just benefit the filmmakers but everyone around them shows how widely real time technology can be deployed. This might be a production designer who can test colours on the wall of a set without needing to get out a paint brush, or a lighting gaffer who can see different lighting configurations at the touch of a button. It also means that actors can now better visualise a world or a digital character that they otherwise wouldn't have seen until the premiere.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-726x484.jpg alt= width=413 height=275 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-726x484.jpg 726w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-353x235.jpg 353w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-768x512.jpg 768w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-1536x1024.jpg 1536w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-2048x1365.jpg 2048w data-sizes=(max-width: 413px) 100vw, 413px />The Bourne StuntacularIn recent times, VFX studios' worlds have expanded far beyond film and TV screens to include attractions and immersive experiences where real time is really widely used. For example, Cinesite recently won a VES award for its work on The Bourne Stuntacular live show at Universal Studios, Hollywood, which takes place in front of a 130-foot-long LED screen. Unreal Engine was used to render 3D environments throughout production, providing real time feedback and the flexibility to adjust timings and layouts on-site. Without a real time engine in the mix, Cinesite's Salvador Zalvidea said the project would have been a painful and frustrating experience.

Benefits and challengesWhat real-time technology allows is for creatives to experiment with ideas and make decisions early on that would otherwise take weeks to visualise with traditional VFX rendering. On The Bourne Stuntacular project for example, the use of real time for previs meant the team could use a headset to review their work as soon as it was completed in Unreal.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/05/15_The-Bourne-Stuntacular-Technology-726x545.jpg alt= width=416 height=313 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/0
LINK: https://www.tvbeurope.com/production-post/the-impact-real-time-technol...
See more stories from tvb

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

15/04/2026

Spotify Podcast Awards Return to Celebrate Latin America's Most Influential Voices

From immersive storytelling to laugh-out-loud comedies, podcasts are booming in ...

15/04/2026

Spotify Expands Audiobook Features, and Printed Book Sales Go Live in the US and UK

Books have always moved with us, whether tucked in our bags or humming in our he...

15/04/2026

Spotify and NIVA Partner to Support Independent Venues Across the US

For many artists, independent venues are where music careers begin and fan communities take shape. Independent venue operators work hard every day to keep local...

15/04/2026

Spotify Editors Reveal Their Picks for Best Book of the Century (So Far)

From gripping thrillers to poignant memoirs, the 21st century has had no shortage of unforgettable books. To celebrate the standout storytelling of our modern e...

15/04/2026

SonicWorld introduce Telsie T

Vintage broadcast experts release second plug-in Telsie T is the second plug-in to be released by SonicWorld, a German audio company who specialise in servi...

15/04/2026

UAD Explore Free from Universal Audio

Includes eight free UAD plug-ins Universal Audio's latest bundle brings together a selection of their renowned plug-ins and virtual instruments, and is ...

15/04/2026

Maximum uptime for broadcasters: Rohde & Schwarz launches R&SBroadcastShield at NAB 2026

Maximum uptime for broadcasters: Rohde & Schwarz launches R&S BroadcastShield at...

15/04/2026

aconnic launches ACCEED 4430 10 Gigabit system for high volume enterprise and business service aggregation

aconnic AG (ISIN: DE000A0LBKW6), Munich, announces the market launch of the ACCE...

15/04/2026

EVO Entertainment to Bring Dolby Vision+Atmos Across Its EVX Auditoriums

April 15 2026, 13:34 (PDT) EVO Entertainment to Bring Dolby Vision Atmos Across Its EVX Auditoriums Integration would cover 17 screens across Texas, New Mex...

15/04/2026

Introducing Smart Home from Sky, a simple way to stay connected to home, for less

Wednesday 15 April 2026 Introducing Smart Home from Sky, a simple way to stay c...

15/04/2026

The Burbs confirmed to return to Sky and NOW for a second season

Wednesday 15 April 2026 The Burbs confirmed to return to Sky and NOW for a second season Mystery-comedy series, The Burbs, will continue its exclusive resid...

15/04/2026

Moving Next Generation Audio Production Workflows into the Cloud

With new broadcast standards evolving all over the world and OTT streaming striving for the pole position in media consumption, both next-gen video and audio co...

15/04/2026

CentralCast Delivers Breakthrough Efficiencies to Public Broadcasting Stations with Harmonic

Harmonic's XOS Media Processor Delivers Exceptional Video Quality to More th...

15/04/2026

Five Decades of Box Office Intelligence: Comscore Celebrates 50 Years of Movie Measurement

Five Decades of Box Office Intelligence: Comscore Celebrates 50 Years of Movie M...

15/04/2026

RT announces new crime drama The Yank starring Kate Mulgrew and Colm Meaney

Two Cities Television and Keeper Pictures to produce six-part series in association with Screen Ireland for RT and ITV Studios RT has commissioned Two Citie...

15/04/2026

RT unveils The Signal' a specially commissioned 60-second film to celebrate RT100

RT 100 RT unveils The Signal' a specially commissioned 60-second film ...

14/04/2026

ToolsOnAir and Omnistream Bring Mobile SRT Contribution into Professional 24/7 Playout and Live News Workflows

ToolsOnAir and Omnistream Bring Mobile SRT Contribution into Professional 24/7 P...

14/04/2026

AIR Music Tech release Fabric Vintage Synths Vol.1

Captures a trio of renowned polysynths The latest software to join AIR Music Tech's extensive catalogue captures the sound of three sought-after polysyn...

14/04/2026

United Plugins introduce UnitedFreeBundle

Free offering includes 10 powerful plug-ins United Plugins have announced the launch of a new bundle that brings together 10 of their pro-audio plug-ins, an...

14/04/2026

Celemony update Tonalic

Julian Coryell joins virtual session player line-up Announced at NAMM 2026, Celemony's Tonalic kits DAW users out with real performances by world-class ...

14/04/2026

X-Rite Pantone Color Academy Grand Opening in Shanghai

X-Rite Pantone Color Academy Grand Opening in Shanghai On March 27, 2026, X-Rite Pantone, the global authority in color standards and color science, held the...

14/04/2026

VEON and JazzWorld Receive Competition Commission of Pakistan Approval for Acquisition of TPL Insurance

14 Apr 2026 VEON and JazzWorld Receive Competition Commission of Pakistan Appro...

14/04/2026

Nicola Coughlan and Aimee Lou Wood to host next two episodes of Saturday Night Live UK

Tuesday 14 April 2026 Nicola Coughlan and Aimee Lou Wood to host next two episo...

14/04/2026

p Drs leads Sky and AMC+ Original Gangs of London Series 4 as new players enter the fight for control of Londons underworld

Lead writer and executive producer Jack Lothian joins alongside lead director Je...

14/04/2026

Thomas Riedel Acquires Premium Manufacturer ARRI

Wuppertal April 14, 2026 Thomas Riedel Acquires Premium Manufacturer ARRIStrategic Alignment With the Riedel Group for Innovation and Growth Thomas Riedel, f...

14/04/2026

Harmonic Introduces Breakthrough AI Orchestration Service for Live Video Workflows

New Service Simplifies Integration of AI Applications with Exceptional Reliabili...

14/04/2026

SES, Japan Airlines to Expand Multi-Orbit Inflight Connectivity to Long-Haul Fleet

Luxembourg, April 14, 2026 - SES, a leading space solutions company, today annou...

13/04/2026

ToolsOnAir Composition Builder 2026 Boilerplate

ToolsOnAir Composition Builder 2026 Boilerplate More Details: The Composition Builder 2026 application for macOS enables TV stations and Live Event broadcast...

13/04/2026

ToolsOnAr just:live pro 2026 Boilerplate

ToolsOnAr just:live pro 2026 Boilerplate More Details: just:live pro 2026 is a Multi-Channel Live Production Playout solution for video and static or real-ti...

13/04/2026

ToolsOnAr just:play pro 2026 Boilerplate

ToolsOnAr just:play pro 2026 Boilerplate More Details: just:play pro 2026 is a Multi-Channel automated 24/7 Master Control playout solution with SD, HD and U...

13/04/2026

ToolsOnAr live:cut 2026 Boilerplate

ToolsOnAr live:cut 2026 Boilerplate More Details: live:cut is an option to just:in mac pro 2025 and enables multicamera production workflows for up to 16 cam...

13/04/2026

ToolsOnAir Just In Mac Lite NDI 2026 Boilerplate

ToolsOnAir Just In Mac Lite NDI 2026 Boilerplate More Details: The Just In Mac Lite NDI application is a streamlined media capture solution designed specific...

13/04/2026

ToolsOnAir Just In Mac Lite 2026 Boilerplate

ToolsOnAir Just In Mac Lite 2026 Boilerplate More Details: The Just In Mac Lite application is a streamlined media capture solution designed specifically for...

13/04/2026

ToolsOnAir just:in mac pro 2026 Boilerplate

ToolsOnAir just:in mac pro 2026 Boilerplate More Details: just:in mac pro is a macOS-based client-server multichannel capture solution to record SDI, HDMI, N...

13/04/2026

Musik Hack update SweetEQ

Intuitive EQ plug-in gets an upgrade Following its official launch back in February 2026, Musik Hack's intuitive EQ plug-in has been treated to its firs...

13/04/2026

Vintage Vault 5 from UVI

Flagship soft synth collection expanded The latest version of UVI's flagship vintage-inspired soft synth collection has just arrived, expanding the suit...

13/04/2026

Sonuscore launch Lux Orchestral Strings Elements

Free version of innovative string library arrives Released in October 2025, Lux Orchestral Strings was said to be Sonuscore's most ambitious library to ...

13/04/2026

Girls' Research Camp at SGL Carbon in Meitingen inspires young women to pursue STEM careers

The Girls' Research Camp is part of the Technology - Future in Bavaria edu...

13/04/2026

Rohde & Schwarz transforms submarine communications for realtime underwater dominance at UDT 2026

Rohde & Schwarz transforms submarine communications for real time underwater dom...

13/04/2026

Rohde & Schwarz enables Pulsar signal simulation to support next-generation navigation devices

Rohde & Schwarz enables Pulsar signal simulation to support next-generation navi...

13/04/2026

Paddy Treacy is the first act revealed to compete on The Late Late Show Opening Act

The search for Ireland's newest country music star is live on Friday 17 Apri...

13/04/2026

Global environmental action NGO WRAP brings recycling to life with Rescue Me TV campaign, backed by Sky Media

Monday 13 April 2026 Global environmental action NGO WRAP brings recycling to l...

13/04/2026

Jnger Audio Joins EBU ADM Integration Group as Founding Member to Help Advance ADM/S-ADM Integration

J nger Audio has joined the EBU ADM Implementers Group (ADM-IG) as a founding me...