Sony Pixel Power calrec Sony

The impact real-time technology is having on VFX

14/05/2021

Martin Izzard, head of media and entertainment at Red Lorry Yellow Lorry takes a look at the rise of virtual production

By Contributor

Published: May 14, 2021

Martin Izzard, head of media and entertainment at Red Lorry Yellow Lorry takes a look at the rise of virtual production

target=_blank title=Share on LinkedIn class=share-linkedin>

The last few weeks have seen both the Real Time Conference and FMX take place; albeit virtually. The first is a technology-focused event that covers a number of different industries (VFX included) and the latter a VFX-specific show with panels and sessions that are increasingly being dominated by talk about the deployment of real-time technology. That is, engine technology that can render digital assets, whether it's environments, characters or animation in . well, real time.

Talk to any VFX studio or supervisor about the biggest cinematic or episodic projects from the last few years and you'll find the use of real time technology. It's also increasingly being deployed for smaller productions and has long been the basis for mixed reality experiences which arguably set the scene for some of the techniques that are now becoming standard in the real time-enabled VFX toolkit.

I spoke to some of the experts within technology vendors, VFX studios and service providers about the impact that real time is having on today's VFX industry. Like any emerging technology, it's in a constant state of change and development, but one thing that real time has quickly become synonymous with is virtual production, or VP.

The rise of virtual productionEver since Jon Favreau and the ILM StageCraft team tackled the latest trip into a galaxy far, far away with a lot of LEDs and cameras that respond to digital environments in real-time, filmmakers everywhere have wanted to use this so-called virtual production on their next project.

But Ben Lumsden from Epic Games, the company behind the Unreal Engine, says that it's important to make a distinction between in-camera visual effects, and other forms of virtual production. Thanks to its background, he says Unreal Engine has been set up to do all sorts of forms of virtual production for about eight years, but it just keeps getting better and better at accommodating film, TV, and animation workflows.

As everyone is now realising, there's much more that VP can offer other than just this particular technique. Pascal Achermann is the CEO & technical director at VRFX Realtime Studio, a Swiss studio which uses the Unity engine to create mixed reality content and deliver virtual production services. According to his definition of VP: any time you are using real-time to support your animation, film or commercial production or storytelling, you are producing virtually.

That means, depending on how you deploy real-time technology, the impact it has and the benefit it provides to your project will differ. Ed Thomas, the head of real-time and virtual production for volumetric video capture studio Dimension, says that VP allows filmmakers to create living, breathing worlds at much earlier stages in development than has previously been possible.

He adds that it means each filmmaking discipline has access to key decision-making moments much earlier in the process and in a more collaborative environment [which] democratises the creation of this content.

This interesting prospect that technology innovation doesn't just benefit the filmmakers but everyone around them shows how widely real time technology can be deployed. This might be a production designer who can test colours on the wall of a set without needing to get out a paint brush, or a lighting gaffer who can see different lighting configurations at the touch of a button. It also means that actors can now better visualise a world or a digital character that they otherwise wouldn't have seen until the premiere.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-726x484.jpg alt= width=413 height=275 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-726x484.jpg 726w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-353x235.jpg 353w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-768x512.jpg 768w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-1536x1024.jpg 1536w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-2048x1365.jpg 2048w data-sizes=(max-width: 413px) 100vw, 413px />The Bourne StuntacularIn recent times, VFX studios' worlds have expanded far beyond film and TV screens to include attractions and immersive experiences where real time is really widely used. For example, Cinesite recently won a VES award for its work on The Bourne Stuntacular live show at Universal Studios, Hollywood, which takes place in front of a 130-foot-long LED screen. Unreal Engine was used to render 3D environments throughout production, providing real time feedback and the flexibility to adjust timings and layouts on-site. Without a real time engine in the mix, Cinesite's Salvador Zalvidea said the project would have been a painful and frustrating experience.

Benefits and challengesWhat real-time technology allows is for creatives to experiment with ideas and make decisions early on that would otherwise take weeks to visualise with traditional VFX rendering. On The Bourne Stuntacular project for example, the use of real time for previs meant the team could use a headset to review their work as soon as it was completed in Unreal.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/05/15_The-Bourne-Stuntacular-Technology-726x545.jpg alt= width=416 height=313 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/0
LINK: https://www.tvbeurope.com/production-post/the-impact-real-time-technol...
See more stories from tvb

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

17/11/2026

Freqport introduce FreqLift plug-in

Multiband dynamics plug-in boasts FT1 integration Freqport's latest plug-in combines multiband upward and downward dynamics with the company's renow...

17/11/2026

Studio 5X: Debut monitors from Teufel Audio

Hi-fi experts launch two pro-audio models Berlin-based hi-fi experts Teufel Audio have recently branched out into the pro-audio world with their first pairs...

17/11/2026

EastWest Black Friday 2026

A year of ComposerCloud+ for $99 EastWest's annual Black Friday Sale is already live, and new users are being offered one year of the all-encompassing C...

17/11/2026

SOS Awards: Make Your Vote Count!

Pick your favourite gear from 2026 The annual SOS Awards are now underway, and as always, we're asking readers to help us choose the best pro-audio rele...

17/11/2026

Production capacity expanded at SGL Carbons Ried im Innkreis site

As part of an ongoing series production program for a German automaker, production capacity has been increased at SGL Carbon's Austrian site in Ried im Innk...

17/11/2026

Clear-Com Delivers Portable Wireless Systems for Secure Aircraft Communications Testing

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

17/11/2026

Sky announces major free upgrade to the Sky Glass and Sky Stream experience with the launch of the new Sky OS

Tuesday 17 November 2026 Sky announces major free upgrade to the Sky Glass and ...

17/11/2026

Passion, Betrayal and Scandal: Sky Arts Reveals the Man Behind the Music in Dangerous Debussy, Premiering 1 December

Tuesday 17 November 2026 Passion, Betrayal and Scandal: Sky Arts Reveals the Ma...

17/11/2026

Apple Podcasts names Baby, this is Keke\u00A0Palmer the 2026 Show of the Year - UPDATE - Posted on 17 November 2026

Today, Apple Podcasts named Baby, this is Keke Palmer its Show of the Year, hono...

16/11/2026

New plug-in suite from Berry Effects

Creative effects designed to encourage experimentation Berry Effects is the brainchild of Abe and Ralph, a pair of multi-instrumentalists and audio engineer...

16/11/2026

Anukari 1.1 now available

Physics-based synth gets first major update Anukari have just released a new version of their innovative physics-based software synth, marking the instrumen...

16/11/2026

Hit'n'Mix RipX DAW 9 arrives

Both versions kitted out with new tools & improvements Hit'n'Mix have just launched the latest major version of their innovative DAW software, with ...

16/11/2026

Eventide to launch SplitEQ 2

Dynamic bands, unmasking features & new stereo tools Launched in 2021, Eventide's SplitEQ plug-in introduced an interesting new approach to EQ, with the...

16/11/2026

Rohde & Schwarz Japan demonstrates multi-vendor ASA-ML communication with highperformance oscilloscope

Rohde & Schwarz Japan demonstrates multi-vendor ASA-ML communication with high p...

16/11/2026

CNAO and Hitachi launch advanced rotating proton therapy system in Italy

November 16, 2026 Hitachi system enables proton beams to be delivered from 360 degrees around the patient, expanding treatment capacity and supporting more pre...

16/11/2026

SES and ITU Expand Partner2Connect Digital-learning Initiative to 30 African Schools

Initiative in Malawi, Burundi, Zambia and Zimbabwe will leverage SES satellite s...

16/11/2026

U sees new original drama Fleet Street from the creators of Miss Scarlet

Images available HERE UKTV has announced Fleet Street (6x60'), a new period crime drama from Miss Scarlet creators Rachael New and Ben Edwards, coming to f...

16/11/2026

Sky and NOW bring some of the UKs biggest video podcasts to the big screen at no extra cost with Platform Media as first partner

From Graham Norton to Olivia Attwood and Joe Marler, a new collection of hit vid...

16/11/2026

Can Digital Product Passports help meet climate goals?

As countries gather to discuss climate targets at COP 31 this week, one question that is at the heart of debates is how to measure the environmental impact of t...

15/11/2026

Yamaha launch MGX, URX & CC1 updates

Mixers, interfaces & DAW controller receive new firmware Yamaha have just launched a trio of firmware updates that bring some powerful new functionality to ...

14/11/2026

Rotary Exciter & Resonator Clamps from ADDAC System

Modular innovators introduce two guitar-based products ADDAC System's recently introduced Four String Series makes it possible to integrate physical str...

13/11/2026

HLabs reveal the CL089

Studer-inspired 500-series PWM compressor unveiled The HLabs range already includes a couple of Studer-inspired offerings in the form of the PRE169 and EQ16...

13/11/2026

Freedom of Choice White Paper

Download Now! To view the white paper, please enter the following details: -- First Name* First Name Company* Country* Please select your countryA...

13/11/2026

Apple HomeView available today - UPDATE - Posted on 13 November 2026

Beginning today, November 13, Apple HomeView is available for purchase at Apple Store locations, on the Apple Store online, and in the Apple Store app in select...

12/11/2026

UVI release Twin 88 Keys

Blend between concert grand & vintage electric pianos UVI's latest release combines a concert grand with a vintage electric piano in a single instrument...

12/11/2026

Universal Audio reintroduce UAD Cooper Time Cube Delay

Native version of popular effects plug-in arrives Many of the plug-ins that used to require Universal Audios Apollo interfaces or DSP accelerators have made...

12/11/2026

Audient launch the iD Mk3 line-up

Four next-generation interfaces announced Following on from the release of their new flagship Thunderbolt interfaces, Audient have refreshed the design of t...

12/11/2026

Rohde & Schwarz and Connektica showcase automated RF test systems for satellite payloads and radar at Space Tech Expo

Rohde & Schwarz and Connektica showcase automated RF test systems for satellite ...

12/11/2026

More Pets, More Laughs, and More Chaos: The Big Pet Project is back

Airing Sunday 15 November on RT One and RT Player at 5.10pm A new series of The Big Pet Project kicks off this Sunday, brightening our winter evenings with a...

12/11/2026

U unveils first look teaser for brand-new drama, The Cadburys

Image available HERE Teaser available HERE A teaser for The Cadburys (6x60') has been released, introducing audiences to the core family of George (Harry ...

12/11/2026

Jeremiah Slovarp on building Jereco from the ground up in rural Montana

An island in rural MontanaJeremiah Slovarp owns Jereco in Bozeman, Montana, and teaches music technology and recording arts at Montana State University. He star...

12/11/2026

Introducing Ask the AI GP'

Who am I and whats an AI GP? Im Kathryn Hodgkinson, and Ive recently qualified as an Artificial Intelligence Governance Professional (AIGP), a certification awa...

12/11/2026

RT Coverage of European Political Community Summit in Dublin

RT will provide extensive coverage of the European Political Community Summit in Dublin across television, radio and online on Thursday, 12 November 2026. As p...

11/11/2026

Spitfire Audio & Eric Whitacre launch Eternity

Third collaboration with Grammy-winning composer & conductor Spitfire Audio have announced the release of Eternity, the third sample library to be created a...

11/11/2026

Modbap release Wax Theory

Eurorack experts launch vinyl-inspired plug-in When praised Eurorackers Modbap revealed their first software effect recently, they stated it was the first r...

11/11/2026

If your fraud tool detects invalid traffic, what happens next?

Fraud detection and removal tools play an important role in defending advertising budgets against invalid traffic. A robust fraud tool, independently accredited...

11/11/2026

Irish culture and music take centre stage at COP31 event in Turkiye this Friday in partnership with RT lyric fm

RT lyric fm is partnering with the Department of Climate, Energy, and the Envir...

11/11/2026

Meet the eight finalists for RT TODAY's Christmas Home Cook Competition

RT TODAY show has announced the eight finalists for its festive amateur cook competition Christmas Home Cook'. Following the success of TODAY TV Home C...

10/11/2026

VSL introduce Vienna Performer

New tool humanises orchestral MIDI parts Described as a session musician inside your DAW, VSL's latest plug-in aims to make quick work of making program...

10/11/2026

PSPaudioware release PSP ClassicQlite

Free EQ launched alongside four major updates PSPaudioware have just launched their latest free plug-in, along with a set of updates that bring modern OS co...

10/11/2026

John Walden Cubase Essentials promotion

Save 25% throughout November 2026 Following the recent release of Cubase 16, regular SOS contributor John Walden has announced that he will be running a 25%...

10/11/2026

Ableton Live 13 announced

Set to launch in early 2027 The latest version of Ableton's DAW software has just been unveiled, and will be making an official appearance in early 2027...

10/11/2026

IoT frequency bands below 6 GHz: range, power and antenna trade-offs

IoT devices use a wide range of frequency bands below 6 GHz, from Sub-GHz LPWAN sensors to 5G and Wi-Fi systems. Lower frequencies such as 433 MHz, 868 MHz, 915...

10/11/2026

How to Choose an embedded GPS antenna

A ceramic patch GPS antenna may fit mechanically but still perform poorly if it is too small, incorrectly orientated, placed near noisy electronics or installed...

10/11/2026

Does an Active Patch GNSS Antenna Need a Ground Plane?

A GPS antenna ground plane provides the conductive RF reference a ceramic GPS/GNSS patch needs, but that does not always mean the product PCB must provide it. T...

10/11/2026

External GPS antenna vs internal antenna: when should you move outside the enclosure?

An external GPS antenna is usually the better option when the product enclosure ...

10/11/2026

New R&S FNH combines spectrum analysis, vector network analysis and power metering in a handheld format

New R&S FNH combines spectrum analysis, vector network analysis and power meteri...

10/11/2026

Clear-Com Supports Global Student Broadcast On Air 2026 With Integrated Intercom Solutions

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

10/11/2026

Winners Announcement RT Radio 1 Folk Awards

Two awards for Barry Kerr Awards also for Beoga, Macdara Yeates, Ultan O'Brien, Joshua Burnside, Rua R President Connolly announces formal induction of ...