Sony Pixel Power calrec Sony

The impact real-time technology is having on VFX

14/05/2021

Martin Izzard, head of media and entertainment at Red Lorry Yellow Lorry takes a look at the rise of virtual production

By Contributor

Published: May 14, 2021

Martin Izzard, head of media and entertainment at Red Lorry Yellow Lorry takes a look at the rise of virtual production

target=_blank title=Share on LinkedIn class=share-linkedin>

The last few weeks have seen both the Real Time Conference and FMX take place; albeit virtually. The first is a technology-focused event that covers a number of different industries (VFX included) and the latter a VFX-specific show with panels and sessions that are increasingly being dominated by talk about the deployment of real-time technology. That is, engine technology that can render digital assets, whether it's environments, characters or animation in . well, real time.

Talk to any VFX studio or supervisor about the biggest cinematic or episodic projects from the last few years and you'll find the use of real time technology. It's also increasingly being deployed for smaller productions and has long been the basis for mixed reality experiences which arguably set the scene for some of the techniques that are now becoming standard in the real time-enabled VFX toolkit.

I spoke to some of the experts within technology vendors, VFX studios and service providers about the impact that real time is having on today's VFX industry. Like any emerging technology, it's in a constant state of change and development, but one thing that real time has quickly become synonymous with is virtual production, or VP.

The rise of virtual productionEver since Jon Favreau and the ILM StageCraft team tackled the latest trip into a galaxy far, far away with a lot of LEDs and cameras that respond to digital environments in real-time, filmmakers everywhere have wanted to use this so-called virtual production on their next project.

But Ben Lumsden from Epic Games, the company behind the Unreal Engine, says that it's important to make a distinction between in-camera visual effects, and other forms of virtual production. Thanks to its background, he says Unreal Engine has been set up to do all sorts of forms of virtual production for about eight years, but it just keeps getting better and better at accommodating film, TV, and animation workflows.

As everyone is now realising, there's much more that VP can offer other than just this particular technique. Pascal Achermann is the CEO & technical director at VRFX Realtime Studio, a Swiss studio which uses the Unity engine to create mixed reality content and deliver virtual production services. According to his definition of VP: any time you are using real-time to support your animation, film or commercial production or storytelling, you are producing virtually.

That means, depending on how you deploy real-time technology, the impact it has and the benefit it provides to your project will differ. Ed Thomas, the head of real-time and virtual production for volumetric video capture studio Dimension, says that VP allows filmmakers to create living, breathing worlds at much earlier stages in development than has previously been possible.

He adds that it means each filmmaking discipline has access to key decision-making moments much earlier in the process and in a more collaborative environment [which] democratises the creation of this content.

This interesting prospect that technology innovation doesn't just benefit the filmmakers but everyone around them shows how widely real time technology can be deployed. This might be a production designer who can test colours on the wall of a set without needing to get out a paint brush, or a lighting gaffer who can see different lighting configurations at the touch of a button. It also means that actors can now better visualise a world or a digital character that they otherwise wouldn't have seen until the premiere.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-726x484.jpg alt= width=413 height=275 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-726x484.jpg 726w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-353x235.jpg 353w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-768x512.jpg 768w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-1536x1024.jpg 1536w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-2048x1365.jpg 2048w data-sizes=(max-width: 413px) 100vw, 413px />The Bourne StuntacularIn recent times, VFX studios' worlds have expanded far beyond film and TV screens to include attractions and immersive experiences where real time is really widely used. For example, Cinesite recently won a VES award for its work on The Bourne Stuntacular live show at Universal Studios, Hollywood, which takes place in front of a 130-foot-long LED screen. Unreal Engine was used to render 3D environments throughout production, providing real time feedback and the flexibility to adjust timings and layouts on-site. Without a real time engine in the mix, Cinesite's Salvador Zalvidea said the project would have been a painful and frustrating experience.

Benefits and challengesWhat real-time technology allows is for creatives to experiment with ideas and make decisions early on that would otherwise take weeks to visualise with traditional VFX rendering. On The Bourne Stuntacular project for example, the use of real time for previs meant the team could use a headset to review their work as soon as it was completed in Unreal.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/05/15_The-Bourne-Stuntacular-Technology-726x545.jpg alt= width=416 height=313 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/0
LINK: https://www.tvbeurope.com/production-post/the-impact-real-time-technol...
See more stories from tvb

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

24/08/2026

Dr. Fill from Yurt Rock

Human-played drum fills on demand Sample library developers Yurt Rock have announced the launch of a new plug-in that's dedicated to creating drum fill...

24/08/2026

Black Rooster Audio launch PS-VC1 Vocal Chain Channel

Debut plug-in in new Professional Series Black Rooster Audio's latest plug-in delivers an all-in-one vocal-processing tool, and is the debut release in ...

24/08/2026

Rohde & Schwarz addresses operational efficiency and infrastructure resilience at IBC 2026 in Amsterdam

Rohde & Schwarz addresses operational efficiency and infrastructure resilience a...

24/08/2026

Sky Arts Confirms Double Classical Documentary Showcase Ahead of Edinburgh TV Festival

The Handel Scandal and Dangerous Debussy will both air on Sky Arts this AutumnMo...

24/08/2026

Dalet Accelerates Media Transformation with AI, Automation and Governance at IBC 2026

Dalet, a leading technology and service provider for media-rich organizations, w...

24/08/2026

Arvato Systems becomes a service partner of HANDELSVERBAND.swiss

Arvato Systems Becomes a Service Partner of HANDELSVERBAND.swiss Zurich - Arvato Systems Switzerland has been a service partner of HANDELSVERBAND.swiss since ...

24/08/2026

Documentary on the life and writings of James Connolly to air on RT

We Only Want the Earth: The Life & Ideas of James Connolly airs Wednesday 26 August on RT One and RT Player at 9.35pm RT is to air the compelling documenta...

23/08/2026

Parish Audio introduce Parametric Compressor

Offers up to 10 bands of compression Parish Audio's latest release allows users to place individual compressors anywhere in the frequency range, but tak...

21/08/2026

Rapid Flow release miniGRID

Hardware-style timing shifts for software instruments Following on from the release of Omniclock, Rapid Flow have launched a new sequencer plug-in that can ...

21/08/2026

Love Synthesizers announce First Love pre-orders

Highly anticipated synthesizer ships in October 2026 Iceland-based Love Synthesizers have announced that their highly anticipated synthesizer is now availab...

21/08/2026

The Forsytes' Adds Gregg Sulkin & Gabriel Antunes As PBS Masterpiece Series Starts Filming Season 3

Masterpiece PBS The Forsytes has expanded its cast as its begins production in ...

21/08/2026

BBC reveals haunting first look and further casting for The Witch Farm

The BBC has unveiled first-look pictures from The Witch Farm, a new ghost story and mystery set in the Welsh countryside, coming soon to BBC iPlayer and BBC One...

21/08/2026

A first look at Edward Bluemel as Hercule Poirot.

The BBC and BritBox have revealed the first look of Edward Bluemel as Hercule Poirot in the forthcoming six-part series Hercule from Mammoth Screen and Agatha C...

21/08/2026

Clear-Com Appoints Venuetech as its Main Partner for the Middle East

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

21/08/2026

** MEDIA ALERT ** VIZ Media Takes Over Anime NYC with BLEACH, BLACK TORCH, MAO and More

** MEDIA ALERT ** VIZ Media Takes Over Anime NYC with BLEACH, BLACK TORCH, M...

21/08/2026

Take five with Sophie

Tell us a little bit about your job I'm a Marketing Manager and work across a mix of clients and projects. No two days are ever quite the same, which defini...

21/08/2026

Irish Lottery heist documentary to air on RT

Beat The Lotto dives into the plot behind the 1980s National Lottery scandal 24 August 2026 at 9:35pm on RT One and RT Player Beat The Lotto is the story o...

21/08/2026

The Late Late Toy Show kicks off search for this year's stars

The countdown to the most wonderful night of the year has officially begun! Host Patrick Kielty is gearing up for another unforgettable Late Late Toy Show nig...

21/08/2026

New children's series Bellie and Whizz at Big School set to air on RT KIDSjr & RT Player from Monday, 24th August

Meet puppet duo Bellie and Whizz, who are about to explore all the big feelings ...

20/08/2026

SoundBridges TURN server tutorial

Set up your own private remote collaboration infrastructure SoundBridge have recently put together a tutorial video that provides users with a step-by-step ...

20/08/2026

Neyrinck revive Avid D-Control surfaces

New V-Control Pro features restore basic functionality Neyrinck's V-Control software has long been keeping older Avid control surfaces compatible with n...

20/08/2026

ROSE AYLING-ELLIS BEGINS FILMING SERIES TWO OF ITVS BAFTA-WINNING THRILLER CODE OF SILENCE

TV, BritBox and Mammoth Screen have announced that filming is now underway on th...

20/08/2026

Transformation Church Elevates Production Communications With Riedel Artist and Bolero

Wuppertal August 20, 2026 Transformation Church Elevates Production Communicat...

20/08/2026

The music between the notes

The music between the notes Coming together In the middle of 2026, as conversations around artificial intelligence continue to raise questions about how musi...

20/08/2026

Arvato Systems brings together digital transformation leaders in the manufacturing industry

Arvato Systems Brings Together Digital Transformation Leaders in the Manufacturi...

19/08/2026

MPG launch Save Our Studios survey

Studio owners invited to have their say on rates cuts The Music Producers Guild (MPG) are inviting UK-based studios to take part in an in-depth survey that ...

19/08/2026

Harrison unveil the Flex-10

Vintage-inspired desktop interface revealed Harrison's latest hardware offering sees them head back into the world of audio interfaces, delivering a 10-...

19/08/2026

Minimal Audio release Lucid

Granular effect remains locked to scale and tempo Described as your dream granular effect , Minimal Audio's latest creation is capable of turning any s...

19/08/2026

Audio Modeling open PolySWAM pre-orders

First polyphonic SWAM instrument incoming Audio Modeling's latest physical-modelling orchestral instrument is just around the corner, and is now availab...

19/08/2026

U&alibi re-commissions Bookish for Christmas Special and Series 3

There's an early Christmas gift for Bookish fans, as UKTV confirms the re-commission of the hit U&alibi drama, created by and starring Mark Gatiss. Viewers ...

19/08/2026

Sky gives sports fans the chance to watch multiple live sports events simultaneously on the big screen for the first time

Wednesday 19 August 2026 Sky gives sports fans the chance to watch multiple liv...

19/08/2026

RT TO AIR HISTORIC KATIE TAYLOR FIGHT IN CROKE PARK

On Saturday September 5 Katie Taylor will step into the ring for the fight of her life against Flora Pili in front of 80,000 fans in Croke Park. A legendary fig...

18/08/2026

Panoramic from Panorama Labs

Company launch with stereo-imaging tool Panoramic is the debut release from Panorama Labs, a new company formed by mastering engineer Nicholas Di Lorenzo. C...

18/08/2026

Focusrite extend Control 2 support

Control software now available for older interfaces Focusrite have just announced the launch of an update that extends Control 2 software support for their ...

18/08/2026

Sky Sports and The Fast and the Curious announce new partnership

Tuesday 18 August 2026 Sky Sports and The Fast and the Curious announce new partnership Sky Sports and The Fast and the Curious have announced a new long-term...

18/08/2026

Riedel Brings Professional Live Production Into the Classrooms of ECU

Wuppertal August 18, 2026 Riedel Brings Professional Live Production Into the Classrooms of ECURiedel Communications today announced that Edith Cowan Universi...

18/08/2026

Apple announces changes for apps in the European Union - UPDATE - Posted on 18 August 2026

Apple today announced changes to its business terms for apps in the European Uni...

18/08/2026

RT TO AIR NEW DOCUMENTARY THAT LIFTS THE LID ON THE HEALY RAE DYNASTY

THE HEALY RAES: BLOOD, SWEAT & TEARS AIRS WEDNESDAY AUGUST 19 ON RT ONE AT 9:35PM A new documentary The Healy-Raes: Blood, Sweat & Tears airs on RT One and ...

18/08/2026

Stunning Irish performances at European Athletics and Swimming Championships reach almost 1.7 million viewers

Stunning Irish performances at European Athletics and Swimming Championships rea...

18/08/2026

An Irish Atlantic Rainforest: The Story of a West Cork Rainforest on the edges of the Beara Peninsula

The two-part series begins Sunday 23 August at 6.30pm on RT One and RT Player ...

17/08/2026

SHIK open S32 pre-orders

New MIDI processor & macro controller revealed SHIK have announced that they have opened pre-orders for the S32, a standalone MIDI processor and macro contr...

17/08/2026

Melbourne Instruments introduce 10-year motor warranty

Cover extended on innovative motorised pot system Melbourne Instruments have just revealed that the innovative motorised pot system used in their synths and...

17/08/2026

1010music update the Bluebox

Latest firmware version now available 1010music have just released a free firmware update that brings some nice new features to their renowned Bluebox digit...

17/08/2026

Rohde & Schwarz showcases integrated defense and test solutions at DALO Industry Days 2026

Rohde & Schwarz showcases integrated defense and test solutions at DALO Industry...

17/08/2026

Calrec Integrates ImPulseV with NEP Platform

Calrec's ImPulseV Virtualised Audio Mixing Engine joins NEP Platform, the industry's largest ecosystem of trusted production software, bringing scalable...