Sony Pixel Power calrec Sony

The impact real-time technology is having on VFX

14/05/2021

Martin Izzard, head of media and entertainment at Red Lorry Yellow Lorry takes a look at the rise of virtual production

By Contributor

Published: May 14, 2021

Martin Izzard, head of media and entertainment at Red Lorry Yellow Lorry takes a look at the rise of virtual production

target=_blank title=Share on LinkedIn class=share-linkedin>

The last few weeks have seen both the Real Time Conference and FMX take place; albeit virtually. The first is a technology-focused event that covers a number of different industries (VFX included) and the latter a VFX-specific show with panels and sessions that are increasingly being dominated by talk about the deployment of real-time technology. That is, engine technology that can render digital assets, whether it's environments, characters or animation in . well, real time.

Talk to any VFX studio or supervisor about the biggest cinematic or episodic projects from the last few years and you'll find the use of real time technology. It's also increasingly being deployed for smaller productions and has long been the basis for mixed reality experiences which arguably set the scene for some of the techniques that are now becoming standard in the real time-enabled VFX toolkit.

I spoke to some of the experts within technology vendors, VFX studios and service providers about the impact that real time is having on today's VFX industry. Like any emerging technology, it's in a constant state of change and development, but one thing that real time has quickly become synonymous with is virtual production, or VP.

The rise of virtual productionEver since Jon Favreau and the ILM StageCraft team tackled the latest trip into a galaxy far, far away with a lot of LEDs and cameras that respond to digital environments in real-time, filmmakers everywhere have wanted to use this so-called virtual production on their next project.

But Ben Lumsden from Epic Games, the company behind the Unreal Engine, says that it's important to make a distinction between in-camera visual effects, and other forms of virtual production. Thanks to its background, he says Unreal Engine has been set up to do all sorts of forms of virtual production for about eight years, but it just keeps getting better and better at accommodating film, TV, and animation workflows.

As everyone is now realising, there's much more that VP can offer other than just this particular technique. Pascal Achermann is the CEO & technical director at VRFX Realtime Studio, a Swiss studio which uses the Unity engine to create mixed reality content and deliver virtual production services. According to his definition of VP: any time you are using real-time to support your animation, film or commercial production or storytelling, you are producing virtually.

That means, depending on how you deploy real-time technology, the impact it has and the benefit it provides to your project will differ. Ed Thomas, the head of real-time and virtual production for volumetric video capture studio Dimension, says that VP allows filmmakers to create living, breathing worlds at much earlier stages in development than has previously been possible.

He adds that it means each filmmaking discipline has access to key decision-making moments much earlier in the process and in a more collaborative environment [which] democratises the creation of this content.

This interesting prospect that technology innovation doesn't just benefit the filmmakers but everyone around them shows how widely real time technology can be deployed. This might be a production designer who can test colours on the wall of a set without needing to get out a paint brush, or a lighting gaffer who can see different lighting configurations at the touch of a button. It also means that actors can now better visualise a world or a digital character that they otherwise wouldn't have seen until the premiere.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-726x484.jpg alt= width=413 height=275 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-726x484.jpg 726w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-353x235.jpg 353w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-768x512.jpg 768w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-1536x1024.jpg 1536w, https://www.tvbeurope.com/wp-content/uploads/2021/05/09_The-Bourne-Stuntacular-1-2048x1365.jpg 2048w data-sizes=(max-width: 413px) 100vw, 413px />The Bourne StuntacularIn recent times, VFX studios' worlds have expanded far beyond film and TV screens to include attractions and immersive experiences where real time is really widely used. For example, Cinesite recently won a VES award for its work on The Bourne Stuntacular live show at Universal Studios, Hollywood, which takes place in front of a 130-foot-long LED screen. Unreal Engine was used to render 3D environments throughout production, providing real time feedback and the flexibility to adjust timings and layouts on-site. Without a real time engine in the mix, Cinesite's Salvador Zalvidea said the project would have been a painful and frustrating experience.

Benefits and challengesWhat real-time technology allows is for creatives to experiment with ideas and make decisions early on that would otherwise take weeks to visualise with traditional VFX rendering. On The Bourne Stuntacular project for example, the use of real time for previs meant the team could use a headset to review their work as soon as it was completed in Unreal.

data-src=https://www.tvbeurope.com/wp-content/uploads/2021/05/15_The-Bourne-Stuntacular-Technology-726x545.jpg alt= width=416 height=313 data-srcset=https://www.tvbeurope.com/wp-content/uploads/2021/0
LINK: https://www.tvbeurope.com/production-post/the-impact-real-time-technol...
See more stories from tvb

Europe Stories

09/11/2025

Dalet Unveils Agentic AI Media Workflows at IBC2025

Dalet today announced a transformative leap forward for media operations: Agentic Artificial Intelligence (AI) that unifies the Dalet ecosystem under one natura...

06/10/2025

France Tlvisions Wins Prestigious 2025 EBU Technology & Innovation Award in Groundbreaking Collaboration with Dalet

France T l visions, France's leading broadcaster, has received the 2025 EBU ...

17/09/2025

Dua Lipa's Service95 Book Club' Goes Live at the New York Public Library

It was the ultimate convergence of pop culture and literary prestige: Last night, Dua Lipa brought her Service95 Book Club podcast to the stage for a special li...

17/09/2025

SES and K2 Space to Accelerate Development of Next-Generation MEO Network

Transatlantic collaboration combines experience and agility to drive innovation in network design and delivery Luxembourg, September 16, 2025 - SES, a leading ...

17/09/2025

Portrait Artist of the Year returns to Sky Arts with a dazzling line-up of celebrity sitters on 1 October

Wednesday 17 September 2025 UK artists capture icons of stage and screen, inclu...

17/09/2025

AIR's Big Comeback with DPA Microphones

For the Moon Safari anniversary tour, AIR opened the doors to their backstage. Just a few hours before the Paris concert, DPA met with two key figures of the te...

17/09/2025

The Late Late Toy Show hits the road in search of Ireland's brightest young stars

Auditions will be held in Dublin, Cork and Galway The County Parade returns f...

16/09/2025

Celebramos 10 aos de Viva Latino en Spotify y el xito global de la msica latina

Hace una d cada, la m sica latina representaba apenas el 8% de las reproducciones globales en Spotify. Hoy, constituye m s de una cuarta parte (27%) de toda la ...

16/09/2025

Celebrating 10 Years of Spotify's Viva Latino Playlist and the Global Rise of Latin Music

A decade ago, Latin music made up just 8% of global Spotify streams. Today, it a...

16/09/2025

Spotify Welcomes Graham Norton and Select VICE Studios Content

Spotify is expanding our video lineup with a new partnership with Zoo 55, part of ITV Studios. For the first time, acclaimed content from ITV Studios is landing...

16/09/2025

RTW chooses Calrec as technology partner

Calrec has strengthened its collaboration with audio metering expert RTW by integrating RTW's new TMxCore metering platform across its full range of Argo IP...

16/09/2025

SES Partners with Cailabs to Test Next-Generation Laser Communication Technology

Leading space solutions company will use optical ground stations to deliver faster, more secure data from space Luxembourg, September 15, 2025 - SES, a leading...

16/09/2025

Comscore Unveils The Scoreboard: An Interactive Destination Surfacing Consumer Behaviors and Trends Across Multiple Platforms

Comscore Unveils The Scoreboard: An Interactive Destination Surfacing Consumer B...

15/09/2025

aespa and Spotify Invite Fans to Unlock Their Inner Rich Man' With an Immersive MY VAULT Experience

Global K-Pop sensation aespa is redefining what it means to be rich with the r...

15/09/2025

Spotify's Free Experience Is Even Better-Here's How to Make the Most of It

Every day, millions of people around the world turn to Spotify to enjoy the audi...

15/09/2025

Brembo SGL Carbon Ceramic Brakes (BSCCB) successfully expands production capacity by 50% in Germany and Italy to meet rising demand

After months of intensive planning and implementation, Brembo SGL Carbon Ceramic...

15/09/2025

SES SCORE Surpasses 600,000 of Transmission Hours, Delivering 900 Hours of Major Sports Content Daily

Unique sports content orchestration platform builds momentum among SES's cus...

15/09/2025

New study reveals overwhelming support for a more sustainable future

-- Opens door to growth in renewable energy New Delhi, India - 15th September -- Global business and industry leaders from around the world are joining technol...

13/09/2025

SKY Perfect Modernizes Playout-to-Delivery with Harmonic

Harmonic's Software-Based XOS Advanced Media Processor Provides Unparalleled Efficiency and Unlocks New Business Models SAN JOSE, Calif. - Sept. 13, 2025 -...

12/09/2025

Spotify's The Drop Weekly' Brings You the Week in New Releases, Straight From Our Editors

For fans, we know how important it is to stay plugged into music culture and dis...

12/09/2025

Agama and Consult Red announce RDK Accelerator integration

Link ping, Sweden and Shipley, United Kingdom, September 12, 2025 - Agama, the expert in video observability and analytics for service quality and customer expe...

12/09/2025

Granville opens up one last time for U&GOLD in Open All Hours: Inside Out

Feature-length retrospective from Studio Crook to air in 2026 Sir David Jason returns to the nation's favourite comedy channel, U&GOLD, for Open All Hours:...

12/09/2025

Bob Geldof to receive Lifetime Achievement Award at the Sky Arts Awards 2025

Friday 12 September 2025 The Boomtown Rats, Nyah Grace, Soweto Kinch, Royal Ballet and Madness also announced to perform at the ceremony on Tuesday Sky today ...

12/09/2025

Riedel Unveils Ultra-Light Bolero Mini Wireless Intercom Beltpack

Wuppertal September 12, 2025 Riedel Unveils Ultra-Light Bolero Mini Wireless Intercom BeltpackAt IBC2025 in Amsterdam, Riedel Communications unveiled Bolero M...

12/09/2025

Riedel Communications Acquires hi human interface

Wuppertal September 12, 2025 Riedel Communications Acquires hi human interfaceRiedel Communications today announced the acquisition of hi human interface fro...

12/09/2025

What Is CORE+ Technologyand How Does It Elevate Church Sound?

CORE+ virtually removes distortion, setting a new standard for church sound and giving worship teams the clarity and confidence they need. Read the full artic...

12/09/2025

Margot Robbie, Colin Farrell, Mary Robinson and Conor Murray amongst guests on Late Late Show season opener

The Late Late Show is back with a bang after the summer break, and Patrick Kielt...

12/09/2025

Another jam-packed weekend of live, free-to-air Sport across RT

The World Athletics Championships, Ireland v France in the Women's Rugby World Cup quarter-final, the Irish Champions Festival, and two Sports Direct Men...

12/09/2025

Katie Hannon explores the shelves of Ireland's National Archives in new series

The Records Show starts Sunday at 6.30pm on RT One and RT Player. Katie Hanno...

11/09/2025

RADAR's 1,000-Artist Milestone: Rachel Chinouriri, Zimmer90, and More Celebrate With Spotify in Berlin

RADAR, Spotify's program for emerging talent, recently hit a major milestone...

11/09/2025

Smarter Video Analytics and Easier Operations with Agama 11

Link ping, Sweden, September 11, 2025 - Agama, the expert in video observability & analytics for service quality and customer experience, announced today the la...

11/09/2025

SES Space & Defense Awarded Sustainment Tactical Network Contract to Support U.S. Army

Under the USD 89.6 Million award, SES Space & Defense will provide global commer...

11/09/2025

Telekom Srbija Expands and Extends Partnership with SES

Leading Balkan DTH provider adds capacity to consolidate its m:Sat TV platform at 23.5 degrees East and serve more customers across the region Luxembourg, 11 S...

11/09/2025

UKTV's free streaming service U launches on Sky Q in the UK

UKTV's free streaming service U launches on Sky Q Free streaming service U has launched on Sky Q in the UK, UKTV and Sky confirm today, expanding the footp...

11/09/2025

Capturing Music in the Chaos of a Train Station

From the discreet 2061 lavaliers to 4099 and 4011 mics, the setup delivered clean, natural sound in one of the most challenging broadcast environments. Read th...

11/09/2025

Tiny but Mighty: A Review of the DPA 2061 Lavalier Mic

From rugged build quality to natural, detailed sound, the verdict is clear: big performance can come in a very small package. Read the full review here!...

11/09/2025

Tonight on Prime Time: Family of Liam Farrell seeking answers six years after his death

Tonight on Prime Time RT One and RT Player at 9:35pm Tonight RT Prime Time...

11/09/2025

RT Statement: 2026 Eurovision Song Contest

RT Statement: 2026 Eurovision Song Contest At the General Assembly of the European Broadcasting Union (EBU) in July, a number of EBU members raised concerns ...

10/09/2025

Lossless Listening Arrives on Spotify Premium With a Richer, More Detailed Listening Experience

Lossless on Spotify Premium is here. Lossless audio has been one of the most a...

10/09/2025

The Television Will Be Revolutionised

The Television Will Be Revolutionised Sep 10, 2025 Written by Sunit Kotecha, Director of Delivery and Operations, YouView 2025 marks a century since the f...

10/09/2025

First of Spains F110 frigates get future-ready with Rohde & Schwarz communications systems

First of Spains F110 frigates get future-ready with Rohde & Schwarz communicatio...

10/09/2025

Midco Taps Harmonic to Fuel Next-Generation Broadband Services

Harmonic's cOS Platform Supports DOCSIS and Fiber, Enabling Midco to Deliver Reliable Multi-Gigabit Connectivity to Subscribers SAN JOSE, Calif. - Sept. 10,...

10/09/2025

Join RT at The Ploughing 2025

RT brings three days of live radio, live entertainment, live news, live weather, personal appearances, and more Join RT Radio 1: Morning Ireland, The Oliver ...

09/09/2025

RADAR's Global Impact: 1,000 Artists, Billions of Streams, and a World of Discovery

Since 2020, Spotify's RADAR program has been a launchpad for emerging talent...

09/09/2025

5 Years and 1,000 Artists Later: How Spotify RADAR Supports Emerging Talent on the Path to Global Stardom

In 2020, Spotify launched RADAR with a clear mission: to identify, nurture, and ...

09/09/2025

Spotify and TikTok Launch Big on BookTok' Pilot Hub for Audiobook Fans

If you're on BookTok, you know the drill. You scroll, you tap, and suddenly your To Be Read list is overflowing with trending must-reads. Not unlike Spoti...

09/09/2025

TED2025 Relies on Clear-Com and NETGEAR to Power Production Communications

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

09/09/2025

OSN Unlocks New Era of Targeted Video Streaming Monetization with Harmonic

Harmonic's VOS360 Ad SaaS Enables Personalized Ad Delivery and Seamless Integration with the Ad Tech Ecosystem SAN JOSE, Calif. - Sept. 9, 2025 - Harmonic ...

09/09/2025

Clear Sound for Worship and Livestreams at St. Luke's

St. Luke's Episcopal Church in New Jersey needed audio that truly connects and they found the answer. Read the full case study here!...