Sony Pixel Power calrec Sony

Opinion: The state of virtual production

11/07/2024

Tim Moore, CEO at Vu Technologies, discusses emerging trends in the virtual production market

By Contributor

Published: July 8, 2024 Updated: July 11, 2024

Tim Moore, CEO at Vu Technologies, discusses emerging trends in the virtual production market

target=_blank title=Share on LinkedIn class=share-linkedin> Tim Moore, CEO at Vu Technologies, discusses emerging trends in the virtual production market

https://www.tvbeurope.com/features/opinion-the-state-of-virtual-production title=Share via Email class=share-email>

In the wake of back-to-back labour strikes last year, the media and entertainment industry experienced a decline of historic proportions, with a 52 per cent decrease in production spending compared to the previous year and so much collateral damage that the effects have yet to be fully tallied. However in 2024, virtual production earnings have bounced back, with 35 per cent growth in the corporate and education sector.

But the market is forecasted to be a tale of two cities. As the volatile media and entertainment market continues to stifle investment in the industry, a rising number of corporate and higher education virtual studios will take virtual production technologies to new audiences with different use cases. With compounding disruption and volatile labour markets, radical transformation is quickly approaching.

The continued pace of innovation in the production industry has been relentlessly accelerating with advancements in computer graphics, and new creative workflows that are coming out so quickly it is outpacing the market's ability to commercialise them into viable solutions. With another looming strike on the horizon for M&E, and innovations in generative AI continuing to redefine how content is created, this year is expected to be one of the most transformative years in the industry since the shift to digital in the early 2000s.

We have reached the tipping point of advanced computer graphics We are at a unique moment in time where new innovations in real-time computer graphics and paradigm shifts in AI-powered workflows are allowing creators to make content at super-human speeds. For years, the human brain was the greatest processor in the world, but now there is a new species of AI in town and it's reaching human-like capabilities in almost every category of communication, including visual communication. Computer-generated visuals are so advanced that the human brain can no longer distinguish what's real or not. We have officially reached the tipping point. With new advanced technologies like generative AI and real-time virtual production, photo-realistic imaging is not just a creative aspiration, it's a widely accessible reality.

The AI crash is coming The Gen AI crash is coming, but not every AI company will feel it. Hype cycles are nothing new in the market. They often start when new transformative technologies emerge with a promise to change the world, then speculative investment capital propels the technologies into orbit before they are ready for mass commercialisation, leading to spectacular crashes that decimate large parts of the industry.

In the recent virtual production hype cycle of 2022, there was a bit of a different effect that happened. Fuelled by a huge surge in demand during the pandemic, the virtual production market experienced accelerated growth in 2021-2022, but the forces of gravity set in and eventually brought it right back down the following year. However, unlike some of the other technologies that thrived during the pandemic, virtual production has taken another accelerated upswing this year, suggesting a trajectory we are used to seeing on the long tail of a hype cycle. With virtual production in accelerated growth mode and generative AI now approaching the hype cycle peak, it will be an interesting year to see how the cascade of hype cycles all level out.

Instant is the new norm. A new real-time creative workflow In the past 12 months, new virtual production tools have been introduced to the market on a seemingly monthly basis. New 3D scanning solutions with technologies like NeRFs and Gaussian Splatting are allowing anyone to upload a basic video scan of a location from their phone into applications like Volinga and Luma.ai to create 3D virtual environments in minutes versus weeks. Markerless tracking solutions like Move.ai and Theia3D are replacing bulky, complex body suits with standard consumer cameras to create quick 3D character animations. Generative AI tools like Cuebric and Vu.ai are allowing for real-time virtual background creation for instant on set adjustments. A growing number of studios are migrating to hybrid 3D workflows like 2.5D and 3D depth maps for faster scene creation where full 3D isn't necessary.

Of all these advancements, generative AI for 2D plates seems to be the most adopted workflow as it is the simplest workflow for newcomers to the field to understand, and is often much quicker to create than full 3D environments. Let's not forget about Runway, Sora and Pika Labs all in a race for creating the studio completely in the cloud. And now Google has entered the race with Google VEO, an update to the original Imagine they announced in 2021. These fully synthetic AI text-to video generators will dramatically change the creative workflow as studios are able to instantly generate 2D video plates as virtual backgrounds and in many cases use generated video directly in their edits without ever going to a studio. And all of this technology progress is making virtual production faster, easier and allowing artists to create content at the speed of thought.

Virtual production 2.0: from science experiment to industry standard In the same way that Smart TVs made our lives easier by integrating the media player, internet and stereo system all together, virtual production stud
LINK: https://www.tvbeurope.com/features/opinion-the-state-of-virtual-produc...
See more stories from tvb

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

13/04/2026

ToolsOnAir Composition Builder 2026 Boilerplate

ToolsOnAir Composition Builder 2026 Boilerplate More Details: The Composition Builder 2026 application for macOS enables TV stations and Live Event broadcast...

13/04/2026

ToolsOnAr just:live pro 2026 Boilerplate

ToolsOnAr just:live pro 2026 Boilerplate More Details: just:live pro 2026 is a Multi-Channel Live Production Playout solution for video and static or real-ti...

13/04/2026

ToolsOnAr just:play pro 2026 Boilerplate

ToolsOnAr just:play pro 2026 Boilerplate More Details: just:play pro 2026 is a Multi-Channel automated 24/7 Master Control playout solution with SD, HD and U...

13/04/2026

ToolsOnAr live:cut 2026 Boilerplate

ToolsOnAr live:cut 2026 Boilerplate More Details: live:cut is an option to just:in mac pro 2025 and enables multicamera production workflows for up to 16 cam...

13/04/2026

ToolsOnAir Just In Mac Lite NDI 2026 Boilerplate

ToolsOnAir Just In Mac Lite NDI 2026 Boilerplate More Details: The Just In Mac Lite NDI application is a streamlined media capture solution designed specific...

13/04/2026

ToolsOnAir Just In Mac Lite 2026 Boilerplate

ToolsOnAir Just In Mac Lite 2026 Boilerplate More Details: The Just In Mac Lite application is a streamlined media capture solution designed specifically for...

13/04/2026

ToolsOnAir just:in mac pro 2026 Boilerplate

ToolsOnAir just:in mac pro 2026 Boilerplate More Details: just:in mac pro is a macOS-based client-server multichannel capture solution to record SDI, HDMI, N...

13/04/2026

Jnger Audio Joins EBU ADM Implementers Group as Founding Member

Telos Alliance has announced that J nger Audio has joined the EBU ADM Implementers Group (ADM-IG) as a founding member. The group is focused on advancing ADM an...

13/04/2026

NAB 2026: Grass Valley to Showcase Alliance Partner Ecosystem

Grass Valley will demonstrate its Alliance Partner ecosystem at NAB Show 2026 (Booth C2408, Central Hall, April 19-22), showing AMPP integrations across live pr...

13/04/2026

NAB 2026: Media Links to Demonstrate IP Transport Solutions

Media Links will exhibit at NAB Show 2026 (Booth W2033), demonstrating IP transport solutions for live production including hitless protection technology, Xscen...

13/04/2026

NBC Sports Partners with Overtime for OT7 Football League and Navy All-American Bowl

NBC Sports has announced a programming, distribution, and sales partnership with...

13/04/2026

FloSports Promotes Jayar Donlan from COO to President

FloSports has promoted Chief Operating Officer Jayar Donlan to President, effective immediately. In his new role, Donlan will lead the company's commercial,...

13/04/2026

MASV Case Study: PanCam Pictures Uses MASV for Remote Post-Production at Senior Bowl 2026

PanCam Pictures, the documentary production company founded by Paul Camarata, us...

13/04/2026

NAB 2026: Mimir to Showcase Cloud Production Platform

Mimir will exhibit at NAB Show 2026 (North Hall, Booth N2850), demonstrating its cloud-native media production platform with new capabilities including Mimir Cu...

13/04/2026

NAB 2026: BBright Adds RIST Protocol Support to IP Gateway

BBright has announced that its IP Gateway now supports the Reliable Internet Stream Transport (RIST) protocol. The addition will be introduced at NAB Show 2026 ...

13/04/2026

Net Insight Awarded ESA NAVISP Development Project for PNT Technology

Net Insight has been awarded a development project through the European Space Agency's Navigation Innovation and Support Program (NAVISP), with co-funding f...

13/04/2026

NAB 2026: intoPIX to Showcase JPEG XS, IPMX, and SMPTE 2110 Solutions

intoPIX will exhibit at NAB Show 2026, marking the company's 20th anniversary. The company will demonstrate its JPEG XS compression portfolio and IPMX-appro...

13/04/2026

Inside the Launch of BravesVision: How Braves, Raycom Sports Pulled Off One of the Most Ambitious Efforts in Regional-Sports-Media History

Starting from scratch, the team built an in-house content platform comprising ga...

13/04/2026

NAB 2026: AI Will Make Its Presence Felt in Audio Offerings, Presentations

Here's a look at some of the new products and updates, along with audio-centric conferences, that attendees will find next week at the show When the 2026 N...

13/04/2026

NAB 2026: Avid to Demonstrate Integrated Newsroom Capabilities

Avid will launch new integrated newsroom capabilities for Avid for News at NAB Show 2026 (Booth N2226, April 18-22), demonstrating how Avid Content Core connect...

13/04/2026

NAB 2026: Synamedia Launches Cloud-Controlled Edge Playout Version of Quortex PowerVu

Synamedia has announced a new version of Quortex PowerVu, an IP-native, software...

13/04/2026

NAB 2026: Mediaproxy Adds AI Brand and Advertisement Tracking to LogServer

Mediaproxy has developed a suite of AI-powered tools for brand and advertisement tracking, integrated into its LogServer compliance logging and analysis platfor...

13/04/2026

NAB 2026: Disguise to Demonstrate Media Server and Software Integrations

Disguise will demonstrate its media servers and software at NAB Show 2026, appearing across five partner booths in Central Hall: MRMC, B&H, Planar, CarbonBlack,...

13/04/2026

NAB 2026: OpenDrives Introduces Edge Hybrid Cloud-Edge Performance Accelerator

OpenDrives is introducing OpenDrives Edge at NAB Show 2026, a hybrid cloud-edge performance accelerator for distributed video and rich media workflows. The prod...

13/04/2026

ESPN Returns to The Shed for 2026 WNBA Draft, Expanding Camera Arsenal and Deepening Fan Coverage

The show will deploy 18 cameras across two sets and the draft floor, including a...

13/04/2026

Musik Hack update SweetEQ

Intuitive EQ plug-in gets an upgrade Following its official launch back in February 2026, Musik Hack's intuitive EQ plug-in has been treated to its firs...

13/04/2026

Vintage Vault 5 from UVI

Flagship soft synth collection expanded The latest version of UVI's flagship vintage-inspired soft synth collection has just arrived, expanding the suit...

13/04/2026

Sonuscore launch Lux Orchestral Strings Elements

Free version of innovative string library arrives Released in October 2025, Lux Orchestral Strings was said to be Sonuscore's most ambitious library to ...

13/04/2026

Girls' Research Camp at SGL Carbon in Meitingen inspires young women to pursue STEM careers

The Girls' Research Camp is part of the Technology - Future in Bavaria edu...

13/04/2026

Rohde & Schwarz transforms submarine communications for realtime underwater dominance at UDT 2026

Rohde & Schwarz transforms submarine communications for real time underwater dom...

13/04/2026

Rohde & Schwarz enables Pulsar signal simulation to support next-generation navigation devices

Rohde & Schwarz enables Pulsar signal simulation to support next-generation navi...

13/04/2026

When Missiles Move at 5X the Speed of Sound, Timing Is Everything

L3Harris is accelerating the development of infrared payloads for Space Development Agency's Tranche 2 Tracking Layer, to help meet urgent national defense ...

13/04/2026

US Army Selects L3Harris for Next-Generation Night-Vision System

By leveraging cutting-edge unfilmed Gen III image intensifier technology, NOVA delivers unmatched clarity, range, and reliability in low-light environments - en...

13/04/2026

Harvey Arnold Represents the Best of Broadcast Engineering

Share Copy link Facebook X Linkedin Bluesky Email...

13/04/2026

Ross Video and HighField AI to Deliver AI-Assisted Graphics Creation

Share Copy link Facebook X Linkedin Bluesky Email...

13/04/2026

Disguise to Showcase Cutting-Edge Experience Tech for Bro...

Explore new Disguise plugins, including Sony's VP integration; Listen to panels across partner booths at Sony and B&H Disguise, the company powering everyt...

13/04/2026

TAG Video Systems Joins MXL Interoperability Initiative t...

TAG Video Systems, the leading IP-native Realtime Media Platform, has announced its participation in the Media Exchange Layer (MXL) interop initiative. TAG has ...

13/04/2026

Chaos Launches Free V-Ray for Blender Community Edition a...

Today, Chaos launched V-Ray for Blender Community Edition at BCON Austin 2026, making its production-proven 3D renderer free for all Blender users. The same Aca...

13/04/2026

LTN Appoints Mark Romano as Vice President Multichannel P...

Additions strengthen LTN's leadership as broadcasters scale satellite-to-IP transition LTN today announced the appointments of Mark Romano as Vice Presiden...

13/04/2026

NUGEN Audio Updates Halo Vision With New Precision Analys...

LEEDS, UK, APRIL 13, 2026 NUGEN Audio releases Halo Vision v1.2, a significant update to its real time, customizable audio analysis suite for 3D, surround and...

13/04/2026

Atomos to Acquire Flanders Scientific

Atomos today announced the acquisition of Flanders Scientific (FSI), one of the most respected names in professional reference monitoring. This strategic move r...

13/04/2026

How Mei Semones Built Her Sound from J-Pop, Jazz, and Bilingual Songwriting

How Mei Semones Built Her Sound from J-Pop, Jazz, and Bilingual Songwriting The indie-pop artist combines agile guitar lines, rhythmic shifts, and lyrics that...

13/04/2026

Cue the Change: Jonathon Heyward Is Making Classical Music More Relatable

Cue the Change: Jonathon Heyward Is Making Classical Music More Relatable Nicknamed the Converse Conductor, the Boston Conservatory alum holds top conductin...

13/04/2026

Heat Wave: Inside Miamis Sizzling, Boundary-Blurring Latin Music Scene

Heat Wave: Inside Miamis Sizzling, Boundary-Blurring Latin Music Scene In a city shaped by migration and exchange, Berklee alumni are helping drive a Latin mu...