Sony Pixel Power calrec Sony

Opinion: The state of virtual production

11/07/2024

Tim Moore, CEO at Vu Technologies, discusses emerging trends in the virtual production market

By Contributor

Published: July 8, 2024 Updated: July 11, 2024

Tim Moore, CEO at Vu Technologies, discusses emerging trends in the virtual production market

target=_blank title=Share on LinkedIn class=share-linkedin> Tim Moore, CEO at Vu Technologies, discusses emerging trends in the virtual production market

https://www.tvbeurope.com/features/opinion-the-state-of-virtual-production title=Share via Email class=share-email>

In the wake of back-to-back labour strikes last year, the media and entertainment industry experienced a decline of historic proportions, with a 52 per cent decrease in production spending compared to the previous year and so much collateral damage that the effects have yet to be fully tallied. However in 2024, virtual production earnings have bounced back, with 35 per cent growth in the corporate and education sector.

But the market is forecasted to be a tale of two cities. As the volatile media and entertainment market continues to stifle investment in the industry, a rising number of corporate and higher education virtual studios will take virtual production technologies to new audiences with different use cases. With compounding disruption and volatile labour markets, radical transformation is quickly approaching.

The continued pace of innovation in the production industry has been relentlessly accelerating with advancements in computer graphics, and new creative workflows that are coming out so quickly it is outpacing the market's ability to commercialise them into viable solutions. With another looming strike on the horizon for M&E, and innovations in generative AI continuing to redefine how content is created, this year is expected to be one of the most transformative years in the industry since the shift to digital in the early 2000s.

We have reached the tipping point of advanced computer graphics We are at a unique moment in time where new innovations in real-time computer graphics and paradigm shifts in AI-powered workflows are allowing creators to make content at super-human speeds. For years, the human brain was the greatest processor in the world, but now there is a new species of AI in town and it's reaching human-like capabilities in almost every category of communication, including visual communication. Computer-generated visuals are so advanced that the human brain can no longer distinguish what's real or not. We have officially reached the tipping point. With new advanced technologies like generative AI and real-time virtual production, photo-realistic imaging is not just a creative aspiration, it's a widely accessible reality.

The AI crash is coming The Gen AI crash is coming, but not every AI company will feel it. Hype cycles are nothing new in the market. They often start when new transformative technologies emerge with a promise to change the world, then speculative investment capital propels the technologies into orbit before they are ready for mass commercialisation, leading to spectacular crashes that decimate large parts of the industry.

In the recent virtual production hype cycle of 2022, there was a bit of a different effect that happened. Fuelled by a huge surge in demand during the pandemic, the virtual production market experienced accelerated growth in 2021-2022, but the forces of gravity set in and eventually brought it right back down the following year. However, unlike some of the other technologies that thrived during the pandemic, virtual production has taken another accelerated upswing this year, suggesting a trajectory we are used to seeing on the long tail of a hype cycle. With virtual production in accelerated growth mode and generative AI now approaching the hype cycle peak, it will be an interesting year to see how the cascade of hype cycles all level out.

Instant is the new norm. A new real-time creative workflow In the past 12 months, new virtual production tools have been introduced to the market on a seemingly monthly basis. New 3D scanning solutions with technologies like NeRFs and Gaussian Splatting are allowing anyone to upload a basic video scan of a location from their phone into applications like Volinga and Luma.ai to create 3D virtual environments in minutes versus weeks. Markerless tracking solutions like Move.ai and Theia3D are replacing bulky, complex body suits with standard consumer cameras to create quick 3D character animations. Generative AI tools like Cuebric and Vu.ai are allowing for real-time virtual background creation for instant on set adjustments. A growing number of studios are migrating to hybrid 3D workflows like 2.5D and 3D depth maps for faster scene creation where full 3D isn't necessary.

Of all these advancements, generative AI for 2D plates seems to be the most adopted workflow as it is the simplest workflow for newcomers to the field to understand, and is often much quicker to create than full 3D environments. Let's not forget about Runway, Sora and Pika Labs all in a race for creating the studio completely in the cloud. And now Google has entered the race with Google VEO, an update to the original Imagine they announced in 2021. These fully synthetic AI text-to video generators will dramatically change the creative workflow as studios are able to instantly generate 2D video plates as virtual backgrounds and in many cases use generated video directly in their edits without ever going to a studio. And all of this technology progress is making virtual production faster, easier and allowing artists to create content at the speed of thought.

Virtual production 2.0: from science experiment to industry standard In the same way that Smart TVs made our lives easier by integrating the media player, internet and stereo system all together, virtual production stud
LINK: https://www.tvbeurope.com/features/opinion-the-state-of-virtual-produc...
See more stories from tvb

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

27/03/2026

GatesAir Expands AirWatch365 Managed Service

Share Copy link Facebook X Linkedin Bluesky Email...

27/03/2026

Dejero, Eutelsat, Others to Offer 'Field to Air' Demo at NAB Show

Share Copy link Facebook X Linkedin Bluesky Email...

27/03/2026

Global NextGen TV Takes Center Stage at 2026 NAB Show

Share Copy link Facebook X Linkedin Bluesky Email...

27/03/2026

USSI Global Opens Media Transport Solutions Lab

Share Copy link Facebook X Linkedin Bluesky Email...

27/03/2026

Net Insight Elevates Nimbra Edge to Govern Live Media Sys...

At NAB Show 2026, Net Insight will showcase the next evolution of Nimbra Edge, its orchestration and control layer designed to manage live media services across...

27/03/2026

Harmonic Delivers Winning Live Sports Streaming Innovatio...

Harmonic (NASDAQ: HLIT) today announced powerful new innovations that further elevate the company's sports streaming solution. The advanced capabilities enh...

27/03/2026

Bitmovin s Player Web X Expands with Performance First Ad...

Bitmovin, the leading provider of video streaming solutions, today announced significant new capabilities for Player Web X, its next-generation web video player...

27/03/2026

CS live Builds Future Ready OB Van With Riedel MediorNet...

Riedel Communications today announced that Czech-based production company CS live has equipped its newest outside broadcast (OB) van with an integrated Riedel i...

27/03/2026

MPTS 2026 Unveils First Wave of Speakers Featuring BBC Sk...

130 Industry Experts Confirmed as Show Celebrates its 10th Anniversary MPTS, the UK's largest and most influential event for the media, production and tech...

27/03/2026

Grass Valley and NVP Elevate LALIGA Broadcast Production...

Grass Valley today announced the successful completion of a major live production deployment with NVP, a leading European media company specializing in live spo...

27/03/2026

Appear Business Momentum Drives Leadership in Live Produc...

Showcases resilient solutions for satellite-to-IP migration, REMI and hybrid live production Appear ASA (Appear, OSE:APR), a global leader in live production t...

27/03/2026

Lightware MX2 delivers rock-solid 4K60 HDMI 10-bit signal...

San Francisco, California, March 2026 - Microsoft Ignite, a major annual conference hosted by Microsoft for developers, IT professionals, partners and business ...

27/03/2026

Clear-Coms EQUIP Wireless System Keeps Youth With A Missi...

Clear-Com is proud to highlight its support for worship teams through professional communication solutions, with the deployment of its EQUIP wireless system a...

27/03/2026

Orban Collaborates with Sage on Virtualized EAS Technology Demo

Orban Collaborates with Sage on Virtualized EAS Technology Demo Brie Clayton March 26, 2026 0 Comments Sage Alerting Systems (SAS), in cooperation wit...

27/03/2026

Berklee Alums Bring GIANT to Broadway

Berklee Alums Bring GIANT to Broadway Brian and Dayna Lee BM '13 met and fell in love at Berklee, and now their production companys first Broadway debut i...

26/03/2026

Audio-Technica and Extron Announce Microsoft Teams-Certified Enterprise Solutions

Extron and Audio-Technica have announced that their Design Solutions devices, Ce...

26/03/2026

SPORTEL Asia Returns to Singapore with 370 Participants from 35 Countries

SPORTEL Asia took place March 24-25 at the Orchard Hotel Singapore, drawing 370 participants representing more than 220 companies from 35 countries. Approximate...

26/03/2026

NAB 2026: LTN to Showcase Satellite-to-IP Migration Solutions

LTN will demonstrate satellite-to-IP migration solutions for broadcasters, cable networks, MVPDs, and station groups at NAB Show 2026 (Booth W2100). The C-Ban...

26/03/2026

Seattle Mariners Upgrade Center Field Video Display at T-Mobile Park with Daktronics

The Seattle Mariners have partnered with Daktronics to install an upgraded outfi...

26/03/2026

Esports Nations Cup 2026 Names National Team Partners Across 100+ Countries

The Esports Foundation (EF) has awarded National Team Partner status to organizations and individuals across more than 100 countries and territories for the Esp...

26/03/2026

NAB 2026: Telestream Expands Vantage Integration with Adobe Premiere, Media Encoder, and Frame.io

Telestream has announced expanded integration between its Vantage workflow platf...

26/03/2026

NAB 2026: FOR-A Brings Nippon TV's viztrick AiDi AI Production Tool to Market with NVIDIA

FOR-A Corporation has announced a partnership with Nippon TV and NVIDIA to distr...

26/03/2026

CBS Sports Reaches New Long-Term Multiplatform Rights Agreement with the WNBA

CBS Sports and the WNBA have expanded their partnership through a new long-term, multiplatform rights agreement. CBS Sports will feature up to 20 regular-season...

26/03/2026

Zac Brown Band to Perform Sunday Night Baseball Open on NBC and Peacock

Zac Brown Band will star in the Sunday Night Baseball show open on NBC and Peacock, NBC Sports announced. The open was filmed at American Family Field, home of ...

26/03/2026

2026 MLB Season Opens With Full Slate of National Games

Major League Baseball opens the 2026 season with nationally televised games across multiple media partners. Fans can visit MLB.com/Watch for a complete schedule...

26/03/2026

DIRECTV Adds Nine MLB Team Channels for 2026 Season

DIRECTV has announced an agreement to carry nine new MLB-operated team channels, covering the Cincinnati Reds, Detroit Tigers (Detroit SportsNet), Kansas City R...

26/03/2026

Nationals.TV Now Available on Charter, Comcast, Cox, DIRECTV, Verizon Fios and More

Nationals.TV, the Washington Nationals' local broadcast channel, is now avai...

26/03/2026

MLB.TV Launches on the ESPN App Starting Opening Day

Starting Thursday, March 26, MLB.TV will be available on the ESPN App, giving fans access to more than 2,000 out-of-market regular season games. Fans can also r...

26/03/2026

What's Next for Spotify and NAVER in Korea After a Stockholm Summit

Spotify's partnership with NAVER, Korea's leading digital platform, is built around one simple goal: making it easier for listeners in Korea to discover...

26/03/2026

EastWest DrumX: Early access

Exclusive to ComposerCloud for first month Sample library and virtual instrument gurus EastWest have announced the upcoming release of a new virtual drum i...

26/03/2026

Dynamic Range Day 2026

Friday 27 March Friday 27 March will mark Dynamic Range Day 2026, the annual day of online activity that was started in 2010 by mastering engineer Ian Sheph...

26/03/2026

ASMR Choir from SRM Sounds

Includes four separate instruments Max Richter's SRM Sounds venture have just announced their fifth release, ASMR Choir. Captured at the main live room ...

26/03/2026

IMPORTANT FEEDBACK: PESP 6

The National Film and Video Foundation (NFVF), an agency of the Department of Sport, Arts and Culture (DSAC), has been tasked with administering the Sixth Presi...

26/03/2026

Why YEP Changed My Career (And Why It Might Change Yours)

By Matt Klein Hello to everyone reading this - whether you're a current YEP, HPA member, or just YEP-curious. I'm Matt Klein, one of the co-chairs of t...

26/03/2026

CBS Sports Inks New WNBA Deal

Share Copy link Facebook X Linkedin Bluesky Email...

26/03/2026

Apogee Insight Acquires PMA Research

Share Copy link Facebook X Linkedin Bluesky Email...

26/03/2026

NBC Announces Exclusive Coverage of Sail4th 250 Tall Ships in NYC

Share Copy link Facebook X Linkedin Bluesky Email...

26/03/2026

UK Group of media tech companies take the spotlight at NA...

28 participating companies, from start-ups to blue-chips, lead the UK Group as part of the GREAT Britain and Northern Ireland presence across all the Halls at N...

26/03/2026

Arkona Unveils BLADE//planner and Major Usability Enhancements at NAB 2026

Arkona Unveils BLADE//planner and Major Usability Enhancements at NAB 2026 Brie Clayton March 26, 2026 0 Comments New graphical configuration tool and...

26/03/2026

Bitfocus showcases complete control at NAB Show 2026

Bitfocus showcases complete control at NAB Show 2026 Brie Clayton March 26, 2026 0 Comments Continuing development drives advances in security, availa...

26/03/2026

Allen Media Group To Deploy Anoki ContextIQ

Share Copy link Facebook X Linkedin Bluesky Email...

26/03/2026

LG Announces New Premium FAST Channels

Share Copy link Facebook X Linkedin Bluesky Email...

26/03/2026

IABM to Host Breakfast Event at 2026 NAB Show

Share Copy link Facebook X Linkedin Bluesky Email...

26/03/2026

Nexstar Defends Tegna Deal in Calif. Court Filing

Share Copy link Facebook X Linkedin Bluesky Email...

26/03/2026

Nevion introduces powerful new Panel Builder to enhance VideoIPath broadcast control capability

Nevion introduces powerful new Panel Builder to enhance VideoIPath broadcast con...