Sony Pixel Power calrec Sony

Opinion: The state of virtual production

11/07/2024

Tim Moore, CEO at Vu Technologies, discusses emerging trends in the virtual production market

By Contributor

Published: July 8, 2024 Updated: July 11, 2024

Tim Moore, CEO at Vu Technologies, discusses emerging trends in the virtual production market

target=_blank title=Share on LinkedIn class=share-linkedin> Tim Moore, CEO at Vu Technologies, discusses emerging trends in the virtual production market

https://www.tvbeurope.com/features/opinion-the-state-of-virtual-production title=Share via Email class=share-email>

In the wake of back-to-back labour strikes last year, the media and entertainment industry experienced a decline of historic proportions, with a 52 per cent decrease in production spending compared to the previous year and so much collateral damage that the effects have yet to be fully tallied. However in 2024, virtual production earnings have bounced back, with 35 per cent growth in the corporate and education sector.

But the market is forecasted to be a tale of two cities. As the volatile media and entertainment market continues to stifle investment in the industry, a rising number of corporate and higher education virtual studios will take virtual production technologies to new audiences with different use cases. With compounding disruption and volatile labour markets, radical transformation is quickly approaching.

The continued pace of innovation in the production industry has been relentlessly accelerating with advancements in computer graphics, and new creative workflows that are coming out so quickly it is outpacing the market's ability to commercialise them into viable solutions. With another looming strike on the horizon for M&E, and innovations in generative AI continuing to redefine how content is created, this year is expected to be one of the most transformative years in the industry since the shift to digital in the early 2000s.

We have reached the tipping point of advanced computer graphics We are at a unique moment in time where new innovations in real-time computer graphics and paradigm shifts in AI-powered workflows are allowing creators to make content at super-human speeds. For years, the human brain was the greatest processor in the world, but now there is a new species of AI in town and it's reaching human-like capabilities in almost every category of communication, including visual communication. Computer-generated visuals are so advanced that the human brain can no longer distinguish what's real or not. We have officially reached the tipping point. With new advanced technologies like generative AI and real-time virtual production, photo-realistic imaging is not just a creative aspiration, it's a widely accessible reality.

The AI crash is coming The Gen AI crash is coming, but not every AI company will feel it. Hype cycles are nothing new in the market. They often start when new transformative technologies emerge with a promise to change the world, then speculative investment capital propels the technologies into orbit before they are ready for mass commercialisation, leading to spectacular crashes that decimate large parts of the industry.

In the recent virtual production hype cycle of 2022, there was a bit of a different effect that happened. Fuelled by a huge surge in demand during the pandemic, the virtual production market experienced accelerated growth in 2021-2022, but the forces of gravity set in and eventually brought it right back down the following year. However, unlike some of the other technologies that thrived during the pandemic, virtual production has taken another accelerated upswing this year, suggesting a trajectory we are used to seeing on the long tail of a hype cycle. With virtual production in accelerated growth mode and generative AI now approaching the hype cycle peak, it will be an interesting year to see how the cascade of hype cycles all level out.

Instant is the new norm. A new real-time creative workflow In the past 12 months, new virtual production tools have been introduced to the market on a seemingly monthly basis. New 3D scanning solutions with technologies like NeRFs and Gaussian Splatting are allowing anyone to upload a basic video scan of a location from their phone into applications like Volinga and Luma.ai to create 3D virtual environments in minutes versus weeks. Markerless tracking solutions like Move.ai and Theia3D are replacing bulky, complex body suits with standard consumer cameras to create quick 3D character animations. Generative AI tools like Cuebric and Vu.ai are allowing for real-time virtual background creation for instant on set adjustments. A growing number of studios are migrating to hybrid 3D workflows like 2.5D and 3D depth maps for faster scene creation where full 3D isn't necessary.

Of all these advancements, generative AI for 2D plates seems to be the most adopted workflow as it is the simplest workflow for newcomers to the field to understand, and is often much quicker to create than full 3D environments. Let's not forget about Runway, Sora and Pika Labs all in a race for creating the studio completely in the cloud. And now Google has entered the race with Google VEO, an update to the original Imagine they announced in 2021. These fully synthetic AI text-to video generators will dramatically change the creative workflow as studios are able to instantly generate 2D video plates as virtual backgrounds and in many cases use generated video directly in their edits without ever going to a studio. And all of this technology progress is making virtual production faster, easier and allowing artists to create content at the speed of thought.

Virtual production 2.0: from science experiment to industry standard In the same way that Smart TVs made our lives easier by integrating the media player, internet and stereo system all together, virtual production stud
LINK: https://www.tvbeurope.com/features/opinion-the-state-of-virtual-produc...
See more stories from tvb

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

17/11/2026

Fabric Insights and Fonn Group Partner to Connect Newsroom Planning and Media Operations

Fabric Insights and Fonn Group have announced a partnership to connect editorial...

17/11/2026

NABJ Online Seminar Highlights Black Sports Production Legends on Nov. 25

The National Association of Black Journalists is offering up a Thanksgiving Eve treat on Wednesday, Nov. 25, in the form of a live streaming event featuring for...

17/11/2026

Bridge Technologies Adds Apple ProRes Support to VB440 Production Probe

Bridge Technologies has announced that its VB440 production probe now supports both monitoring and signal generation for Apple ProRes video streams. The additio...

17/11/2026

Canon U.S.A. Hosts Jericho High School Journalism Students at Melville Headquarters

Canon U.S.A., Inc. recently welcomed 21 Jericho High School students to its Melv...

17/11/2026

Amagi to Power Live Newscasts for Spectrum News

Spectrum News has deployed the Amagi platform to support its live news operations. Amagi says the platform lets Spectrum News streamline newsroom workflows, red...

17/11/2026

Microsoft Expands Haivision Video Contribution Deployment, Adds Makito ONE for Global Live Events

Microsoft has expanded its use of Haivision's live video contribution ecosys...

17/11/2026

Setanta Sports Deploys Ateme TITAN Live for OTT Sports Streaming

Setanta Sports has deployed Ateme's TITAN Live platform to support its OTT video delivery operations. Ateme's transcoding technology is integrated into ...

17/11/2026

Media Links Joins Panasonic's KAIROS Alliance Partner Program

Media Links has joined the KAIROS Alliance Partner program for Panasonic's KAIROS IT/IP live video production platform. The company completed interoperabili...

17/11/2026

Behind The Mic: Dan Hicks, Iconic NBC Sports Broadcaster, Passes Away at 64

Behind The Mic provides a roundup of recent news regarding on-air talent, including new deals, departures, and assignments compiled from press releases and repo...

17/11/2026

2026 Sports Broadcasting Hall of Fame: Jim Dove, an Innovator Offering Second Looks at the Greatest Plays in Sports

In live sports and in life, things go by in the blink of an eye. Savoring the mo...

17/11/2026

SVG Sit-Down: Eutelsat's Gonzalez, Carroccia on C-Band Clearing, LEO Contribution, the Future of Satellite in Sports

Satellite operators are adding a new generation of low-Earth-orbit (LEO) network...

17/11/2026

Clear-Com Delivers Portable Wireless Systems for Aircraft Communications Security Testing

Clear-Com has delivered five customized test systems for electromagnetic securit...

17/11/2026

Stephen Arnold Music Creates Sonic Identity for WTGL

Stephen Arnold Music (SAM) has created the sonic identity for WTGL, the women's team golf league from TMRW Sports, created in partnership with the LPGA and ...

17/11/2026

PAMA Introduces Give Sound a Voice Initiative to Promote the Value of Sound

The Professional Audio Manufacturers Alliance (PAMA) has introduced Give Sound a Voice, an initiative aimed at raising awareness of the value of sound among the...

17/11/2026

Fanatics Studios Names Jamal Henderson First President of Film & TV

Fanatics Studios, the sports entertainment joint venture between Fanatics and OBB, has named Jamal Henderson its first President of Film & TV, announced Michael...

17/11/2026

NFL Thanksgiving Week Halftime Shows to Feature U2, Wu-Tang Clan, Miranda Lambert and Goo Goo Dolls

The NFL's Thanksgiving Week games will feature halftime performances by U2, ...

17/11/2026

FanSided Launches Redesigned App with Live Scores and Personalized Feeds

FanSided, a Minute brand with more than 250 fan communities, has launched a redesigned mobile app that combines team news, analysis, live game coverage, stats a...

17/11/2026

Major League Volleyball Announces 2027 Media Lineup with NBC Sports, ESPN, ION and CBS Sports

Major League Volleyball (MLV), the longest-running indoor professional volleybal...

17/11/2026

Prime Video to Present Black Friday Sports Lineup in 200+ Countries, No Subscription Required

Prime Video will present a 15-hour slate of live sports on Black Friday, Nov. 27...

17/11/2026

DIOR X SUNDANCE INSTITUTE PARTNERSHIP ANNOUNCED AHEAD OF 2027 SUNDANCE FILM FESTIVAL

Catherine Dior was more than a muse. A Resistance fighter, a survivor of deporta...

17/11/2026

Freqport introduce FreqLift plug-in

Multiband dynamics plug-in boasts FT1 integration Freqport's latest plug-in combines multiband upward and downward dynamics with the company's renow...

17/11/2026

Studio 5X: Debut monitors from Teufel Audio

Hi-fi experts launch two pro-audio models Berlin-based hi-fi experts Teufel Audio have recently branched out into the pro-audio world with their first pairs...

17/11/2026

EastWest Black Friday 2026

A year of ComposerCloud+ for $99 EastWest's annual Black Friday Sale is already live, and new users are being offered one year of the all-encompassing C...

17/11/2026

SOS Awards: Make Your Vote Count!

Pick your favourite gear from 2026 The annual SOS Awards are now underway, and as always, we're asking readers to help us choose the best pro-audio rele...

17/11/2026

Production capacity expanded at SGL Carbons Ried im Innkreis site

As part of an ongoing series production program for a German automaker, production capacity has been increased at SGL Carbon's Austrian site in Ried im Innk...

17/11/2026

Clear-Com Delivers Portable Wireless Systems for Secure Aircraft Communications Testing

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

17/11/2026

Signiant Acquires Media Intelligence Technology

Signiant has acquired the media intelligence technology, Ceivo, developed by Burnlab with founder Aaron Sloman joining the company as Vice President, Product Ma...

17/11/2026

Broadcasters to Conduct EAS Test Today

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

Microsoft Taps Haivision Contribution, Video Transport Solutions for Live Events

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

NAB Promotes Broadcast Positioning System Amid Tech Outages

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

Colorfront's Color Management Added to RED Camera Feeds

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

Berklees 2027 Alumni Grammy Nominees: See the Full List

Berklees 2027 Alumni Grammy Nominees: See the Full List From pop and R&B to jazz, musical theater, and video game scores, Berklee talent is represented across...

17/11/2026

Sinclair's Bill Fanshawe Sets Retirement

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

WCVB Boston Names Michael Murgia Director of Engineering

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

Two Scripps Research faculty named inaugural recipients of the Schultz Innovative Investigator Award

LA JOLLA, CA-Two Scripps Research faculty, Assistant Professor Christian Diercks...

17/11/2026

Synthogy Black Friday Savings - 33% on ALL Ivory 3 products

Our Biggest Sale of the Year on Ivory 3! From November 17th through November 30th, enjoy our best savings of the year on Ivory 3 Products! Whether it's ou...

17/11/2026

Sky announces major free upgrade to the Sky Glass and Sky Stream experience with the launch of the new Sky OS

Tuesday 17 November 2026 Sky announces major free upgrade to the Sky Glass and ...

17/11/2026

Passion, Betrayal and Scandal: Sky Arts Reveals the Man Behind the Music in Dangerous Debussy, Premiering 1 December

Tuesday 17 November 2026 Passion, Betrayal and Scandal: Sky Arts Reveals the Ma...

17/11/2026

Exact 3D Video launches AI service that turns product documents and CAD files into narrated 3D explainer videos

Exact 3D Video, a web service based in Japan, has launched its English version, ...

17/11/2026

Apple Podcasts names Baby, this is Keke\u00A0Palmer the 2026 Show of the Year - UPDATE - Posted on 17 November 2026

Today, Apple Podcasts named Baby, this is Keke Palmer its Show of the Year, hono...

17/11/2026

Ian Buck Kicks Off NVIDIA's Week at SC26 as Science Enters the Age of Agents

NVIDIA's Ian Buck kicked off the company's week at SC26 in Chicago on Monday with new tools for AI agents, software that can plan experiments, run code ...

16/11/2026

ESPN Edge Partners Chart a Future Built on Data, AI and a New Generation of Fans

The ESPN Edge Innovation Conference once again gave key ESPN technology partners as a chance to take to the stage and discuss the future of sports fan experienc...

16/11/2026

IMGs Ashley Shaner: How Micro-Dramas Can Build Sports Media Audiences and Why Content Creators Matter

As rights holders rethink who tells their stories and where, IMG is preparing th...

16/11/2026

Heard' at SVG Live!: Audio Needs To Make More Noise

From the sidelines, sonic savants advocate for greater emphasis on sound as sports and entertainment increasingly merge SVG Live!, a one-day event on Nov. 10 i...

16/11/2026

Yamaha To Acquire Disguise, Expanding Into Live Sports, Venue Production, and Immersive Entertainment

Deal combines Yamaha's audio technology with Disguise's visual-productio...

16/11/2026

New plug-in suite from Berry Effects

Creative effects designed to encourage experimentation Berry Effects is the brainchild of Abe and Ralph, a pair of multi-instrumentalists and audio engineer...

16/11/2026

Anukari 1.1 now available

Physics-based synth gets first major update Anukari have just released a new version of their innovative physics-based software synth, marking the instrumen...

16/11/2026

Hit'n'Mix RipX DAW 9 arrives

Both versions kitted out with new tools & improvements Hit'n'Mix have just launched the latest major version of their innovative DAW software, with ...

16/11/2026

Eventide to launch SplitEQ 2

Dynamic bands, unmasking features & new stereo tools Launched in 2021, Eventide's SplitEQ plug-in introduced an interesting new approach to EQ, with the...