Opinion: The state of virtual production

Tim Moore, CEO at Vu Technologies, discusses emerging trends in the virtual production market

By Contributor

Published: July 8, 2024 Updated: July 11, 2024

Tim Moore, CEO at Vu Technologies, discusses emerging trends in the virtual production market

target=_blank title=Share on LinkedIn class=share-linkedin> Tim Moore, CEO at Vu Technologies, discusses emerging trends in the virtual production market

https://www.tvbeurope.com/features/opinion-the-state-of-virtual-production title=Share via Email class=share-email>

In the wake of back-to-back labour strikes last year, the media and entertainment industry experienced a decline of historic proportions, with a 52 per cent decrease in production spending compared to the previous year and so much collateral damage that the effects have yet to be fully tallied. However in 2024, virtual production earnings have bounced back, with 35 per cent growth in the corporate and education sector.

But the market is forecasted to be a tale of two cities. As the volatile media and entertainment market continues to stifle investment in the industry, a rising number of corporate and higher education virtual studios will take virtual production technologies to new audiences with different use cases. With compounding disruption and volatile labour markets, radical transformation is quickly approaching.

The continued pace of innovation in the production industry has been relentlessly accelerating with advancements in computer graphics, and new creative workflows that are coming out so quickly it is outpacing the market's ability to commercialise them into viable solutions. With another looming strike on the horizon for M&E, and innovations in generative AI continuing to redefine how content is created, this year is expected to be one of the most transformative years in the industry since the shift to digital in the early 2000s.

We have reached the tipping point of advanced computer graphics We are at a unique moment in time where new innovations in real-time computer graphics and paradigm shifts in AI-powered workflows are allowing creators to make content at super-human speeds. For years, the human brain was the greatest processor in the world, but now there is a new species of AI in town and it's reaching human-like capabilities in almost every category of communication, including visual communication. Computer-generated visuals are so advanced that the human brain can no longer distinguish what's real or not. We have officially reached the tipping point. With new advanced technologies like generative AI and real-time virtual production, photo-realistic imaging is not just a creative aspiration, it's a widely accessible reality.

The AI crash is coming The Gen AI crash is coming, but not every AI company will feel it. Hype cycles are nothing new in the market. They often start when new transformative technologies emerge with a promise to change the world, then speculative investment capital propels the technologies into orbit before they are ready for mass commercialisation, leading to spectacular crashes that decimate large parts of the industry.

In the recent virtual production hype cycle of 2022, there was a bit of a different effect that happened. Fuelled by a huge surge in demand during the pandemic, the virtual production market experienced accelerated growth in 2021-2022, but the forces of gravity set in and eventually brought it right back down the following year. However, unlike some of the other technologies that thrived during the pandemic, virtual production has taken another accelerated upswing this year, suggesting a trajectory we are used to seeing on the long tail of a hype cycle. With virtual production in accelerated growth mode and generative AI now approaching the hype cycle peak, it will be an interesting year to see how the cascade of hype cycles all level out.

Instant is the new norm. A new real-time creative workflow In the past 12 months, new virtual production tools have been introduced to the market on a seemingly monthly basis. New 3D scanning solutions with technologies like NeRFs and Gaussian Splatting are allowing anyone to upload a basic video scan of a location from their phone into applications like Volinga and Luma.ai to create 3D virtual environments in minutes versus weeks. Markerless tracking solutions like Move.ai and Theia3D are replacing bulky, complex body suits with standard consumer cameras to create quick 3D character animations. Generative AI tools like Cuebric and Vu.ai are allowing for real-time virtual background creation for instant on set adjustments. A growing number of studios are migrating to hybrid 3D workflows like 2.5D and 3D depth maps for faster scene creation where full 3D isn't necessary.

Of all these advancements, generative AI for 2D plates seems to be the most adopted workflow as it is the simplest workflow for newcomers to the field to understand, and is often much quicker to create than full 3D environments. Let's not forget about Runway, Sora and Pika Labs all in a race for creating the studio completely in the cloud. And now Google has entered the race with Google VEO, an update to the original Imagine they announced in 2021. These fully synthetic AI text-to video generators will dramatically change the creative workflow as studios are able to instantly generate 2D video plates as virtual backgrounds and in many cases use generated video directly in their edits without ever going to a studio. And all of this technology progress is making virtual production faster, easier and allowing artists to create content at the speed of thought.

Virtual production 2.0: from science experiment to industry standard In the same way that Smart TVs made our lives easier by integrating the media player, internet and stereo system all together, virtual production stud

LINK:	https://www.tvbeurope.com/features/opinion-the-state-of-virtual-produc...
	See more stories from tvb

Europe Stories