Content streaming and engagement are entering a new dimension with QUEEN, an AI model by NVIDIA Research and the University of Maryland that makes it possible to stream free-viewpoint video, which lets viewers experience a 3D scene from any angle.
QUEEN could be used to build immersive streaming applications that teach skills like cooking, put sports fans on the field to watch their favorite teams play from any angle, or bring an extra level of depth to video conferencing in the workplace. It could also be used in industrial environments to help teleoperate robots in a warehouse or a manufacturing plant.
The model will be presented at NeurIPS, the annual conference for AI research that begins Tuesday, Dec. 10, in Vancouver.
To stream free-viewpoint videos in near real time, we must simultaneously reconstruct and compress the 3D scene, said Shalini De Mello, director of research and a distinguished research scientist at NVIDIA. QUEEN balances factors including compression rate, visual quality, encoding time and rendering time to create an optimized pipeline that sets a new standard for visual quality and streamability.
Reduce, Reuse and Recycle for Efficient Streaming Free-viewpoint videos are typically created using video footage captured from different camera angles, like a multicamera film studio setup, a set of security cameras in a warehouse or a system of videoconferencing cameras in an office.
Prior AI methods for generating free-viewpoint videos either took too much memory for livestreaming or sacrificed visual quality for smaller file sizes. QUEEN balances both to deliver high-quality visuals - even in dynamic scenes featuring sparks, flames or furry animals - that can be easily transmitted from a host server to a client's device. It also renders visuals faster than previous methods, supporting streaming use cases.
In most real-world environments, many elements of a scene stay static. In a video, that means a large share of pixels don't change from one frame to another. To save computation time, QUEEN tracks and reuses renders of these static regions - focusing instead on reconstructing the content that changes over time.
Using an NVIDIA Tensor Core GPU, the researchers evaluated QUEEN's performance on several benchmarks and found the model outperformed state-of-the-art methods for online free-viewpoint video on a range of metrics. Given 2D videos of the same scene captured from different angles, it typically takes under five seconds of training time to render free-viewpoint videos at around 350 frames per second.
This combination of speed and visual quality can support media broadcasts of concerts and sports games by offering immersive virtual reality experiences or instant replays of key moments in a competition.
In warehouse settings, robot operators could use QUEEN to better gauge depth when maneuvering physical objects. And in a videoconferencing application - such as the 3D videoconferencing demo shown at SIGGRAPH and NVIDIA GTC - it could help presenters demonstrate tasks like cooking or origami while letting viewers pick the visual angle that best supports their learning.
The code for QUEEN will soon be released as open source and shared on the project page.
QUEEN is one of over 50 NVIDIA-authored NeurIPS posters and papers that feature groundbreaking AI research with potential applications in fields including simulation, robotics and healthcare. Among them is a best paper runner-up, titled Guiding a Diffusion Model With a Bad Version of Itself - one of just five papers recognized among the over 4,500 accepted this year.
Generative Adversarial Nets, the paper that first introduced GAN models, won the NeurIPS 2024 Test of Time Award. Cited more than 85,000 times, the paper was coauthored by Bing Xu, distinguished engineer at NVIDIA. Hear more from its lead author, Ian Goodfellow, research scientist at DeepMind, on the AI Podcast:
The AI Podcast Ep. 25: Google's Ian Goodfellow on How an Argument in a Bar Led to Generative Adversarial Networks
Learn more about NVIDIA Research at NeurIPS.
See the latest work from NVIDIA Research, which has hundreds of scientists and engineers worldwide, with teams focused on topics including AI, computer graphics, computer vision, self-driving cars and robotics.
Academic researchers working on large language models, simulation and modeling, edge AI and more can apply to the NVIDIA Academic Grant Program.
See notice regarding software product information.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
09/10/2026
September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026
New Sports Intelligence helps providers better unders...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
30/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/09/2026
The An Evening with Emerson, Lake and Palmer tour brings one of rock's most iconic bands back to the stage. These performances seamlessly blend live foota...
30/09/2026
Schibsted Media, one of Norways largest and most influential digital media publishers and content producers, has invested in mixers and digital signal processor...
30/09/2026
Big Blue Marble announces the addition of live multiview channels to Cloud Video Kit, its broadcast-grade video processing platform. The feature is powered by A...
30/09/2026
Leading video software provider Synamedia today announced that Telekom Slovenije, Slovenia's largest provider of telecommunications and TV services, is open...
30/09/2026
PODCAST EXPO 2026 Recorded Using Blackmagic Design Workflow
Brie Clayton September 29, 2026
0 Comments
Conference featuring 24 sessions over two days ...
30/09/2026
IBC2026 Show Report
David Kirk September 29, 2026
0 Comments
The International Broadcasting Convention has long been Europe's equivalent of the US...
30/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
30/09/2026
Mavis has launched Mavis Camera 8.2, the latest release of its professional camera app for the iPhone and iPad. This update brings support for iPhone 18 Pro and...
30/09/2026
How to Shop Well Now starts Monday at 9.35pm
on RT One and RT Player
On the...
30/09/2026
Building on nearly a decade of co-engineering, CoreWeave has built NVIDIA compute, networking and software into a cloud purpose-built for AI that's still re...
29/09/2026
Oak View Group (OVG) has announced Cisco as an Official Technology Partner, with plans to standardize infrastructure across its venue network on Cisco solutions...
29/09/2026
SportsNet Pittsburgh (SNP) won three honors at the 2026 Mid-Atlantic Emmy Awards.
Program awards went to Bucs BP in the Sports Program Live category (produced ...
29/09/2026
The Professional Women's Hockey League has announced home openers for all 12 teams for the 2026-27 season, along with a broadcast partnership with CBC under...
29/09/2026
Manifold technologies has been recognized as a contributor to the Media eXchange...
29/09/2026
FuboTV has announced My Local Sports, allowing subscribers in select markets to add their local regional sports network (RSN) as an add-on to a Fubo Sports subs...
29/09/2026
Asian News International (ANI), a wire agency and video news provider based in India, has deployed Grass Valley's AMPP Media Operating System and Framelight...
29/09/2026
South African Broadcasting Corporation (SABC) has deployed Ikegami UHK-X600 cameras as part of an upgrade to IP-based production infrastructure. The deployment ...
29/09/2026
REMI, REMCO models will drive the bulk of the broadcaster's NHL productions ...
29/09/2026
Three years in, the facility is supporting more centralized race production, com...
29/09/2026
NBC, Peacock, and NBSN are carrying all four Wild Card series with a production ...
29/09/2026
19 Nonfiction Projects Across All Stages of Production to Receive More Than $1 million in Support as Documentary Film Program Approaches 25th Anniversary
LOS ...
29/09/2026
Two new plug-ins launch alongside updated bundles
Zynaptiq have just announced the launch of two new plug-ins, alongside new and improved versions of two of...
29/09/2026
All-in-one bus processor revealed
Wes Audio's ng product range has come a long way since it was first introduced, and now includes a tasty selection of ...
29/09/2026
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......
29/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/09/2026
Ikegami announces that the South African Broadcasting Corporation, SABC, has chosen Ikegami UHK-X600 camera systems as part of an advance to IP-based operation ...
29/09/2026
Blendkit Offers 20% Discount to Celebrate Crossing 150K Asset Milestone
Brie Clayton September 29, 2026
0 Comments
Blendkit, the largest 3D asset libr...
29/09/2026
Interactive streaming specialist Ease Live supported more than 76.5 million fan sessions across three major European media operators during this summers FIFA Wo...
29/09/2026
Ease Live has added support for VAST (Video Ad Serving Template) to its graphical overlay technology, opening up new ways for broadcasters, streamers and rights...
29/09/2026
Rise AV has announced the launch of the inaugural Rise AV Awards, a new global awards programme celebrating the women, advocates and organisations across the AV...
29/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/09/2026
Clear-Com announced that First Baptist Nashville has upgraded its production communications with a Clear-Com intercom solution as part of a comprehensive sanct...
29/09/2026
Blackmagic Cinema Camera 6K Captured Action Shots for Sketch
Brie Clayton September 28, 2026
0 Comments
Camera's portable design and dynamic range...
29/09/2026
Kean Production Services Deploys AJA ColorBox to Deliver Consistent, Accurate Co...
Content streaming and engagement are entering a new dimension with QUEEN, an AI model by NVIDIA Research and the University of Maryland that makes it possible to stream free-viewpoint video, which lets viewers experience a 3D scene from any angle.
