
Content streaming and engagement are entering a new dimension with QUEEN, an AI model by NVIDIA Research and the University of Maryland that makes it possible to stream free-viewpoint video, which lets viewers experience a 3D scene from any angle.
QUEEN could be used to build immersive streaming applications that teach skills like cooking, put sports fans on the field to watch their favorite teams play from any angle, or bring an extra level of depth to video conferencing in the workplace. It could also be used in industrial environments to help teleoperate robots in a warehouse or a manufacturing plant.
The model will be presented at NeurIPS, the annual conference for AI research that begins Tuesday, Dec. 10, in Vancouver.
To stream free-viewpoint videos in near real time, we must simultaneously reconstruct and compress the 3D scene, said Shalini De Mello, director of research and a distinguished research scientist at NVIDIA. QUEEN balances factors including compression rate, visual quality, encoding time and rendering time to create an optimized pipeline that sets a new standard for visual quality and streamability.
Reduce, Reuse and Recycle for Efficient Streaming Free-viewpoint videos are typically created using video footage captured from different camera angles, like a multicamera film studio setup, a set of security cameras in a warehouse or a system of videoconferencing cameras in an office.
Prior AI methods for generating free-viewpoint videos either took too much memory for livestreaming or sacrificed visual quality for smaller file sizes. QUEEN balances both to deliver high-quality visuals - even in dynamic scenes featuring sparks, flames or furry animals - that can be easily transmitted from a host server to a client's device. It also renders visuals faster than previous methods, supporting streaming use cases.
In most real-world environments, many elements of a scene stay static. In a video, that means a large share of pixels don't change from one frame to another. To save computation time, QUEEN tracks and reuses renders of these static regions - focusing instead on reconstructing the content that changes over time.
Using an NVIDIA Tensor Core GPU, the researchers evaluated QUEEN's performance on several benchmarks and found the model outperformed state-of-the-art methods for online free-viewpoint video on a range of metrics. Given 2D videos of the same scene captured from different angles, it typically takes under five seconds of training time to render free-viewpoint videos at around 350 frames per second.
This combination of speed and visual quality can support media broadcasts of concerts and sports games by offering immersive virtual reality experiences or instant replays of key moments in a competition.
In warehouse settings, robot operators could use QUEEN to better gauge depth when maneuvering physical objects. And in a videoconferencing application - such as the 3D videoconferencing demo shown at SIGGRAPH and NVIDIA GTC - it could help presenters demonstrate tasks like cooking or origami while letting viewers pick the visual angle that best supports their learning.
The code for QUEEN will soon be released as open source and shared on the project page.
QUEEN is one of over 50 NVIDIA-authored NeurIPS posters and papers that feature groundbreaking AI research with potential applications in fields including simulation, robotics and healthcare. Among them is a best paper runner-up, titled Guiding a Diffusion Model With a Bad Version of Itself - one of just five papers recognized among the over 4,500 accepted this year.
Generative Adversarial Nets, the paper that first introduced GAN models, won the NeurIPS 2024 Test of Time Award. Cited more than 85,000 times, the paper was coauthored by Bing Xu, distinguished engineer at NVIDIA. Hear more from its lead author, Ian Goodfellow, research scientist at DeepMind, on the AI Podcast:
The AI Podcast Ep. 25: Google's Ian Goodfellow on How an Argument in a Bar Led to Generative Adversarial Networks
Learn more about NVIDIA Research at NeurIPS.
See the latest work from NVIDIA Research, which has hundreds of scientists and engineers worldwide, with teams focused on topics including AI, computer graphics, computer vision, self-driving cars and robotics.
Academic researchers working on large language models, simulation and modeling, edge AI and more can apply to the NVIDIA Academic Grant Program.
See notice regarding software product information.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
09/10/2026
September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026
New Sports Intelligence helps providers better unders...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
22/09/2026
From Malaysia to Mexico and from DR Congo to Ukraine, this year's 12 finalists for the 2026 Thomson Foundation Young Journalist of the Year award tell extra...
22/09/2026
The annual preseason content-gathering event brought 36 NHL players to Las Vegas, where ESPN used 2.5 kilowatts of laser power and a motion-control camera syste...
22/09/2026
Neumann has introduced the KK 104 A (cardioid) and KK 105 A (supercardioid) wireless capsule heads, succeeding the KK 204 and KK 205. The new capsules are compa...
22/09/2026
The NFL and TMRW Sports have announced a new annual Pro Flag Showcase to be held during Super Bowl LXI week in Los Angeles. The event will feature top flag foot...
22/09/2026
Washington State University has unveiled a new end zone video display and audio ...
22/09/2026
Disney's SVP of Live Operations and Engineering details the technology behin...
22/09/2026
Cosm has announced two senior promotions. Mazen Alawar has been promoted to SVP,...
22/09/2026
Mississippi State University's University Television Center has purchased four KOKUSAI DENKI SK-UHD7000-S2 cameras since 2024, with plans to add two more, a...
22/09/2026
Net Insight has announced that Christine Kjellvard will assume the role of interim Chief Financial Officer on November 1, 2026. Kjellvard has previously held in...
22/09/2026
Net Insight has announced Zyntai TimeNode Access, a compact PTP Grandmaster designed for distributed edge sites. The product carries secure, precise time across...
22/09/2026
Sam Hazeldine, Austin Amelio, Padraic McKinley, Julia Jones, and Ethan Hawke attend the premiere of The Weight at The Ray Theatre on January 26, 2026, in Park...
22/09/2026
Second high-gain tone plug-in released
Following on from their debut release, Chainsaw Suite, Avalanche Tones have announced the launch of their second plug...
22/09/2026
Uncompressed audio with below 6ms of latency
Lewitt's have just introduced their first pair of headphones which, despite being aimed primarily at studio...
22/09/2026
Two new capsule heads for Sennheiser wireless systems
Neumann have announced the upcoming launch of the KK 104 A and KK 105 A, a pair of new premium condens...
22/09/2026
Apogee Plugins Are Moving to Plugin Alliance We're excited to share an important update about the future of Apogee plugins.
Apogee plugins are moving to Pl...
22/09/2026
Parkland, Florida, US, September 22, 2026: SipRadius, widely recognized for making content processing and connectivity secure and seamless, has been honored wit...
22/09/2026
VanityFilter 3.1.5 adds project files and adjustable protection around lips, bro...
22/09/2026
Chile's TV Modernizes Broadcast Operations with Blackmagic Design
Brie Clayton September 22, 2026
0 Comments
URSA Broadcast G2 brings versatility...
22/09/2026
OWC Shares Sneak Peek at Amazon Prime Big Deal Days Pricing
Brie Clayton September 22, 2026
0 Comments
Image courtesy of Deposit Photos
Business and ...
22/09/2026
Berklee's First Homecoming Block Party Brings Alumni Home for Global Music F...
22/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
22/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
22/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
22/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
22/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
22/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
22/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
22/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
22/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
22/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
22/09/2026
From Academy Award-winning Passion Pictures and BAFTA-winning director Marian Mo...
22/09/2026
Tuesday 22 September 2026
Portrait Artist of the Year returns to Sky Arts with ...
22/09/2026
Whether it be from the sun or from our phones and other devices, we are all exposed to electromagnetic radiation in some shape or form. With the dramatic growth...
22/09/2026
Comscore's latest AI Intelligence Report Shows Competition Intensifying as C...
22/09/2026
The Factory-X Project Sets Standards for Data Sovereignty in Industry
Arvato Systems Brings Digital Sovereignty to Industrial Practice
Factory-X Successfully...
22/09/2026
LONDON Apple today announced the opening of Apple Music Hall, a brand-new state-...
22/09/2026
RT , Creative Ireland and Shared Island Initiative ask young artists
to respon...
22/09/2026
To build and deploy sophisticated robotics applications that can perceive, reason and act in dynamic environments, developers need new physical AI models and to...
21/09/2026
Manifold Technologies, developer of software-defined, FPGA-accelerated infrastructure for live production, has named Ryhaan Williams as Chief Commercial Officer...
21/09/2026
Studio Network Solutions (SNS) has won Best Journal Article at the 2026 IAMT Impact Awards for What Video Editors Need When Everything Is Changing Around Them,...
21/09/2026
Major League Wrestling (MLW) has announced a streaming distribution agreement with Tubi for its weekly series MLW FUSION. Beginning September 17, new episodes w...
21/09/2026
Disney Entertainment has announced that Adam Smith has been named Chairman, Direct-to-Consumer, with responsibility for Disney and Hulu including product, engi...
21/09/2026
United Airlines and DISH have announced an agreement to bring live professional ...
21/09/2026
SES and JioStar have announced a multi-year agreement under which SES will provide satellite distribution services for JioStar's television channel portfoli...
21/09/2026
The Detroit Red Wings have announced details for their inaugural season on Detro...
21/09/2026
Manifold Technologies has appointed Ryhaan Williams as Chief Commercial Officer for North America, effective October 1, 2026. Based in Jacksonville, Florida, Wi...
21/09/2026
Angels Broadcast Television (ABTV), the local television home of the Los Angeles...