Sony Pixel Power calrec Sony

NVIDIA Wins NeurIPS Awards for Research on Generative AI, Generalist AI Agents

28/11/2022

Two NVIDIA Research papers - one exploring diffusion-based generative AI models and another on training generalist AI agents - have been honored with NeurIPS 2022 Awards for their contributions to the field of AI and machine learning.

These are among more than 60+ talks, posters and workshops with NVIDIA authors being presented at the NeurIPs conference, taking place this week in New Orleans and next week online.

Synthetic data generation - for images, text or video - is a key theme across several of the NVIDIA-authored papers. Other topics include reinforcement learning, data collection and augmentation, weather models and federated learning.

AI is an incredibly important technology, and NVIDIA is making fast progress across the gamut - from generative AI to autonomous AI agents, said Jan Kautz, vice president of learning and perception research at NVIDIA. In generative AI, we are not only advancing our theoretical understanding of the underlying models, but are also making practical contributions that will reduce the effort of creating realistic virtual worlds and simulations.

Reimagining the Design of Diffusion-Based Generative Models Diffusion-based models have emerged as a groundbreaking technique for generative AI. NVIDIA researchers won an Outstanding Main Track Paper award for work that analyzes the design of diffusion models, proposing improvements that can dramatically improve the efficiency and quality of these models.

The paper breaks down the components of a diffusion model into a modular design, helping developers identify processes that can be adjusted to improve the performance of the entire model. The researchers show that their modifications enable record scores on a metric that assesses the quality of AI-generated images.

Training Generalist AI Agents in a Minecraft-Based Simulation Suite While researchers have long trained autonomous AI agents in video-game environments such as Starcraft, Dota and Go, these agents are usually specialists in only a few tasks. So NVIDIA researchers turned to Minecraft, the world's most popular game, to develop a scalable training framework for a generalist agent - one that can successfully execute a wide variety of open-ended tasks.

Dubbed MineDojo, the framework enables an AI agent to learn Minecraft's flexible gameplay using a massive online database of more than 7,000 wiki pages, millions of Reddit threads and 300,000 hours of recorded gameplay (shown in image at top). The project won an Outstanding Datasets and Benchmarks Paper Award from the NeurIPS committee.

As a proof of concept, the researchers behind MineDojo created a large-scale foundation model, called MineCLIP, that learned to associate YouTube footage of Minecraft gameplay with the video's transcript, in which the player typically narrates the onscreen action. Using MineCLIP, the team was able to train a reinforcement learning agent capable of performing several tasks in Minecraft without human intervention.

Creating Complex 3D Shapes to Populate Virtual Worlds Also at NeurIPS is GET3D, a generative AI model that instantly synthesizes 3D shapes based on the category of 2D images it's trained on, such as buildings, cars or animals. The AI-generated objects have high-fidelity textures and complex geometric details - and are created in a triangle mesh format used in popular graphics software applications. This makes it easy for users to import the shapes into 3D renderers and game engines for further editing.

Named for its ability to Generate Explicit Textured 3D meshes, GET3D was trained on NVIDIA A100 Tensor Core GPUs using around 1 million 2D images of 3D shapes captured from different camera angles. The model can generate around 20 objects a second when running inference on a single NVIDIA GPU.

The AI-generated objects could be used to populate 3D representations of buildings, outdoor spaces or entire cities - digital spaces designed for industries such as gaming, robotics, architecture and social media.

Improving Inverse Rendering Pipelines With Control Over Materials, Lighting At the most recent CVPR conference, held in New Orleans in June, NVIDIA Research introduced 3D MoMa, an inverse rendering method that enables developers to create 3D objects composed of three distinct parts: a 3D mesh model, materials overlaid on the model, and lighting.

The team has since achieved significant advancements in untangling materials and lighting from the 3D objects - which in turn improves creators' abilities to edit the AI-generated shapes by swapping materials or adjusting lighting as the object moves around a scene.

The work, which relies on a more realistic shading model that leverages NVIDIA RTX GPU-accelerated ray tracing, is being presented as a poster at NeurIPS.

Enhancing Factual Accuracy of Language Models' Generated Text Another accepted paper at NeurIPS examines a key challenge with pretrained language models: the factual accuracy of AI-generated text.

Language models trained for open-ended text generation often come up with text that includes nonfactual information, since the AI is simply making correlations between words to predict what comes next in a sentence. In the paper, NVIDIA researchers propose techniques to address this limitation, which is necessary before such models can be deployed for real-world applications.

The researchers built the first automatic benchmark to measure the factual accuracy of language models for open-ended text generation, and found that bigger language models with billions of parameters were more factual than smaller ones. The team proposed a new technique, factuality-enhanced training, along with a novel sampling algorithm that together help train language models to generate accurate text - and demonstrated a reduction in the rate of factual errors from 33% to around 15%.

There are more th
LINK: https://blogs.nvidia.com/blog/2022/11/28/nvidia-neurips-research/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

23/03/2026

Professional Fighters League & U-Next Renew Multi-year Partnership to Broadcast PFL Events Live in Japan

The Professional Fighters League (PFL) has renewed its multi-year partnership wi...

23/03/2026

The Snow League Announces Google Cloud as Official Cloud and AI Partner to Power Personalized Fan Experiences Worldwide

The Snow League has named Google Cloud as its Official Cloud and AI Partner. The...

23/03/2026

Chyron Appoints Eric Wolff as Director of Venues Sales, North America

Chyron has appointed Eric Wolff as Director of Venues Sales, North America. Wolff previously served as Director of Broadcast Operations & Media Production for T...

23/03/2026

Chicago Sports Network, WCIU To Simulcast 10 White Sox Games

Chicago Sports Network (CHSN) and Weigel Broadcasting's WCIU (The U, ch. 26.1) will simulcast 10 Chicago White Sox games during the 2026 season, the compani...

23/03/2026

Cosm Appoints Jon Werbeck as VP, Head of Sponsorships

Cosm has appointed Jon Werbeck as Vice President, Head of Sponsorships. He will report to Corey Breton, Head of Venues, and will focus on corporate sponsorship ...

23/03/2026

CP Communications Partners with Mark Roberts Motion Control to Bring Robotic Camera Systems to Florida

CP Communications has announced a partnership with Mark Roberts Motion Control (...

23/03/2026

NAB 2026: Creators, Media Leaders, Storytelling Legends and AI Step Into the Spotlight as Lineup is Unveiled

NAB Show 2026, taking place April 18-22 (exhibits April 19-22) at the Las Vegas ...

23/03/2026

Bay FC Announces Multi-Year Partnership with Victory+ as the Official Streaming Partner

Bay FC and free streaming platform Victory have announced a partnership through...

23/03/2026

MLB, Google Cloud Debut AI-Powered, Real-Time Game Analysis With Scout Insights' in MLB Gameday

Gemini AI models will surface hidden context around pitches, matchups, rare stat...

23/03/2026

Behind the Mic: NBC Sports Announces MLB Opening Day On Air Lineup, Featuring Orel Hershiser, Al Leiter and More.

Behind The Mic provides a roundup of recent news regarding on-air talent, includ...

23/03/2026

SVG All-Stars: Alex McKeen, Senior Manager, Strategic Production Planning, TNT Sports

Growing from broadcast engineer to strategic planner, this Ithaca College grad h...

23/03/2026

Announcing the 2026 Sundance Institute | Sandbox Fund Grantees

16 Science-Focused Nonfiction Projects Selected for Funding LOS ANGELES, CA, March 23, 2026 - The nonprofit Sundance Institute and Sandbox Films announced toda...

23/03/2026

Celebrate 20 Years of Hannah Montana With Megan Moroney's New The Best of Both Worlds' Cover and More

It's been 20 years since Miley Cyrus introduced the world to Hannah Montana,...

23/03/2026

BOOM Library release Seasons of Earth: European Autumn

Made entirely from real natural recordings Aimed at sound designers and editors working in film, TV and game audio, the latest release from BOOM Library com...

23/03/2026

Klang.io launch Transcription Studio

Transcribe sheets, tabs or MIDI from audio files Klang.io have announced the launch of a new AI-powered software tool that's capable of detecting multip...

23/03/2026

RL10 and Orion Main Engine are Key to NASA's Historic Artemis II Journey to the Moon

An auxiliary target has been affixed to the Interim Cryogenic Propulsion Stage f...

23/03/2026

Scripps To Launch Scripps Sports Network Streaming Channel

Share Copy link Facebook X Linkedin Bluesky Email...

23/03/2026

IBEW Calls for Scrutiny of Skydance-CBS Layoffs and Proposed CNN Merger

Share Copy link Facebook X Linkedin Bluesky Email...

23/03/2026

Bruno Mars Risk It All Music Video Captures Timeless Text...

Pro8mm, the Super 8 experts, provided cameras, Super 8 movie film, and scanning services for Bruno Mars' Risk It All music video. The debut single from Br...

23/03/2026

Matthews Intros Lightweight Aluminum Grid Clamps

Matthews, introduces their first aluminum grid clamp collection, engineered for the rigging needs of film, television and live production. Combining light weigh...

23/03/2026

Hacks, the multi-Emmy -winning Sky Exclusive comedy, returns to the UK for its final season this April

Monday 23 March 2026 Hacks, the multi-Emmy -winning Sky Exclusive comedy, retur...

23/03/2026

'Too Hot to Handle: Italy' Reignites for a Second Season With the Special Participation of Selvaggia Lucarelli

Back to All News Too Hot to Handle: Italy Reignites for a Second Season With th...

23/03/2026

How Autonomous AI Agents Become Secure by Design With NVIDIA OpenShell

Autonomous agents mark a new inflection point in AI. Systems are no longer limited to generating responses or reasoning through tasks. They can take action: Age...

23/03/2026

RT Statement on the Death of Sports Broadcaster Michael Lyster

RT is sad today to learn of the death of legendary RT Sport broadcaster Michael Lyster, who died this morning aged 71 years. Kevin Bakhurst, Director-General...

23/03/2026

RT Documentary On One wins its first ever dedicated music award

RT Documentary On One has scooped its first ever dedicated music award. At the 2026 Icelandic Music Awards, composer lfur Eldj rn won Release of the Year in t...

23/03/2026

Czechia v Republic of Ireland live on RT2, RT Player and RT Radio 1

Inside Sport, Liveline, Morning Ireland and 2FM DRIVE will all be in Prague to bring fans to the heart of the action Every Moment, Every GenerationRT | FIFA W...

22/03/2026

VSL update Synchron Woodwinds & Strings

Free updates now available VSL have just released some free updates that add some existing features to a selection of libraries in their expansive Synchron ...

22/03/2026

Live-Action Sins of Kujo' Premieres April 2: Main Trailer and Key Art Debut

Back to All News Live-Action Sins of Kujo' Premieres April 2: Main Trailer and Key Art Debut Entertainment 22 March 2026 GlobalJapan Link copied to cl...

21/03/2026

MPG announce new Impact Award

Presented to War Child UK's HELP(2) project The MPG (Music Producers Guild) have announced the launch of the MPG Impact Award, a brand-new honour that w...

21/03/2026

Eduardo Tarilonte's Ancient ERA Persia from Best Service

Microtuning support for Arabic, Persian & Turkish scales The latest release from Best Service brings together a selection of string, wind and percussion ins...

21/03/2026

New campaign from NAATI and SBS CulturalConnect highlights how we all deserve to be understood'

New campaign from NAATI and SBS CulturalConnect highlights how we all deserve t...

21/03/2026

Statement regarding Rhoda Roberts AO

Statement regarding Rhoda Roberts AO 21 March, 2026 Media releases SBS is deeply saddened by the passing of Widjabul Wia-bal woman from the Bundjalung Na...

21/03/2026

Survey: Fans Prefer Sports on Broadcast Over Streaming

Share Copy link Facebook X Linkedin Bluesky Email...

21/03/2026

Graham Promotes Stephanie Slagle to VP, CRO & GM of WDIV Local 4

Share Copy link Facebook X Linkedin Bluesky Email...

21/03/2026

Study: Repurposed Traditional TV Ads for CTV Is a Missed Opportunity

Share Copy link Facebook X Linkedin Bluesky Email...

21/03/2026

Carr Backs Trump Army/Navy Game Executive Order

Share Copy link Facebook X Linkedin Bluesky Email...

21/03/2026

Opponents File Emergency FCC Petition to Block Nexstar/Tegna Merger

Share Copy link Facebook X Linkedin Bluesky Email...

21/03/2026

Eight States Ask for Court to Stop Nexstar/Tegna Merger

Share Copy link Facebook X Linkedin Bluesky Email...

21/03/2026

Cine Gear Connect NY Ramps Up for March 28 - 2026

Cine Gear Connect NY, presented by Universal Production Services, is filling in the slate for a full day of panels, peers, learning the latest, and mixing it up...

21/03/2026

Studio Technologies Debuts New StudioComm System at NAB 2026

Studio Technologies Debuts New StudioComm System at NAB 2026 Brie Clayton March 20, 2026 0 Comments StudioComm Model 794 Central Controller and Model ...

21/03/2026

Restoration Christian Fellowship Captures Worship Music Videos with PYXIS 12K

Restoration Christian Fellowship Captures Worship Music Videos with PYXIS 12K Brie Clayton March 20, 2026 0 Comments PYXIS' open gate provides cre...

20/03/2026

NAB 2026: Net Insight unveils Market-Leading JPEG XS at Scale for Live IP Media Production

Net Insight will introduce a JPEG XS solution for full IP environments at NAB Sh...

20/03/2026

NAB 2026: LTN and Harmonic Expand Partnership to Support FAST Growth and C-Band Migration

LTN has expanded its technology partnership with Harmonic ahead of the FCC's...

20/03/2026

NAB 2026: Solid State Logic to Preview SSL Live V6.2 with New SolidPitch Effect and Major Workflow Enhancements

Solid State Logic will preview SSL Live V6.2 at NAB Show, booth C6907. The softw...

20/03/2026

NAB 2026: Fujifilm Announces Availability of FUJINON UA22x4.8BERD 4K Broadcast Zoom Lens

FUJIFILM North America Corporation's Optical Devices Division has announced ...