NVIDIA Wins NeurIPS Awards for Research on Generative AI, Generalist AI Agents
28/11/2022
These are among more than 60+ talks, posters and workshops with NVIDIA authors being presented at the NeurIPs conference, taking place this week in New Orleans and next week online.
Synthetic data generation - for images, text or video - is a key theme across several of the NVIDIA-authored papers. Other topics include reinforcement learning, data collection and augmentation, weather models and federated learning.
AI is an incredibly important technology, and NVIDIA is making fast progress across the gamut - from generative AI to autonomous AI agents, said Jan Kautz, vice president of learning and perception research at NVIDIA. In generative AI, we are not only advancing our theoretical understanding of the underlying models, but are also making practical contributions that will reduce the effort of creating realistic virtual worlds and simulations.
Reimagining the Design of Diffusion-Based Generative Models Diffusion-based models have emerged as a groundbreaking technique for generative AI. NVIDIA researchers won an Outstanding Main Track Paper award for work that analyzes the design of diffusion models, proposing improvements that can dramatically improve the efficiency and quality of these models.
The paper breaks down the components of a diffusion model into a modular design, helping developers identify processes that can be adjusted to improve the performance of the entire model. The researchers show that their modifications enable record scores on a metric that assesses the quality of AI-generated images.
Training Generalist AI Agents in a Minecraft-Based Simulation Suite While researchers have long trained autonomous AI agents in video-game environments such as Starcraft, Dota and Go, these agents are usually specialists in only a few tasks. So NVIDIA researchers turned to Minecraft, the world's most popular game, to develop a scalable training framework for a generalist agent - one that can successfully execute a wide variety of open-ended tasks.
Dubbed MineDojo, the framework enables an AI agent to learn Minecraft's flexible gameplay using a massive online database of more than 7,000 wiki pages, millions of Reddit threads and 300,000 hours of recorded gameplay (shown in image at top). The project won an Outstanding Datasets and Benchmarks Paper Award from the NeurIPS committee.
As a proof of concept, the researchers behind MineDojo created a large-scale foundation model, called MineCLIP, that learned to associate YouTube footage of Minecraft gameplay with the video's transcript, in which the player typically narrates the onscreen action. Using MineCLIP, the team was able to train a reinforcement learning agent capable of performing several tasks in Minecraft without human intervention.
Creating Complex 3D Shapes to Populate Virtual Worlds Also at NeurIPS is GET3D, a generative AI model that instantly synthesizes 3D shapes based on the category of 2D images it's trained on, such as buildings, cars or animals. The AI-generated objects have high-fidelity textures and complex geometric details - and are created in a triangle mesh format used in popular graphics software applications. This makes it easy for users to import the shapes into 3D renderers and game engines for further editing.
Named for its ability to Generate Explicit Textured 3D meshes, GET3D was trained on NVIDIA A100 Tensor Core GPUs using around 1 million 2D images of 3D shapes captured from different camera angles. The model can generate around 20 objects a second when running inference on a single NVIDIA GPU.
The AI-generated objects could be used to populate 3D representations of buildings, outdoor spaces or entire cities - digital spaces designed for industries such as gaming, robotics, architecture and social media.
Improving Inverse Rendering Pipelines With Control Over Materials, Lighting At the most recent CVPR conference, held in New Orleans in June, NVIDIA Research introduced 3D MoMa, an inverse rendering method that enables developers to create 3D objects composed of three distinct parts: a 3D mesh model, materials overlaid on the model, and lighting.
The team has since achieved significant advancements in untangling materials and lighting from the 3D objects - which in turn improves creators' abilities to edit the AI-generated shapes by swapping materials or adjusting lighting as the object moves around a scene.
The work, which relies on a more realistic shading model that leverages NVIDIA RTX GPU-accelerated ray tracing, is being presented as a poster at NeurIPS.
Enhancing Factual Accuracy of Language Models' Generated Text Another accepted paper at NeurIPS examines a key challenge with pretrained language models: the factual accuracy of AI-generated text.
Language models trained for open-ended text generation often come up with text that includes nonfactual information, since the AI is simply making correlations between words to predict what comes next in a sentence. In the paper, NVIDIA researchers propose techniques to address this limitation, which is necessary before such models can be deployed for real-world applications.
The researchers built the first automatic benchmark to measure the factual accuracy of language models for open-ended text generation, and found that bigger language models with billions of parameters were more factual than smaller ones. The team proposed a new technique, factuality-enhanced training, along with a novel sampling algorithm that together help train language models to generate accurate text - and demonstrated a reduction in the rate of factual errors from 33% to around 15%.
There are more th
LINK: | https://blogs.nvidia.com/blog/2022/11/28/nvidia-neurips-research/... |
See more stories from nvidia |
North America Stories
28/03/2024
2024 Big Night In Raises $145k to Support Triangle Arts Councils
Capitol Broadcasting and WRAL-TV once again proudly supported our local arts community with the broadcast of Big Night in for the Arts Thursday, March 7, 2024. ...
28/03/2024
JIC, MRC Announce Accord On Roles In Judging Measurement Companies
With more companies offering different approaches to measuring television viewing and campaign effectiveness, two of the groups that evaluate potential media bu...
28/03/2024
Hulu Added to Disney Plus App for Bundle Subscribers
The Walt Disney Co. said that it launched Hulu on Disney Plus, which makes Hulu programming available via the Disney Plus app....
28/03/2024
GroupM To Double Ad Spending On Women's Sports Programming
Giant media buyer GroupM said it plans to double its media spending on women's sports....
28/03/2024
Scripps Renews State Farm As Sponsor of Friday Night WNBA on Ion
Scripps Sports said that State Farm has signed a new multi-year agreement to continue as the title sponsor of Ion's Friday night WNBA telecasts....
28/03/2024
Elisabeth Moss, Kerry Washington Sign On for Imperfect Women' on Apple TV Plus
Elisabeth Moss and Kerry Washington will star in, and executive produce, Imperfe...
28/03/2024
Telemundo Station Group Addresses Climate Change With Month-Long Initiative
Telemundo Station Group launches the month-long climate change initiative Our Planet Thursday, March 28. The multiplatform campaign ends on Earth Day, April 22,...
28/03/2024
Circle City Broadcasting Renews Nielsen Ratings Deal
Nielsen said that Circle City Broadcasting, owner of WISH-TV in Indianapolis, has renewed its local TV measurement deal....
28/03/2024
Lionsgate Extends Deal With Seth Rogen's Point Grey Pictures
Lionsgate Television said it extended its deal with Point Grey Pictures, the production company led by Seth Rogen, Evan Goldberg and James Weaver....
28/03/2024
Ariana DeBose Back as Tonys Host
Ariana DeBose returns as host of the Tony Awards Sunday, June 16, on CBS and Paramount Plus. It is her third consecutive time hosting, and it will be the 77th T...
28/03/2024
The Steve Wilkos Show' Renewed for Season 18
The Steve Wilkos Show has been renewed for its 18th season in national syndication, Tracie Wilson, executive VP, NBCUniversal Syndication Studios & E! News, sai...
28/03/2024
Sinclair Selects Embrace as Its Media Orchestration Engine
PARIS Embrace, a developer of advanced automation and orchestration software solutions, has announced that Sinclair Broadcast Group has selected Embrace's P...
28/03/2024
Nielsen and Circle City Broadcasting Renew Local TV Measurement Deal
NEW YORK Nielsen has a multi-year renewal with Circle City Broadcasting, Indianas only locally owned and operated broadcast and digital news media network, for ...
28/03/2024
JVC to Demo Its First Ever 40x Zoom PTZ Camera Series at 2024 NAB Show
LAS VEGAS JVC Professional Video has announced that it will debut its new KY-PZ540 Series PTZ Cameras with 40x zoom at 2024 NAB Show (Booth C4720)....
28/03/2024
Brightcove Launches Cloud Playout 2.0
BOSTON Brightcove has announced the launch of Cloud Playout 2.0, a platform that the company said will offer customers new ways to create linear channels, monet...
28/03/2024
NBC Sports Chicago to Air First-Ever Animated Real-Time Local Sports Telecast
The Chicago Blackhawks and NBC Sports Chicago have announced a collaboration with the NHL to bring fans the first-ever local animated real-time sports telecast....
28/03/2024
The Best News Coverage is Real, Live, Balanced, Professional
The Best News Coverage is Real, Live, Balanced, Professional Andy Marken March 28, 2024 0 Comments Hero image source News of the World, Perfect Wo...
28/03/2024
Get Cozy With Palia' on GeForce NOW
Ease into spring with the warm, cozy vibes of Palia, coming to the cloud this GFN Thursday. It's part of six new titles joining the GeForce NOW library of ...
27/03/2024
Inside the Archives: It's Lights, Curtains, Action When Sundance Films Become Stage Productions
By Jen Scott It's time to unwrap those noisy candies and put your phone on ...
27/03/2024
Sencore and Showfer Announce Collaboration at NAB 2024, With a Brand-New Content Management and Distribution Solution
Las Vegas, NV, April 14-17, Booth W2401 Sencore, a leading provider of profess...
27/03/2024
I Am L3Harris - Sam Bonelli
I'm proud to be a woman in aerospace making an impact on our world and among my peers, team and future generations of women in STEM....
27/03/2024
Bitmovin to Show Live Encoder Running on Akamai Cloud at NAB Show
DENVER Bitmovin has launched its Live Encoder running on the Akamai Cloud Computing, optimizing live streaming and reducing total streaming costs by up to 90%, ...
27/03/2024
Hulu Launches on Disney+
BURBANK, Calif. The Walt Disney Company has officially launched Hulu on Disney+ in the U.S. in a move that brings together the extensive Disney+ and Hulu librar...
27/03/2024
WJLA Studio A Revamp Features Brightline Lighting
WASHINGTON D.C. WJLA, Sinclair Broadcast Group's flagship TV station in the nation's capital, has revamped its Studio A news studio with lighting soluti...
27/03/2024
NCAA: March Madness Sees Strong Audience Growth
The NCAA has released figures showing that the NCAA Division I Men's Basketball Championship and the Division 1 Women's Basketball Championship both saw...
27/03/2024
Mediahaus GmbH Brings SRT Live Streaming to the Mountain Attack with 5G and URSA Broadcast G2
Mediahaus GmbH Brings SRT Live Streaming to the Mountain Attack with 5G and URSA...
27/03/2024
Instant Latte: NVIDIA Gen AI Research Brews 3D Shapes in Under a Second
Instant Latte: NVIDIA Gen AI Research Brews 3D Shapes in Under a Second Isha Salian March 27, 2024 0 Comments The LATTE3D model rapidly transforms tex...
27/03/2024
NAB Show Exhibitor Insight Matrox Video
TV TECH: What do you anticipate will be the most significant technology trends at the 2024 NAB Show? TVT: What will be your most important product news? TVT: Ho...
27/03/2024
CueScript Poised to Transform the Prompting Experience wi...
CueScript, the leading developer of professional teleprompting solutions, is poised to transform the prompting experience with a line-up comprised of world firs...
27/03/2024
BeckTV to Focus on Systems Integration for Sports Venues...
Visit Beck TV at 2024 NAB Show at Booth C4035 BeckTV, a premier systems integrator for the broadcast media industry, will showcase its facility design, enginee...
27/03/2024
Arkona to Introduce BLADE master Control and Orchestratio...
arkona technologies GmbH, provider of IP core infrastructure solutions for top-tier broadcast productions, is cutting through the complexity of live production ...
27/03/2024
KRK Launches ROKIT Generation Five Studio Monitors
As the unwavering cornerstone of professional audio monitoring for over three decades, KRK earned its reputation through a rich history of innovation and precis...
27/03/2024
Join Maxon for NAB 2024
Maxon, developers of professional software solutions for editors, filmmakers, motion designers, visual effects artists, and creators of all types, is excited to...
27/03/2024
OpenDrives Reinvents Media Industry Infrastructure Invest...
OpenDrives, Inc., the global provider of software-defined media workflow solutions and data management capabilities, will unveil its new Atlas platform and busi...
27/03/2024
Pixotope NAB 2024 Virtual Production Showcase Shapes the...
Pixotope, the leading software platform for end-to-end real-time virtual production solutions, is ushering in a new era of immersive storytelling at NAB 2024. A...
27/03/2024
Dolby Atmos-enabled CMP Studio Tackles Immersive Mixing W...
Like many in the industry, Multi-platinum, Award-winning Producer, Engineer, Mixer, Songwriter and Musician Clint Murphy's latest work has been consumed by ...
27/03/2024
Ateliere Creative Technologies Unveils the Future of Medi...
Ateliere Locations: AWS Partner Village W1343 F, W1343 S and Fontainebleau Hotel Contact: Arianna Ruvalcaba, Arianna.Ruvalcaba@ateliere.com Century City, Cal...
27/03/2024
Imagine Enables Unified Control of Hybrid On-prem and Clo...
At the 2024 NAB Show (April 14-17, Las Vegas Convention Center, booth W2467), Imagine Communications is making it easier for media companies to efficiently oper...
27/03/2024
LG Studio Series DVLED Displays Make Virtual Production A...
LG Business Solutions USA, a leading innovator of cutting-edge display technologies, has introduced LG Studio Series DVLED, a new family of advanced giant-scree...
27/03/2024
ZTransform Appoints Bob Hawkanson as SVP of Sales for Nor...
Systems and solutions provider continues team expansion and accelerates nation-wide growth strategy ZTransform, a leading technology systems and solutions pro...
27/03/2024
Appear Showcases Groundbreaking Live Production Technolog...
Appear, the global leader in live production technology, will demonstrate its innovative solutions for contribution, remote production and distribution at NAB S...
27/03/2024
Grass Valley expands PHABRIX T and M inventory with QxP p...
Test & measurement innovator, PHABRIX, has announced that Grass Valley has expanded its already-extensive inventory of PHABRIX test & measurement (T&M) equipmen...
27/03/2024
Arrow Media Targets High-Efficiency Story-Telling with Li...
Arrow Media, an award-winning producer of documentary, factual and non-scripted content, creates high quality programming covering a wide range of subjects. Est...
27/03/2024
Planetcast Expands OTT Solutions with Acquisition of Switch Media
SYDNEY & DELHI Planetcast Media Services, a leading media technology services provider in India and Southeast Asia, has acquired one of its key partners, Switch...
27/03/2024
Sony Pictures Expands its FAST Business
Sony Pictures Entertainment (SPE) has announced plans to launch its portfolio of free, ad-supported streaming television (FAST) channels on LG Channels, Samsung...
27/03/2024
NFL Announces Two Exclusive Streaming Games for 2024 Season
More NFL games will be moving exclusively to streaming in the upcoming 2024 season, with the NFL announcing that both Peacock and Prime Video will have exclusiv...
27/03/2024
Adobe Announces Generative AI Solutions for Content Supply Chain
LAS VEGAS As part of the Adobe Summit, Adobe has announced a number of major product developments that will help companies optimize their entire content supply ...
27/03/2024
Peakto Search, the plugin for Lightroom, which instantly retrieves any photo or video across multiple catalogues
Peakto Search, the plugin for Lightroom, which instantly retrieves any photo or ...
27/03/2024
Nevion announces 100G add-on to its Virtuoso media node
Nevion announces 100G add-on to its Virtuoso media node Brie Clayton March 26, 2024 0 Comments The high-density Virtuoso UplinX can aggregate IP strea...
27/03/2024
Limecraft Highlights Media Intelligence and Real-Time Collaboration for NAB Show 2024
Limecraft Highlights Media Intelligence and Real-Time Collaboration for NAB Show...