Sony Pixel Power calrec Sony

NVIDIA Wins NeurIPS Awards for Research on Generative AI, Generalist AI Agents

28/11/2022

Two NVIDIA Research papers - one exploring diffusion-based generative AI models and another on training generalist AI agents - have been honored with NeurIPS 2022 Awards for their contributions to the field of AI and machine learning.

These are among more than 60+ talks, posters and workshops with NVIDIA authors being presented at the NeurIPs conference, taking place this week in New Orleans and next week online.

Synthetic data generation - for images, text or video - is a key theme across several of the NVIDIA-authored papers. Other topics include reinforcement learning, data collection and augmentation, weather models and federated learning.

AI is an incredibly important technology, and NVIDIA is making fast progress across the gamut - from generative AI to autonomous AI agents, said Jan Kautz, vice president of learning and perception research at NVIDIA. In generative AI, we are not only advancing our theoretical understanding of the underlying models, but are also making practical contributions that will reduce the effort of creating realistic virtual worlds and simulations.

Reimagining the Design of Diffusion-Based Generative Models Diffusion-based models have emerged as a groundbreaking technique for generative AI. NVIDIA researchers won an Outstanding Main Track Paper award for work that analyzes the design of diffusion models, proposing improvements that can dramatically improve the efficiency and quality of these models.

The paper breaks down the components of a diffusion model into a modular design, helping developers identify processes that can be adjusted to improve the performance of the entire model. The researchers show that their modifications enable record scores on a metric that assesses the quality of AI-generated images.

Training Generalist AI Agents in a Minecraft-Based Simulation Suite While researchers have long trained autonomous AI agents in video-game environments such as Starcraft, Dota and Go, these agents are usually specialists in only a few tasks. So NVIDIA researchers turned to Minecraft, the world's most popular game, to develop a scalable training framework for a generalist agent - one that can successfully execute a wide variety of open-ended tasks.

Dubbed MineDojo, the framework enables an AI agent to learn Minecraft's flexible gameplay using a massive online database of more than 7,000 wiki pages, millions of Reddit threads and 300,000 hours of recorded gameplay (shown in image at top). The project won an Outstanding Datasets and Benchmarks Paper Award from the NeurIPS committee.

As a proof of concept, the researchers behind MineDojo created a large-scale foundation model, called MineCLIP, that learned to associate YouTube footage of Minecraft gameplay with the video's transcript, in which the player typically narrates the onscreen action. Using MineCLIP, the team was able to train a reinforcement learning agent capable of performing several tasks in Minecraft without human intervention.

Creating Complex 3D Shapes to Populate Virtual Worlds Also at NeurIPS is GET3D, a generative AI model that instantly synthesizes 3D shapes based on the category of 2D images it's trained on, such as buildings, cars or animals. The AI-generated objects have high-fidelity textures and complex geometric details - and are created in a triangle mesh format used in popular graphics software applications. This makes it easy for users to import the shapes into 3D renderers and game engines for further editing.

Named for its ability to Generate Explicit Textured 3D meshes, GET3D was trained on NVIDIA A100 Tensor Core GPUs using around 1 million 2D images of 3D shapes captured from different camera angles. The model can generate around 20 objects a second when running inference on a single NVIDIA GPU.

The AI-generated objects could be used to populate 3D representations of buildings, outdoor spaces or entire cities - digital spaces designed for industries such as gaming, robotics, architecture and social media.

Improving Inverse Rendering Pipelines With Control Over Materials, Lighting At the most recent CVPR conference, held in New Orleans in June, NVIDIA Research introduced 3D MoMa, an inverse rendering method that enables developers to create 3D objects composed of three distinct parts: a 3D mesh model, materials overlaid on the model, and lighting.

The team has since achieved significant advancements in untangling materials and lighting from the 3D objects - which in turn improves creators' abilities to edit the AI-generated shapes by swapping materials or adjusting lighting as the object moves around a scene.

The work, which relies on a more realistic shading model that leverages NVIDIA RTX GPU-accelerated ray tracing, is being presented as a poster at NeurIPS.

Enhancing Factual Accuracy of Language Models' Generated Text Another accepted paper at NeurIPS examines a key challenge with pretrained language models: the factual accuracy of AI-generated text.

Language models trained for open-ended text generation often come up with text that includes nonfactual information, since the AI is simply making correlations between words to predict what comes next in a sentence. In the paper, NVIDIA researchers propose techniques to address this limitation, which is necessary before such models can be deployed for real-world applications.

The researchers built the first automatic benchmark to measure the factual accuracy of language models for open-ended text generation, and found that bigger language models with billions of parameters were more factual than smaller ones. The team proposed a new technique, factuality-enhanced training, along with a novel sampling algorithm that together help train language models to generate accurate text - and demonstrated a reduction in the rate of factual errors from 33% to around 15%.

There are more th
LINK: https://blogs.nvidia.com/blog/2022/11/28/nvidia-neurips-research/...
See more stories from nvidia

North America Stories

28/03/2024

2024 Big Night In Raises $145k to Support Triangle Arts Councils

Capitol Broadcasting and WRAL-TV once again proudly supported our local arts community with the broadcast of Big Night in for the Arts Thursday, March 7, 2024. ...

28/03/2024

JIC, MRC Announce Accord On Roles In Judging Measurement Companies

With more companies offering different approaches to measuring television viewing and campaign effectiveness, two of the groups that evaluate potential media bu...

28/03/2024

Hulu Added to Disney Plus App for Bundle Subscribers

The Walt Disney Co. said that it launched Hulu on Disney Plus, which makes Hulu programming available via the Disney Plus app....

28/03/2024

GroupM To Double Ad Spending On Women's Sports Programming

Giant media buyer GroupM said it plans to double its media spending on women's sports....

28/03/2024

Scripps Renews State Farm As Sponsor of Friday Night WNBA on Ion

Scripps Sports said that State Farm has signed a new multi-year agreement to continue as the title sponsor of Ion's Friday night WNBA telecasts....

28/03/2024

Elisabeth Moss, Kerry Washington Sign On for Imperfect Women' on Apple TV Plus

Elisabeth Moss and Kerry Washington will star in, and executive produce, Imperfe...

28/03/2024

Telemundo Station Group Addresses Climate Change With Month-Long Initiative

Telemundo Station Group launches the month-long climate change initiative Our Planet Thursday, March 28. The multiplatform campaign ends on Earth Day, April 22,...

28/03/2024

Circle City Broadcasting Renews Nielsen Ratings Deal

Nielsen said that Circle City Broadcasting, owner of WISH-TV in Indianapolis, has renewed its local TV measurement deal....

28/03/2024

Lionsgate Extends Deal With Seth Rogen's Point Grey Pictures

Lionsgate Television said it extended its deal with Point Grey Pictures, the production company led by Seth Rogen, Evan Goldberg and James Weaver....

28/03/2024

Ariana DeBose Back as Tonys Host

Ariana DeBose returns as host of the Tony Awards Sunday, June 16, on CBS and Paramount Plus. It is her third consecutive time hosting, and it will be the 77th T...

28/03/2024

The Steve Wilkos Show' Renewed for Season 18

The Steve Wilkos Show has been renewed for its 18th season in national syndication, Tracie Wilson, executive VP, NBCUniversal Syndication Studios & E! News, sai...

28/03/2024

Sinclair Selects Embrace as Its Media Orchestration Engine

PARIS Embrace, a developer of advanced automation and orchestration software solutions, has announced that Sinclair Broadcast Group has selected Embrace's P...

28/03/2024

Nielsen and Circle City Broadcasting Renew Local TV Measurement Deal

NEW YORK Nielsen has a multi-year renewal with Circle City Broadcasting, Indianas only locally owned and operated broadcast and digital news media network, for ...

28/03/2024

JVC to Demo Its First Ever 40x Zoom PTZ Camera Series at 2024 NAB Show

LAS VEGAS JVC Professional Video has announced that it will debut its new KY-PZ540 Series PTZ Cameras with 40x zoom at 2024 NAB Show (Booth C4720)....

28/03/2024

Brightcove Launches Cloud Playout 2.0

BOSTON Brightcove has announced the launch of Cloud Playout 2.0, a platform that the company said will offer customers new ways to create linear channels, monet...

28/03/2024

NBC Sports Chicago to Air First-Ever Animated Real-Time Local Sports Telecast

The Chicago Blackhawks and NBC Sports Chicago have announced a collaboration with the NHL to bring fans the first-ever local animated real-time sports telecast....

28/03/2024

The Best News Coverage is Real, Live, Balanced, Professional

The Best News Coverage is Real, Live, Balanced, Professional Andy Marken March 28, 2024 0 Comments Hero image source News of the World, Perfect Wo...

28/03/2024

Get Cozy With Palia' on GeForce NOW

Ease into spring with the warm, cozy vibes of Palia, coming to the cloud this GFN Thursday. It's part of six new titles joining the GeForce NOW library of ...

27/03/2024

Inside the Archives: It's Lights, Curtains, Action When Sundance Films Become Stage Productions

By Jen Scott It's time to unwrap those noisy candies and put your phone on ...

27/03/2024

Sencore and Showfer Announce Collaboration at NAB 2024, With a Brand-New Content Management and Distribution Solution

Las Vegas, NV, April 14-17, Booth W2401 Sencore, a leading provider of profess...

27/03/2024

I Am L3Harris - Sam Bonelli

I'm proud to be a woman in aerospace making an impact on our world and among my peers, team and future generations of women in STEM....

27/03/2024

Bitmovin to Show Live Encoder Running on Akamai Cloud at NAB Show

DENVER Bitmovin has launched its Live Encoder running on the Akamai Cloud Computing, optimizing live streaming and reducing total streaming costs by up to 90%, ...

27/03/2024

Hulu Launches on Disney+

BURBANK, Calif. The Walt Disney Company has officially launched Hulu on Disney+ in the U.S. in a move that brings together the extensive Disney+ and Hulu librar...

27/03/2024

WJLA Studio A Revamp Features Brightline Lighting

WASHINGTON D.C. WJLA, Sinclair Broadcast Group's flagship TV station in the nation's capital, has revamped its Studio A news studio with lighting soluti...

27/03/2024

NCAA: March Madness Sees Strong Audience Growth

The NCAA has released figures showing that the NCAA Division I Men's Basketball Championship and the Division 1 Women's Basketball Championship both saw...

27/03/2024

Mediahaus GmbH Brings SRT Live Streaming to the Mountain Attack with 5G and URSA Broadcast G2

Mediahaus GmbH Brings SRT Live Streaming to the Mountain Attack with 5G and URSA...

27/03/2024

Instant Latte: NVIDIA Gen AI Research Brews 3D Shapes in Under a Second

Instant Latte: NVIDIA Gen AI Research Brews 3D Shapes in Under a Second Isha Salian March 27, 2024 0 Comments The LATTE3D model rapidly transforms tex...

27/03/2024

NAB Show Exhibitor Insight Matrox Video

TV TECH: What do you anticipate will be the most significant technology trends at the 2024 NAB Show? TVT: What will be your most important product news? TVT: Ho...

27/03/2024

CueScript Poised to Transform the Prompting Experience wi...

CueScript, the leading developer of professional teleprompting solutions, is poised to transform the prompting experience with a line-up comprised of world firs...

27/03/2024

BeckTV to Focus on Systems Integration for Sports Venues...

Visit Beck TV at 2024 NAB Show at Booth C4035 BeckTV, a premier systems integrator for the broadcast media industry, will showcase its facility design, enginee...

27/03/2024

Arkona to Introduce BLADE master Control and Orchestratio...

arkona technologies GmbH, provider of IP core infrastructure solutions for top-tier broadcast productions, is cutting through the complexity of live production ...

27/03/2024

KRK Launches ROKIT Generation Five Studio Monitors

As the unwavering cornerstone of professional audio monitoring for over three decades, KRK earned its reputation through a rich history of innovation and precis...

27/03/2024

Join Maxon for NAB 2024

Maxon, developers of professional software solutions for editors, filmmakers, motion designers, visual effects artists, and creators of all types, is excited to...

27/03/2024

OpenDrives Reinvents Media Industry Infrastructure Invest...

OpenDrives, Inc., the global provider of software-defined media workflow solutions and data management capabilities, will unveil its new Atlas platform and busi...

27/03/2024

Pixotope NAB 2024 Virtual Production Showcase Shapes the...

Pixotope, the leading software platform for end-to-end real-time virtual production solutions, is ushering in a new era of immersive storytelling at NAB 2024. A...

27/03/2024

Dolby Atmos-enabled CMP Studio Tackles Immersive Mixing W...

Like many in the industry, Multi-platinum, Award-winning Producer, Engineer, Mixer, Songwriter and Musician Clint Murphy's latest work has been consumed by ...

27/03/2024

Ateliere Creative Technologies Unveils the Future of Medi...

Ateliere Locations: AWS Partner Village W1343 F, W1343 S and Fontainebleau Hotel Contact: Arianna Ruvalcaba, Arianna.Ruvalcaba@ateliere.com Century City, Cal...

27/03/2024

Imagine Enables Unified Control of Hybrid On-prem and Clo...

At the 2024 NAB Show (April 14-17, Las Vegas Convention Center, booth W2467), Imagine Communications is making it easier for media companies to efficiently oper...

27/03/2024

LG Studio Series DVLED Displays Make Virtual Production A...

LG Business Solutions USA, a leading innovator of cutting-edge display technologies, has introduced LG Studio Series DVLED, a new family of advanced giant-scree...

27/03/2024

ZTransform Appoints Bob Hawkanson as SVP of Sales for Nor...

Systems and solutions provider continues team expansion and accelerates nation-wide growth strategy ZTransform, a leading technology systems and solutions pro...

27/03/2024

Appear Showcases Groundbreaking Live Production Technolog...

Appear, the global leader in live production technology, will demonstrate its innovative solutions for contribution, remote production and distribution at NAB S...

27/03/2024

Grass Valley expands PHABRIX T and M inventory with QxP p...

Test & measurement innovator, PHABRIX, has announced that Grass Valley has expanded its already-extensive inventory of PHABRIX test & measurement (T&M) equipmen...

27/03/2024

Arrow Media Targets High-Efficiency Story-Telling with Li...

Arrow Media, an award-winning producer of documentary, factual and non-scripted content, creates high quality programming covering a wide range of subjects. Est...

27/03/2024

Planetcast Expands OTT Solutions with Acquisition of Switch Media

SYDNEY & DELHI Planetcast Media Services, a leading media technology services provider in India and Southeast Asia, has acquired one of its key partners, Switch...

27/03/2024

Sony Pictures Expands its FAST Business

Sony Pictures Entertainment (SPE) has announced plans to launch its portfolio of free, ad-supported streaming television (FAST) channels on LG Channels, Samsung...

27/03/2024

NFL Announces Two Exclusive Streaming Games for 2024 Season

More NFL games will be moving exclusively to streaming in the upcoming 2024 season, with the NFL announcing that both Peacock and Prime Video will have exclusiv...

27/03/2024

Adobe Announces Generative AI Solutions for Content Supply Chain

LAS VEGAS As part of the Adobe Summit, Adobe has announced a number of major product developments that will help companies optimize their entire content supply ...

27/03/2024

Peakto Search, the plugin for Lightroom, which instantly retrieves any photo or video across multiple catalogues

Peakto Search, the plugin for Lightroom, which instantly retrieves any photo or ...

27/03/2024

Nevion announces 100G add-on to its Virtuoso media node

Nevion announces 100G add-on to its Virtuoso media node Brie Clayton March 26, 2024 0 Comments The high-density Virtuoso UplinX can aggregate IP strea...

27/03/2024

Limecraft Highlights Media Intelligence and Real-Time Collaboration for NAB Show 2024

Limecraft Highlights Media Intelligence and Real-Time Collaboration for NAB Show...