Sony Pixel Power calrec Sony

NVIDIA Wins NeurIPS Awards for Research on Generative AI, Generalist AI Agents

28/11/2022

Two NVIDIA Research papers - one exploring diffusion-based generative AI models and another on training generalist AI agents - have been honored with NeurIPS 2022 Awards for their contributions to the field of AI and machine learning.

These are among more than 60+ talks, posters and workshops with NVIDIA authors being presented at the NeurIPs conference, taking place this week in New Orleans and next week online.

Synthetic data generation - for images, text or video - is a key theme across several of the NVIDIA-authored papers. Other topics include reinforcement learning, data collection and augmentation, weather models and federated learning.

AI is an incredibly important technology, and NVIDIA is making fast progress across the gamut - from generative AI to autonomous AI agents, said Jan Kautz, vice president of learning and perception research at NVIDIA. In generative AI, we are not only advancing our theoretical understanding of the underlying models, but are also making practical contributions that will reduce the effort of creating realistic virtual worlds and simulations.

Reimagining the Design of Diffusion-Based Generative Models Diffusion-based models have emerged as a groundbreaking technique for generative AI. NVIDIA researchers won an Outstanding Main Track Paper award for work that analyzes the design of diffusion models, proposing improvements that can dramatically improve the efficiency and quality of these models.

The paper breaks down the components of a diffusion model into a modular design, helping developers identify processes that can be adjusted to improve the performance of the entire model. The researchers show that their modifications enable record scores on a metric that assesses the quality of AI-generated images.

Training Generalist AI Agents in a Minecraft-Based Simulation Suite While researchers have long trained autonomous AI agents in video-game environments such as Starcraft, Dota and Go, these agents are usually specialists in only a few tasks. So NVIDIA researchers turned to Minecraft, the world's most popular game, to develop a scalable training framework for a generalist agent - one that can successfully execute a wide variety of open-ended tasks.

Dubbed MineDojo, the framework enables an AI agent to learn Minecraft's flexible gameplay using a massive online database of more than 7,000 wiki pages, millions of Reddit threads and 300,000 hours of recorded gameplay (shown in image at top). The project won an Outstanding Datasets and Benchmarks Paper Award from the NeurIPS committee.

As a proof of concept, the researchers behind MineDojo created a large-scale foundation model, called MineCLIP, that learned to associate YouTube footage of Minecraft gameplay with the video's transcript, in which the player typically narrates the onscreen action. Using MineCLIP, the team was able to train a reinforcement learning agent capable of performing several tasks in Minecraft without human intervention.

Creating Complex 3D Shapes to Populate Virtual Worlds Also at NeurIPS is GET3D, a generative AI model that instantly synthesizes 3D shapes based on the category of 2D images it's trained on, such as buildings, cars or animals. The AI-generated objects have high-fidelity textures and complex geometric details - and are created in a triangle mesh format used in popular graphics software applications. This makes it easy for users to import the shapes into 3D renderers and game engines for further editing.

Named for its ability to Generate Explicit Textured 3D meshes, GET3D was trained on NVIDIA A100 Tensor Core GPUs using around 1 million 2D images of 3D shapes captured from different camera angles. The model can generate around 20 objects a second when running inference on a single NVIDIA GPU.

The AI-generated objects could be used to populate 3D representations of buildings, outdoor spaces or entire cities - digital spaces designed for industries such as gaming, robotics, architecture and social media.

Improving Inverse Rendering Pipelines With Control Over Materials, Lighting At the most recent CVPR conference, held in New Orleans in June, NVIDIA Research introduced 3D MoMa, an inverse rendering method that enables developers to create 3D objects composed of three distinct parts: a 3D mesh model, materials overlaid on the model, and lighting.

The team has since achieved significant advancements in untangling materials and lighting from the 3D objects - which in turn improves creators' abilities to edit the AI-generated shapes by swapping materials or adjusting lighting as the object moves around a scene.

The work, which relies on a more realistic shading model that leverages NVIDIA RTX GPU-accelerated ray tracing, is being presented as a poster at NeurIPS.

Enhancing Factual Accuracy of Language Models' Generated Text Another accepted paper at NeurIPS examines a key challenge with pretrained language models: the factual accuracy of AI-generated text.

Language models trained for open-ended text generation often come up with text that includes nonfactual information, since the AI is simply making correlations between words to predict what comes next in a sentence. In the paper, NVIDIA researchers propose techniques to address this limitation, which is necessary before such models can be deployed for real-world applications.

The researchers built the first automatic benchmark to measure the factual accuracy of language models for open-ended text generation, and found that bigger language models with billions of parameters were more factual than smaller ones. The team proposed a new technique, factuality-enhanced training, along with a novel sampling algorithm that together help train language models to generate accurate text - and demonstrated a reduction in the rate of factual errors from 33% to around 15%.

There are more th
LINK: https://blogs.nvidia.com/blog/2022/11/28/nvidia-neurips-research/...
See more stories from nvidia

Most recent headlines

01/05/2023

Predicting 2023: Simon shares his thoughts with AAM

Our Chief Executive Simon Redlich was recently invited by Alliance for Audited Media (AAM) to share his views on what 2023 might hold. Read what Simon and other...

31/01/2023

Spotify Reports Fourth Quarter 2022 Earnings

Today, Spotify announced our fourth quarter 2022 financial performance. Click here to review the full earnings release, and take a look at the highlights below:...

31/01/2023

Spotify rapporterar intkter fr fjrde kvartalet 2022

Idag publicerar Spotify sina finansiella resultat f r fj rde kvartalet 2022. Klicka h r f r att ta del av hela den finansiella pressreleasen och kolla in h jdpu...

31/01/2023

Get To Know a New Side of Dr. Harleen Quinzel in DC's Harley Quinn and The Joker: Sound Mind' Podcast

-- -- How did everyone's favorite DC bad girl Harley Quinn get, well, bad...

31/01/2023

Spotify's Artists To Watch Are Primed To Make Moves in 2023

It's always exciting when artists enter the realm of bonafide stardom and bring new sounds and ideas to the music world. And it's even more exciting to ...

31/01/2023

L3Harris included in 2023 Bloomberg Gender-Equality Index

L3Harris will be included in the 2023 Bloomberg Gender Equality Index (GEI), a modified capitalization-weighted index that tracks the performance of public comp...

31/01/2023

All Quiet on the Western Front graded and finished in DaVinci Resolve

All Quiet on the Western Front graded and finished in DaVinci Resolve Brie Clayton January 31, 2023 0 Comments Based on the book of the same name by Er...

31/01/2023

Astrophotography Nebula Fly-through, Part 2

Astrophotography Nebula Fly-through, Part 2 Graham Quince January 31, 2023 0 Comments Take a trip through space, flying past stars to observe amazing n...

31/01/2023

Mediapro to open two new virtual production studios in Spain

The company will invest 3.5 million in the Barcelona production centre, which will feature a 500 m2 studio and 235 m2 of LED paneling By Jenny Priestley Pub...

31/01/2023

ARRI, Rotolight settle patent lawsuits

ARRI no longer contests the validity of Rotolight's patents over its special effects CineSFX patent portfolio in the US, UK and Europe By Jenny Priestley ...

31/01/2023

Meet the head of business development

Accedos Abdul Haleem describes the media tech industry as a roller-coaster ride of ups and downs, and urges everyone to be curious By Jenny Priestley Publish...

31/01/2023

U.S. Digital Commerce Topped $1T for First Time

RESTON, Va. Comscore is reporting that U.S. online retail sales hit a record-breaking milestone in 2022, with digital commerce exceeding $1 trillion in online r...

31/01/2023

Frontier Launches 5 Gig Fiber Internet Service

NORWALK, Conn. Frontier has announced that it has rolled out a 5 Gig internet offering across its entire network, making it the first major ISP to deliver a net...

31/01/2023

Hulu, Fox Ink New Streaming Content Deal

LOS ANGELES Fox Entertainment and Hulu have signed a new multi-year content deal and an extensive multi-platform strategic marketing alliance that will keep Fox...

31/01/2023

Celebration Honors WRAL TechWire Past, Present and Future

A celebration for the 20th Anniversary of WRAL TechWire took place in the WRAL Media Buildings at CBC's Corporate Headquarters in Raleigh on Thursday, Janua...

31/01/2023

Student Spotlight: Cindy Latin

Student Spotlight: Cindy Latin The Berklee NYC songwriter talks about her journey from musical theater to writing songs, getting inspired by the Big Apple, an...

31/01/2023

VEON's Scheme becomes effective

Amsterdam, Netherlands, 31 January 2023 12:30 CET: VEON Ltd. (NASDAQ, Euronext Amsterdam: VEON), a global digital operator that provides converged connectivity ...

31/01/2023

Medical Student Helps New Parents Through Technology

When Benazir Mamytova, a fourth-year medical student in Kazakhstan's Astana, told her parents that she wanted to try her hand at entrepreneurship and IT, th...

31/01/2023

Dolby Is Optimistic About HDR Growth as Fox Sports Preps for HDR Super Bowl Coverage

Dolby Is Optimistic About HDR Growth as Fox Sports Preps for HDR Super Bowl Cove...

31/01/2023

CBS Sports Digital Boosts Studio-Production Ops With Revamped Facilities in Ft. Lauderdale, Stamford

CBS Sports Digital Boosts Studio-Production Ops With Revamped Facilities in Ft. ...

31/01/2023

Habitat XR creates immersive experiences at the new Ellen DeGeneres Campus with Mistika VR

Published On: January 31st, 2023 data-orig-src=https://www.sgo.es/wp-content/u...

31/01/2023

All the New Mobile Games on Netflix in January

Back to All News All the New Mobile Games on Netflix in January Netflix Staff Entertainment 31 January 2023 Global Ubisoft's Valiant Hearts: Coming H...

31/01/2023

eOne to Adapt The Twyford Code

BACKeOne to Adapt The Twyford CodeEntertainment One (eOne) has acquired the rights to Janice Hallett's bestselling novel The Twyford Code. Marking the fi...

31/01/2023

Dalet Enables Business Transformation of Italian Premier Football League

Dalet, a leading technology and service provider for media-rich organizations, and Italian partners EI Towers and CVE announced that the Lega Serie A Lissone-ba...

31/01/2023

Banijay's Mastiff TV Denmark Bolsters its Executive Team

Banijay today announces Mastiff TV Denmark, part of Banijay Nordic, has appointed Cornelius Moulvad as COO and Louise Runge Erichsen as Head of Reality, with bo...

31/01/2023

WATCH: The River - Tonight's teaser E257 S5

WATCH: The River - Tonight's teaser E257 S5Watch tonight's episode of The River and catch the latest episode every weekday at 20:00 on 1 Magic, don'...

31/01/2023

WATCH: 7de Laan - Tonight's teaser E24 S24

WATCH: 7de Laan - Tonight's teaser E24 S24Don't miss out on what's happening on tonight's episode of 7de Laan and Catch the latest episode every...

31/01/2023

WATCH: Diep City - Tonight's teaser E217 S2

WATCH: Diep City - Tonight's teaser E217 S2We've got you covered on what's happening tonight. Episodes of Diep City air on Mzansi Magic from Mondays...

31/01/2023

SKEEM SAAM: Tonight's episode, 31 January 2023 [VIDEO]

SKEEM SAAM: Tonight's episode, 31 January 2023 [VIDEO]Missed an episode of Skeem Saam? No problem! Watch all the latest episodes of Skeem Saam soapie right ...

31/01/2023

Ben Affleck to star in new Michael Jordan documentary AIR

Ben Affleck to star in new Michael Jordan documentary AIR Ben Affleck to portray Nike founder Phil Knight in new film Air , a drama tracing the origins Michae...

31/01/2023

Bridgerton' bombshell: Phoebe Dynevor not returning for season 3

Bridgerton' bombshell: Phoebe Dynevor not returning for season 3Phoebe Dynevor, who played Daphe Bridgerton on Netflix's hit series Bridgerton' wil...

31/01/2023

The search for Miss Drag South Africa 2023 has begun

The search for Miss Drag South Africa 2023 has begunEntries are now open for Miss Drag South Africa 2023, a national queer pageant that espouses the ethos of d...

31/01/2023

RIP: Vusi Ma R5's last moments before getting shot

RIP: Vusi Ma R5's last moments before getting shot I don't know how I'm going to heal from what I saw', says DJ Cooper, who is Itumeleng Mosoeu ...

31/01/2023

Kenya to lay murder charge over killing of LGBTQ activist

Kenya to lay murder charge over killing of LGBTQ activistKenyan prosecutors said they will charge a key suspect with murder over the killing of a prominent LGBT...

31/01/2023

Johnstone: Former All Black rugby player comes out as gay

Johnstone: Former All Black rugby player comes out as gayFormer All Black prop Johnstone says he's decided to come out to help remove the stigma of being ga...

31/01/2023

Comedian Celeste Ntuli bags new show We start 2023 Stronger'

Comedian Celeste Ntuli bags new show We start 2023 Stronger'Popular actress and comedian Celeste Ntuli is host of Mzansi's new financial TV show We st...

31/01/2023

Grammy Awards 2023: Harry Styles and Lizzo set to rock the stage

Grammy Awards 2023: Harry Styles and Lizzo set to rock the stageThe 2023 Grammy Awards is taking place this Sunday and the first round of performers include Har...

31/01/2023

Real Housewives of Durban' S3 LIVE BLOG: All you need to know

Real Housewives of Durban' S3 LIVE BLOG: All you need to knowFollow our LIVE BLOG updates of Real Housewives of Durban' season three while the drama un...

31/01/2023

Real Housewives of Durban': Three bombshells from season two

Real Housewives of Durban': Three bombshells from season twoFrom Annie and LaConco to Jojo throwing a drink at Mabusi, here's three bombshells from Rea...

31/01/2023

Millionaire sportscaster': Robert Marawa's net worth and career

Millionaire sportscaster': Robert Marawa's net worth and careerFrom his show Marawa Sports Worldwide' to his book Gqimm Shelele' and more, her...

31/01/2023

WATCH: Scandal - Tonight's teaser E218 S14

WATCH: Scandal - Tonight's teaser E218 S14Get to know what's happening on tonight's episode!. Scandal episodes airs on e.tv Mondays to Fridays at 19...

31/01/2023

WATCH: Skeem Saam - Tonight's teaser E152 S11

WATCH: Skeem Saam - Tonight's teaser E152 S11Find out what's going on tonight on Skeem Saam!. Skeem Saam episodes airs on SABC1 Mondays to Fridays at 18...

31/01/2023

WATCH: Uzalo - Tonight's teaser E238 S8

WATCH: Uzalo - Tonight's teaser E238 S8Don't get left behind, catch up on Uzalo now! Episodes of Uzalo air on SABC1 from Mondays to Fridays at 20h30. b...

31/01/2023

WATCH: Muvhango - Tonight's teaser E541 S22

WATCH: Muvhango - Tonight's teaser E541 S22Don't miss out on the latest drama in Muvhango! Muvhango episodes airs on SABC2 from Mondays to Fridays at 21...

31/01/2023

WATCH: House of Zwide - Tonight's teaser E142 S2

WATCH: House of Zwide - Tonight's teaser E142 S2Don't miss out on what's happening on tonight's episode of House of Zwide and Catch the latest e...

31/01/2023

WATCH: Imbewu - The Seed, tonight's teaser E208 S5

WATCH: Imbewu - The Seed, tonight's teaser E208 S5Catch up on what's going on to night on Imbewu. Episodes of Imbewu air on e.tv from Mondays to Fridays...

31/01/2023

WATCH: Gomora - Tonight's teaser E202 S3

WATCH: Gomora - Tonight's teaser E202 S3Don't miss out on what's happening on tonight's episode of Gomora, and watch the latest episode every we...

31/01/2023

Pamela, A love story: Overturns stereotypes about victims of abuse

Pamela, A love story: Overturns stereotypes about victims of abusePamela Anderson's Netflix documentary offers one of the greatest lessons, what a victim-su...