Sony Pixel Power calrec Sony

Mile-High AI: NVIDIA Research to Present Advancements in Simulation and Gen AI at SIGGRAPH

13/07/2024

Mile-High AI: NVIDIA Research to Present Advancements in Simulation and Gen AI at SIGGRAPH

Aaron Lefohn July 12, 2024

0 Comments

In Denver, NVIDIA researchers will share how simulation research is improving AI models - and how AI models are improving simulation technology.

NVIDIA is taking an array of advancements in rendering, simulation and generative AI to SIGGRAPH 2024, the premier computer graphics conference, which will take place July 28 Aug. 1 in Denver.

More than 20 papers from NVIDIA Research introduce innovations advancing synthetic data generators and inverse rendering tools that can help train next-generation models. NVIDIA's AI research is making simulation better by boosting image quality and unlocking new ways to create 3D representations of real or imagined worlds.

The papers focus on diffusion models for visual generative AI, physics-based simulation and increasingly realistic AI-powered rendering. They include two technical Best Paper Award winners and collaborations with universities across the U.S., Canada, China, Israel and Japan as well as researchers at companies including Adobe and Roblox.

These initiatives will help create tools that developers and businesses can use to generate complex virtual objects, characters and environments. Synthetic data generation can then be harnessed to tell powerful visual stories, aid scientists' understanding of natural phenomena or assist in simulation-based training of robots and autonomous vehicles.

Some contents or functionalities here are not available due to your cookie preferences!

This happens because the functionality/content marked as Vimeo framework uses cookies that you choosed to keep disabled. In order to view this content or use this functionality, please enable cookies: click here to open your cookie preferences.

Diffusion Models Improve Texture Painting, Text-to-Image Generation Diffusion models, a popular tool for transforming text prompts into images, can help artists, designers and other creators rapidly generate visuals for storyboards or production, reducing the time it takes to bring ideas to life.

Two NVIDIA-authored papers are advancing the capabilities of these generative AI models.

ConsiStory, a collaboration between researchers at NVIDIA and Tel Aviv University, makes it easier to generate multiple images with a consistent main character - an essential capability for storytelling use cases such as illustrating a comic strip or developing a storyboard. The researchers' approach introduces a technique called subject-driven shared attention, which reduces the time it takes to generate consistent imagery from 13 minutes to around 30 seconds.

NVIDIA researchers last year won the Best in Show award at SIGGRAPH's Real-Time Live event for AI models that turn text or image prompts into custom textured materials. This year, they're presenting a paper that applies 2D generative diffusion models to interactive texture painting on 3D meshes, enabling artists to paint in real time with complex textures based on any reference image.

Kick-Starting Developments in Physics-Based Simulation Graphics researchers are narrowing the gap between physical objects and their virtual representations with physics-based simulation - a range of techniques to make digital objects and characters move the same way they would in the real world.

Several NVIDIA Research papers feature breakthroughs in the field, including SuperPADL, a project that tackles the challenge of simulating complex human motions based on text prompts.

Some contents or functionalities here are not available due to your cookie preferences!

This happens because the functionality/content marked as Vimeo framework uses cookies that you choosed to keep disabled. In order to view this content or use this functionality, please enable cookies: click here to open your cookie preferences.

Using a combination of reinforcement learning and supervised learning, the researchers demonstrated how the SuperPADL framework can be trained to reproduce the motion of more than 5,000 skills - and can run in real time on a consumer-grade NVIDIA GPU.

Another NVIDIA paper features a neural physics method that applies AI to learn how objects - whether represented as a 3D mesh, a NeRF or a solid object generated by a text-to-3D model - would behave as they are moved in an environment.

A paper written in collaboration with Carnegie Mellon University researchers develops a new kind of renderer - one that, instead of modeling physical light, can perform thermal analysis, electrostatics and fluid mechanics. Named one of five best papers at SIGGRAPH, the method is easy to parallelize and doesn't require cumbersome model cleanup, offering new opportunities for speeding up engineering design cycles.

Additional simulation papers introduce a more efficient technique for modeling hair strands and a pipeline that accelerates fluid simulation by 10x.

Raising the Bar for Rendering Realism, Diffraction Simulation Another set of NVIDIA-authored papers present new techniques to model visible light up to 25x faster and simulate diffraction effects - such as those used in radar simulation for training self-driving cars - up to 1,000x faster.

A paper by NVIDIA and University of Waterloo researchers tackles free-space diffraction, an optical phenomenon where light spreads out or bends around the edges of objects. The team's method can integrate with path-tracing workflows to increase the efficiency of simulating diffraction in complex scenes, offering up to 1,000x acceleration. Beyond rendering visible light, the model could also be used to simulate the longer wavelengths of radar, sound or radio waves.

Path tracing samples numerous paths - multi-bounce light rays traveling through a scene - to create a photorealistic picture. Two SIGGRAPH papers imp
LINK: https://creativecow.net/mile-high-ai-nvidia-research-to-present-advanc...
See more stories from creativecow

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

18/11/2026

Spectrum News Streamlines Workflow With Amagi

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Media Links Joins Panasonic Kairos Partner Program

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Signiant Acquires Burnlab's Ceivo AI-Driven Media Platform

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Democrats Urge Delay of Thumann Severs FCC Confirmation

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Hisong Unveils AirStudio Muse Audio Capture System

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Spectrum Reach Taps Debbie Presser to Lead Sales at AdLink New York

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

Nationwide EAS Test Runs Without Apparent Hiccups

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

18/11/2026

SMPTE Identifies Key Requirements for Content Provenance...

SMPTE, the home for media professionals, technologists and engineers, today announced the publication of an engineering report with the summarized results of an...

17/11/2026

Fabric Insights and Fonn Group Partner to Connect Newsroom Planning and Media Operations

Fabric Insights and Fonn Group have announced a partnership to connect editorial...

17/11/2026

NABJ Online Seminar Highlights Black Sports Production Legends on Nov. 25

The National Association of Black Journalists is offering up a Thanksgiving Eve treat on Wednesday, Nov. 25, in the form of a live streaming event featuring for...

17/11/2026

Bridge Technologies Adds Apple ProRes Support to VB440 Production Probe

Bridge Technologies has announced that its VB440 production probe now supports both monitoring and signal generation for Apple ProRes video streams. The additio...

17/11/2026

Canon U.S.A. Hosts Jericho High School Journalism Students at Melville Headquarters

Canon U.S.A., Inc. recently welcomed 21 Jericho High School students to its Melv...

17/11/2026

Amagi to Power Live Newscasts for Spectrum News

Spectrum News has deployed the Amagi platform to support its live news operations. Amagi says the platform lets Spectrum News streamline newsroom workflows, red...

17/11/2026

Microsoft Expands Haivision Video Contribution Deployment, Adds Makito ONE for Global Live Events

Microsoft has expanded its use of Haivision's live video contribution ecosys...

17/11/2026

Setanta Sports Deploys Ateme TITAN Live for OTT Sports Streaming

Setanta Sports has deployed Ateme's TITAN Live platform to support its OTT video delivery operations. Ateme's transcoding technology is integrated into ...

17/11/2026

Media Links Joins Panasonic's KAIROS Alliance Partner Program

Media Links has joined the KAIROS Alliance Partner program for Panasonic's KAIROS IT/IP live video production platform. The company completed interoperabili...

17/11/2026

Behind The Mic: Dan Hicks, Iconic NBC Sports Broadcaster, Passes Away at 64

Behind The Mic provides a roundup of recent news regarding on-air talent, including new deals, departures, and assignments compiled from press releases and repo...

17/11/2026

2026 Sports Broadcasting Hall of Fame: Jim Dove, an Innovator Offering Second Looks at the Greatest Plays in Sports

In live sports and in life, things go by in the blink of an eye. Savoring the mo...

17/11/2026

SVG Sit-Down: Eutelsat's Gonzalez, Carroccia on C-Band Clearing, LEO Contribution, the Future of Satellite in Sports

Satellite operators are adding a new generation of low-Earth-orbit (LEO) network...

17/11/2026

Clear-Com Delivers Portable Wireless Systems for Aircraft Communications Security Testing

Clear-Com has delivered five customized test systems for electromagnetic securit...

17/11/2026

Stephen Arnold Music Creates Sonic Identity for WTGL

Stephen Arnold Music (SAM) has created the sonic identity for WTGL, the women's team golf league from TMRW Sports, created in partnership with the LPGA and ...

17/11/2026

PAMA Introduces Give Sound a Voice Initiative to Promote the Value of Sound

The Professional Audio Manufacturers Alliance (PAMA) has introduced Give Sound a Voice, an initiative aimed at raising awareness of the value of sound among the...

17/11/2026

Fanatics Studios Names Jamal Henderson First President of Film & TV

Fanatics Studios, the sports entertainment joint venture between Fanatics and OBB, has named Jamal Henderson its first President of Film & TV, announced Michael...

17/11/2026

NFL Thanksgiving Week Halftime Shows to Feature U2, Wu-Tang Clan, Miranda Lambert and Goo Goo Dolls

The NFL's Thanksgiving Week games will feature halftime performances by U2, ...

17/11/2026

FanSided Launches Redesigned App with Live Scores and Personalized Feeds

FanSided, a Minute brand with more than 250 fan communities, has launched a redesigned mobile app that combines team news, analysis, live game coverage, stats a...

17/11/2026

Major League Volleyball Announces 2027 Media Lineup with NBC Sports, ESPN, ION and CBS Sports

Major League Volleyball (MLV), the longest-running indoor professional volleybal...

17/11/2026

Prime Video to Present Black Friday Sports Lineup in 200+ Countries, No Subscription Required

Prime Video will present a 15-hour slate of live sports on Black Friday, Nov. 27...

17/11/2026

DIOR X SUNDANCE INSTITUTE PARTNERSHIP ANNOUNCED AHEAD OF 2027 SUNDANCE FILM FESTIVAL

Catherine Dior was more than a muse. A Resistance fighter, a survivor of deporta...

17/11/2026

Freqport introduce FreqLift plug-in

Multiband dynamics plug-in boasts FT1 integration Freqport's latest plug-in combines multiband upward and downward dynamics with the company's renow...

17/11/2026

Studio 5X: Debut monitors from Teufel Audio

Hi-fi experts launch two pro-audio models Berlin-based hi-fi experts Teufel Audio have recently branched out into the pro-audio world with their first pairs...

17/11/2026

EastWest Black Friday 2026

A year of ComposerCloud+ for $99 EastWest's annual Black Friday Sale is already live, and new users are being offered one year of the all-encompassing C...

17/11/2026

SOS Awards: Make Your Vote Count!

Pick your favourite gear from 2026 The annual SOS Awards are now underway, and as always, we're asking readers to help us choose the best pro-audio rele...

17/11/2026

Production capacity expanded at SGL Carbons Ried im Innkreis site

As part of an ongoing series production program for a German automaker, production capacity has been increased at SGL Carbon's Austrian site in Ried im Innk...

17/11/2026

Clear-Com Delivers Portable Wireless Systems for Secure Aircraft Communications Testing

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

17/11/2026

Signiant Acquires Media Intelligence Technology

Signiant has acquired the media intelligence technology, Ceivo, developed by Burnlab with founder Aaron Sloman joining the company as Vice President, Product Ma...

17/11/2026

Broadcasters to Conduct EAS Test Today

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

Microsoft Taps Haivision Contribution, Video Transport Solutions for Live Events

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

NAB Promotes Broadcast Positioning System Amid Tech Outages

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

Colorfront's Color Management Added to RED Camera Feeds

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

Berklees 2027 Alumni Grammy Nominees: See the Full List

Berklees 2027 Alumni Grammy Nominees: See the Full List From pop and R&B to jazz, musical theater, and video game scores, Berklee talent is represented across...

17/11/2026

Sinclair's Bill Fanshawe Sets Retirement

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

WCVB Boston Names Michael Murgia Director of Engineering

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

17/11/2026

Two Scripps Research faculty named inaugural recipients of the Schultz Innovative Investigator Award

LA JOLLA, CA-Two Scripps Research faculty, Assistant Professor Christian Diercks...

17/11/2026

Synthogy Black Friday Savings - 33% on ALL Ivory 3 products

Our Biggest Sale of the Year on Ivory 3! From November 17th through November 30th, enjoy our best savings of the year on Ivory 3 Products! Whether it's ou...

17/11/2026

Sky announces major free upgrade to the Sky Glass and Sky Stream experience with the launch of the new Sky OS

Tuesday 17 November 2026 Sky announces major free upgrade to the Sky Glass and ...

17/11/2026

Passion, Betrayal and Scandal: Sky Arts Reveals the Man Behind the Music in Dangerous Debussy, Premiering 1 December

Tuesday 17 November 2026 Passion, Betrayal and Scandal: Sky Arts Reveals the Ma...

17/11/2026

Exact 3D Video launches AI service that turns product documents and CAD files into narrated 3D explainer videos

Exact 3D Video, a web service based in Japan, has launched its English version, ...

17/11/2026

Apple Podcasts names Baby, this is Keke\u00A0Palmer the 2026 Show of the Year - UPDATE - Posted on 17 November 2026

Today, Apple Podcasts named Baby, this is Keke Palmer its Show of the Year, hono...

17/11/2026

Ian Buck Kicks Off NVIDIA's Week at SC26 as Science Enters the Age of Agents

NVIDIA's Ian Buck kicked off the company's week at SC26 in Chicago on Monday with new tools for AI agents, software that can plan experiments, run code ...