Sony Pixel Power calrec Sony

Mile-High AI: NVIDIA Research to Present Advancements in Simulation and Gen AI at SIGGRAPH

12/07/2024

NVIDIA is taking an array of advancements in rendering, simulation and generative AI to SIGGRAPH 2024, the premier computer graphics conference, which will take place July 28 Aug. 1 in Denver.

More than 20 papers from NVIDIA Research introduce innovations advancing synthetic data generators and inverse rendering tools that can help train next-generation models. NVIDIA's AI research is making simulation better by boosting image quality and unlocking new ways to create 3D representations of real or imagined worlds.

The papers focus on diffusion models for visual generative AI, physics-based simulation and increasingly realistic AI-powered rendering. They include two technical Best Paper Award winners and collaborations with universities across the U.S., Canada, China, Israel and Japan as well as researchers at companies including Adobe and Roblox.

These initiatives will help create tools that developers and businesses can use to generate complex virtual objects, characters and environments. Synthetic data generation can then be harnessed to tell powerful visual stories, aid scientists' understanding of natural phenomena or assist in simulation-based training of robots and autonomous vehicles.

Diffusion Models Improve Texture Painting, Text-to-Image Generation Diffusion models, a popular tool for transforming text prompts into images, can help artists, designers and other creators rapidly generate visuals for storyboards or production, reducing the time it takes to bring ideas to life.

Two NVIDIA-authored papers are advancing the capabilities of these generative AI models.

ConsiStory, a collaboration between researchers at NVIDIA and Tel Aviv University, makes it easier to generate multiple images with a consistent main character - an essential capability for storytelling use cases such as illustrating a comic strip or developing a storyboard. The researchers' approach introduces a technique called subject-driven shared attention, which reduces the time it takes to generate consistent imagery from 13 minutes to around 30 seconds.

ConsiStory is capable of generating a series of images featuring the same character. NVIDIA researchers last year won the Best in Show award at SIGGRAPH's Real-Time Live event for AI models that turn text or image prompts into custom textured materials. This year, they're presenting a paper that applies 2D generative diffusion models to interactive texture painting on 3D meshes, enabling artists to paint in real time with complex textures based on any reference image.

Kick-Starting Developments in Physics-Based Simulation Graphics researchers are narrowing the gap between physical objects and their virtual representations with physics-based simulation - a range of techniques to make digital objects and characters move the same way they would in the real world.

Several NVIDIA Research papers feature breakthroughs in the field, including SuperPADL, a project that tackles the challenge of simulating complex human motions based on text prompts (see video at top).

Using a combination of reinforcement learning and supervised learning, the researchers demonstrated how the SuperPADL framework can be trained to reproduce the motion of more than 5,000 skills - and can run in real time on a consumer-grade NVIDIA GPU.

Another NVIDIA paper features a neural physics method that applies AI to learn how objects - whether represented as a 3D mesh, a NeRF or a solid object generated by a text-to-3D model - would behave as they are moved in an environment.

https://blogs.nvidia.com/wp-content/uploads/2024/07/Simplicits.mp4

A paper written in collaboration with Carnegie Mellon University researchers develops a new kind of renderer - one that, instead of modeling physical light, can perform thermal analysis, electrostatics and fluid mechanics. Named one of five best papers at SIGGRAPH, the method is easy to parallelize and doesn't require cumbersome model cleanup, offering new opportunities for speeding up engineering design cycles.

In the example above, the renderer performs a thermal analysis of the Mars Curiosity rover, where keeping temperatures within a specific range is critical to mission success.

Additional simulation papers introduce a more efficient technique for modeling hair strands and a pipeline that accelerates fluid simulation by 10x.

Raising the Bar for Rendering Realism, Diffraction Simulation Another set of NVIDIA-authored papers present new techniques to model visible light up to 25x faster and simulate diffraction effects - such as those used in radar simulation for training self-driving cars - up to 1,000x faster.

A paper by NVIDIA and University of Waterloo researchers tackles free-space diffraction, an optical phenomenon where light spreads out or bends around the edges of objects. The team's method can integrate with path-tracing workflows to increase the efficiency of simulating diffraction in complex scenes, offering up to 1,000x acceleration. Beyond rendering visible light, the model could also be used to simulate the longer wavelengths of radar, sound or radio waves.

Simulation of cellular signal coverage in a city. Path tracing samples numerous paths - multi-bounce light rays traveling through a scene - to create a photorealistic picture. Two SIGGRAPH papers improve sampling quality for ReSTIR, a path-tracing algorithm first introduced by NVIDIA and Dartmouth College researchers at SIGGRAPH 2020 that has been key to bringing path tracing to games and other real-time rendering products.

One of these papers, a collaboration with the University of Utah, shares a new way to reuse calculated paths that increases effective sample count by up to 25x, significantly boosting image quality. The other improves sample quality by randomly mutating a subset of the light's path. This helps denoising algorithms perform be
LINK: https://blogs.nvidia.com/blog/siggraph-2024-ai-graphics-research/...
See more stories from nvidia

North America Stories

04/06/2026

Sony's New PTZ Cameras Deliver 4K 60p; New STARVIS Sensor Meets Low-Light Demands

Sony Electronics is introducing the SRG-AS10, a 4K 60p-compatible PTZ auto-frami...

04/06/2026

SVG Students To Watch: Alex Albert, Texas A&M University

This recent grad from Spring, TX, led creative-video output for the Aggies' men's basketball team last season and has been producing video and creating ...

04/06/2026

USGA Brings AI Recaps, 3D Range Tracking, and Predictive Shot Tracing to U.S. Womens Open

For the first time at a women's golf major, every player in the field will r...

04/06/2026

Panasonic PT-RQ45 Projectors Power Lille Video Mapping Festival Opera House Installation

Three Panasonic PT-RQ45 40,000-lumen 3-Chip DLP projectors made their first live...

04/06/2026

Bitmovin and Akamai Support NRJ Groups Deployment of Akamai Adaptive Media Player 2

Bitmovin and Akamai have announced a collaboration with NRJ Group, a French mult...

04/06/2026

Telestream to Exhibit at InfoComm 2026 with Live Production and Media Workflow Demonstrations

Telestream will exhibit at InfoComm 2026 (Booth N7952), demonstrating media work...

04/06/2026

Sony Announces RIALTO 65 Image Sensor Block for VENICE 2, Targeting 2027 Release

Sony has announced the development of RIALTO 65, a 65mm format image sensor block for the VENICE 2 digital cinema camera, targeting release in the first half of...

04/06/2026

KOKUSAI DENKI Electric America to Exhibit 4K and Remote Production Solutions at InfoComm 2026

KOKUSAI DENKI Electric America will exhibit at InfoComm 2026 (Booth N8025, June ...

04/06/2026

Bell Media to Carry All 104 FIFA World Cup 2026 Matches Across TSN, RDS, and Streaming Platforms

Bell Media's TSN and RDS are the exclusive Canadian broadcasters of FIFA Wor...

04/06/2026

MASV Case Study: How MASV Reduced Miami HEAT's Road Game Video Transfer Times by 85%

The Challenge: Receiving Heavy Media Files From Road Games Quickly and ReliablyT...

04/06/2026

MASV Outlines Seven-Step Sports Analytics Workflow, Highlights File Transfer as Key Bottleneck

MASV, a managed file transfer platform used in broadcast and live sports product...

04/06/2026

NESN Appoints Fahad Haider as Vice President of Operations and Engineering

NESN has announced the appointment of Fahad Haider as Vice President of Operations and Engineering. Haider returns to NESN, where he previously served as Vice P...

04/06/2026

Sports Broadcaster, Executive, and Author David J. Halberstam Dies

David J. Halberstam, who spent almost 50 years in sports as a broadcaster and an executive, died June 2 after a years-long battle with brain cancer. Over his l...

04/06/2026

Grass Valleys Ben Dolinky on Offering Teachable Technology to College Students Across the Country

Although collegiate production programs are tasked with delivering high-quality ...

04/06/2026

Prime Video Caps First NBA Season With Sports Emmy Win, Carries In-House Production Into WNBA Campaign

California studio, two production trucks, global distribution system are combine...

04/06/2026

TikTok and Sundance Collab Launch Micro-Series Storytelling Program

New global program empowers and supports storytellers through scriptwriting course and access to industry experts TikTok and Sundance Institute today announce...

04/06/2026

TiVo: TV Viewing Hits Post-Pandemic Peak

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

Bitmovin and Akamai Support NRJ Group to Deploy Next Gene...

Bitmovin, a leading provider of video streaming infrastructure, and Akamai, the cybersecurity and cloud computing company that powers and protects business onli...

04/06/2026

American Underground Opens at American Tobacco Campus, Completing a 16-Year Full-Circle Story

American Underground (AU), the Startup Hub of the South and a community of mor...

04/06/2026

Nielsen: Thunder Rolls as NBA's Most-Watched Team

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

AI Drives Lenovo's 2026 FIFA World Cup Broadcast Plans

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

ATSC Conference Looks Beyond Traditional TV for 3.0 Success

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

ATSC Awards Highest Technical Honor to Julia Kenyon

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

Lumine Group to Acquire Synamedias Video Network Business

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

BFOA Launches 5th Annual Giving Day

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

Hemisphere Media Group Brings WAPA+ Fast Channel to Prime Video

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

APTS to Hold June 4 'Protect My Public Media Day'

Share Copy link Facebook X Linkedin Bluesky Email...

04/06/2026

NVIDIA and Microsoft Reinvent Windows PCs for the Age of Personal AI

NVIDIA and Microsoft Reinvent Windows PCs for the Age of Personal AI Brie Clayton June 3, 2026 0 Comments RTX Spark - a 1-Petaflop Superchip, the Full...

04/06/2026

Inside the Peaky Blinders: The Immortal Man Grade

Inside the Peaky Blinders: The Immortal Man Grade Brie Clayton June 3, 2026 0 Comments Simone Grattarola discusses shaping the look in DaVinci Resolve...

04/06/2026

Cine Gear Expo Announces 2026 Awards of Excellence Recipients

Cine Gear Expo Announces 2026 Awards of Excellence Recipients Brie Clayton June 3, 2026 0 Comments Ed Lachman ASC, Caleb Deschanel ASC, and M. David M...

04/06/2026

St. Vincents Live with Orchestra Tour to Feature Berklee Alum Ruby Plume

St. Vincents Live with Orchestra Tour to Feature Berklee Alum Ruby Plume Berklee alumni St. Vincent and Ruby Plume will appear on the same bill across seven d...

04/06/2026

'All the Truth in My Lies' Coming to Netflix on August 28

Back to All News All the Truth in My Lies Coming to Netflix on August 28 Entertainment 04 June 2026 GlobalSpain Link copied to clipboard Download the imag...

04/06/2026

Larry Tanz, VP of Content, EMEA, Delivers a Keynote Speech at the Enders TMT Leaders Live 2026 Conference

Back to All News Larry Tanz, VP of Content, EMEA, Delivers a Keynote Speech at ...

04/06/2026

Turn Your Living Room into a Stadium With the New FIFA World Cup: Launch Edition' Game, Exclusively on Netflix Games June 11

Back to All News Turn Your Living Room into a Stadium With the New FIFA World ...

04/06/2026

Keeping conversations real on LinkedIn

Keeping conversations real on LinkedIn Published on Jun 4, 2026 Categories: Product News LinkedIn Corporate Communications Share LinkedIn Facebook ...

04/06/2026

Forecast: Fun Ahead - 18 Games Join in June to Stream on GeForce NOW

June's forecast with GeForce NOW: 100% chance of gaming. GeForce NOW is lining up new adventures for the month, from big-name blockbusters to quirky indies...

03/06/2026

SES Launches Multi-Orbit Satellite Inflight Connectivity on Viva Airlines

SES and Viva, Mexico's ultra low-cost airline, have launched multi-orbit satellite inflight connectivity on Viva's Airbus aircraft. A total of 60 A320s ...

03/06/2026

CFP, ESPN, and TNT Sports Announce 2026-27 College Football Playoff Broadcast Schedule

The College Football Playoff, ESPN, and TNT Sports have announced kick times and...

03/06/2026

RED Digital Cinema to Host Panels and Demos at Cine Gear Expo 2026

RED Digital Cinema will exhibit at Cine Gear Expo 2026 (Booth 33, June 5-6, Universal Studios Lot), hosting three panels and hands-on product demonstrations. P...

03/06/2026

Roku Launches Soccer Zone for FIFA World Cup 2026

Roku has announced the Soccer Zone, a dedicated hub for FIFA World Cup 2026 content available across the United States, Canada, Mexico, Brazil, Colombia, Argent...

03/06/2026

Liverpool FC and Wasabi Technologies Renew Multi-Year Partnership

Liverpool FC and Wasabi Technologies have announced a multi-year extension of their partnership, with Wasabi continuing as the club's official cloud storage...

03/06/2026

Sky News Australia Deploys Grass Valley AMPP for Cloud-Based Newsroom Production

Grass Valley has announced that Australian News Channel (ANC), operator of Sky News Australia, has deployed Grass Valley AMPP as part of the relocation of its n...

03/06/2026

Gudrun Scharler Appointed CEO of Riedel Networks

The Riedel Group has announced the appointment of Gudrun Scharler as CEO of Riedel Networks. She succeeds Michael Martens, who has led Riedel Networks since 201...

03/06/2026

Clear-Com Deploys Arcadia Central Station and FreeSpeak II at Itaka Arena in Poland

Clear-Com has announced the deployment of its intercom solutions at Itaka Arena ...

03/06/2026

Scott Coker Announces Six Executive Hires for New MMA Promotion

Scott Coker has announced six senior executive appointments for his new global MMA promotion, which launched earlier this year with $60 million in financing. Ad...

03/06/2026

Telemundo Announces Digital and Social Media Plans for FIFA World Cup 2026

Telemundo, the exclusive Spanish-language home of the FIFA World Cup 2026, has announced its digital and social media programming for the tournament, running Ju...

03/06/2026

Bundesliga Launches AI Assistant 'Captain' in Official App, Developed With AWS

The Bundesliga has announced the launch of Captain, an AI assistant built into t...

03/06/2026

Anthony James Partners Serving as Technology Consultant for UNC Kenan Stadium Modernization

Anthony James Partners (AJP) is serving as technology consultant for a moderniza...

03/06/2026

Audio-Technica Presents 2025-26 Samurai and Presidents Awards

Audio-Technica has announced the recipients of its annual sales rep firm awards for the 2025-26 fiscal year. The awards were presented by Jim Schanz, Executive ...