
Mile-High AI: NVIDIA Research to Present Advancements in Simulation and Gen AI at SIGGRAPH
Aaron Lefohn July 12, 2024
0 Comments
In Denver, NVIDIA researchers will share how simulation research is improving AI models - and how AI models are improving simulation technology.
NVIDIA is taking an array of advancements in rendering, simulation and generative AI to SIGGRAPH 2024, the premier computer graphics conference, which will take place July 28 Aug. 1 in Denver.
More than 20 papers from NVIDIA Research introduce innovations advancing synthetic data generators and inverse rendering tools that can help train next-generation models. NVIDIA's AI research is making simulation better by boosting image quality and unlocking new ways to create 3D representations of real or imagined worlds.
The papers focus on diffusion models for visual generative AI, physics-based simulation and increasingly realistic AI-powered rendering. They include two technical Best Paper Award winners and collaborations with universities across the U.S., Canada, China, Israel and Japan as well as researchers at companies including Adobe and Roblox.
These initiatives will help create tools that developers and businesses can use to generate complex virtual objects, characters and environments. Synthetic data generation can then be harnessed to tell powerful visual stories, aid scientists' understanding of natural phenomena or assist in simulation-based training of robots and autonomous vehicles.
Some contents or functionalities here are not available due to your cookie preferences!
This happens because the functionality/content marked as Vimeo framework uses cookies that you choosed to keep disabled. In order to view this content or use this functionality, please enable cookies: click here to open your cookie preferences.
Diffusion Models Improve Texture Painting, Text-to-Image Generation Diffusion models, a popular tool for transforming text prompts into images, can help artists, designers and other creators rapidly generate visuals for storyboards or production, reducing the time it takes to bring ideas to life.
Two NVIDIA-authored papers are advancing the capabilities of these generative AI models.
ConsiStory, a collaboration between researchers at NVIDIA and Tel Aviv University, makes it easier to generate multiple images with a consistent main character - an essential capability for storytelling use cases such as illustrating a comic strip or developing a storyboard. The researchers' approach introduces a technique called subject-driven shared attention, which reduces the time it takes to generate consistent imagery from 13 minutes to around 30 seconds.
NVIDIA researchers last year won the Best in Show award at SIGGRAPH's Real-Time Live event for AI models that turn text or image prompts into custom textured materials. This year, they're presenting a paper that applies 2D generative diffusion models to interactive texture painting on 3D meshes, enabling artists to paint in real time with complex textures based on any reference image.
Kick-Starting Developments in Physics-Based Simulation Graphics researchers are narrowing the gap between physical objects and their virtual representations with physics-based simulation - a range of techniques to make digital objects and characters move the same way they would in the real world.
Several NVIDIA Research papers feature breakthroughs in the field, including SuperPADL, a project that tackles the challenge of simulating complex human motions based on text prompts.
Some contents or functionalities here are not available due to your cookie preferences!
This happens because the functionality/content marked as Vimeo framework uses cookies that you choosed to keep disabled. In order to view this content or use this functionality, please enable cookies: click here to open your cookie preferences.
Using a combination of reinforcement learning and supervised learning, the researchers demonstrated how the SuperPADL framework can be trained to reproduce the motion of more than 5,000 skills - and can run in real time on a consumer-grade NVIDIA GPU.
Another NVIDIA paper features a neural physics method that applies AI to learn how objects - whether represented as a 3D mesh, a NeRF or a solid object generated by a text-to-3D model - would behave as they are moved in an environment.
A paper written in collaboration with Carnegie Mellon University researchers develops a new kind of renderer - one that, instead of modeling physical light, can perform thermal analysis, electrostatics and fluid mechanics. Named one of five best papers at SIGGRAPH, the method is easy to parallelize and doesn't require cumbersome model cleanup, offering new opportunities for speeding up engineering design cycles.
Additional simulation papers introduce a more efficient technique for modeling hair strands and a pipeline that accelerates fluid simulation by 10x.
Raising the Bar for Rendering Realism, Diffraction Simulation Another set of NVIDIA-authored papers present new techniques to model visible light up to 25x faster and simulate diffraction effects - such as those used in radar simulation for training self-driving cars - up to 1,000x faster.
A paper by NVIDIA and University of Waterloo researchers tackles free-space diffraction, an optical phenomenon where light spreads out or bends around the edges of objects. The team's method can integrate with path-tracing workflows to increase the efficiency of simulating diffraction in complex scenes, offering up to 1,000x acceleration. Beyond rendering visible light, the model could also be used to simulate the longer wavelengths of radar, sound or radio waves.
Path tracing samples numerous paths - multi-bounce light rays traveling through a scene - to create a photorealistic picture. Two SIGGRAPH papers imp
Most recent headlines
11/12/2025
Dalet, a leading provider of cloud-native, end-to-end media workflow solutions, ...
22/11/2025
CARSON, Calif. IDX has introduced the IDX CUE-J Series battery/charger kits, including the CUE-J98, CUE-J150 and CUE-J198....
22/11/2025
The NBA has released encouraging viewing and social media data that the beginnings of its $76 billion deal with NBC/Peacock, Prime Video and ESPN are paying off...
22/11/2025
WASHINGTON The Federal Communications Commission has set deadlines for comments on its newest proposals for NextGen TV, aka ATSC 3.0, with comments due on Jan. ...
22/11/2025
Seeking Advice for a New Opera, Laura Kaminsky Consulted the Experts: Her Studen...
21/11/2025
Platinum White Paper: Appear Shares Why Media Exchange Is the Missing Link in So...
21/11/2025
NWSL Championship 2025: CBS Sports To Deploy Two-Point FlyCam for Match Coverage...
21/11/2025
NWSL Caps 2025 Season With Awards Show, Skills Challenge ProductionsA team of 70 is on the ground in California to produce both eventsBy Mark J Burns, SVG Contr...
21/11/2025
USL and NEP Ready for Largest USL Championship Final Production EverThe broadcast from Tulsa, OK, will air CBS and TUDN on Saturday at 12 p.m. ETBy Jason Dachma...
21/11/2025
With Two New Teams, PWHL Boosts Production Workforce and Central Review for Seas...
21/11/2025
Jared Lank and his mother in the '90s...
21/11/2025
Fans have been counting down the days until the final theatrical chapter of Wicked is revealed. To celebrate the highly anticipated release of Wicked: For Good ...
21/11/2025
Last week, Spotify turned up the volume in Seoul with the return of Spotify Hous...
21/11/2025
Wiesbaden, November 21, 2025. The SGL Carbon site in Meitingen has reason to celebrate as one of its trainees received a special award. Elias Stemmer was honore...
21/11/2025
MELBOURNE, Fla., Nov. 21, 2025 - L3Harris Technologies (NYSE: LHX) has announced this year's LHX Excellence Awards, the company's most prestigious recog...
21/11/2025
WASHINGTON The Federal Communications Commission by a 3-0 vote opened a notice of proposed rulemaking (NPRM) to advance Congress's mandate to clear a minimu...
21/11/2025
WASHINGTON The Federal Communications Commission by a 3-0 vote adopted a Notice of Proposed Rulemaking (NPRM) to advance Congress's mandate to clear a minim...
21/11/2025
STAMFORD, Conn. Charter's Spectrum has expanded the devices that can offer 4K content on the Spectrum TV app to compatible Apple TV 4K and Roku devices....
21/11/2025
NAPERVILLE, Ill. Media industry employers are continuing their multiyear trend of increasing salaries for all worker segments but lag general industry raises, s...
21/11/2025
WASHINGTON The National Association of Broadcasters said it is accepting nominations for the 2026 NAB Technology Awards, honors that recognize excellence in bro...
21/11/2025
American Amplifier Technologies has released a vector network analysis module....
21/11/2025
The Best Movie Musicals on Every Streaming Platform From Wicked to The Sound of Music, heres where to stream all the classic movie musicals and recent hits on...
21/11/2025
The agreement creates a platform for joint collaboration, technology integration...
21/11/2025
Sky Media's £2m award-winning sustainability initiative crowns its first charity as this year's standout changemakerFriday 21 November 2025
GoodGym nam...
21/11/2025
As COP30 draws to a close, the International Electrotechnical Commission (IEC), ...
20/11/2025
MLB Media-Rights Shakeup: NBC's New Three-Year Deal Covers Sunday Night Bas...
20/11/2025
MLB Media-Rights Shakeup: New Deal Will Bring 30 National Games to ESPN's Li...
20/11/2025
MLB Media-Rights Shakeup: Netflix Lands Opening Night, Home Run Derby, Field of ...
20/11/2025
MLB Media-Rights Shakeup Overview: ESPN, NBCU, Netflix Ink Three-Year DealsESPN gets new 30-game package, MLB.TV; NBC extends Sunday nights; Netflix adds tentpo...
20/11/2025
SVG Students To Watch: Henry Thuss, Indiana UniversityThe Southern California product has his goals set on the front benchBy Brandon Costa, Director of Digital ...
20/11/2025
Done+Dusted's Guy Carrington on Creating the Spectacular League of Legends W...
20/11/2025
FIA Extreme H World Cup Host Broadcaster Aurora Goes Inside the Production of th...
20/11/2025
Platinum White Paper: Amagi Utilizes Cloud Production for Sports Events - Multi-...
20/11/2025
2025 Sports Broadcasting Hall of Fame: Marc Herklotz, Steady Hand Behind the Sce...
20/11/2025
NFL Deep Dive: How 32 Cameras at Each Stadium Drive Virtual Measurement, Boundar...
20/11/2025
Charlie Shackleton attends the 2025 Sundance Film Festival premiere of Zodiac K...
20/11/2025
Your playlists are personal. They're the soundtracks to your road trips, your quiet mornings, and your biggest celebrations; collections of memories and dis...
20/11/2025
Spotify, uzun s redir zerine al t T rk m zik k lt r n n ikon haline gelmi ...
20/11/2025
For the first time, Spotify has teamed up with The Hollywood Reporter to cohost ...
20/11/2025
This year's ARIA Awards marked a turning point for Australian music, and Spotify was right at the heart of it. For the first time in the awards' nearly ...
20/11/2025
L3Harris has achieved NSA Cybersecurity Directorate certification for its KSV-650 space hub end cryptographic unit, ensuring secure, adaptable communications fo...
20/11/2025
Left to Right: David Taubman, Regional Managing Director, Central and Eastern Europe; Arek Szalpuk, Poland Sr. Account Manager; Mr. Marcin Wi niewski, President...
20/11/2025
15 March 2012
SHARE Facebook Twitter Linkedin Email
Cinegy and Vericom are pleased to announce the recent deployment of Cinegy Archive for production and as...
20/11/2025
6 September 2012
SHARE Facebook Twitter Linkedin Email
FIC Turkey supplies media content to Pay TV under Fox TV Channel brands in Turkey.
At the start of s...
20/11/2025
25 June 2014
SHARE Facebook Twitter Linkedin Email
Last month VIVA finalized its Cinegy installation in order to produce and broadcast the World Cup Brazil ...
20/11/2025
1 October 2014
SHARE Facebook Twitter Linkedin Email
With 5 locations spread out around Baden-W rttemberg, Schw bisch Media required a scalable end to end s...
20/11/2025
27 April 2015
SHARE Facebook Twitter Linkedin Email
Cinegy, which develops and produces media asset management products that are used in flagship production...
20/11/2025
12 August 2015
SHARE Facebook Twitter Linkedin Email
Munich, Germany, 26 October 2015 - Cinegy, which develops and produces software technology for digital ...
20/11/2025
5 November 2015
SHARE Facebook Twitter Linkedin Email
Munich, Germany 3 November 2015 - Cinegy, which develops and produces software technology for digital ...
20/11/2025
12 February 2016
SHARE Facebook Twitter Linkedin Email
Munich, Germany 9 February 2016 - Cinegy, which develops and produces software technology for digital...