
NVIDIA is taking an array of advancements in rendering, simulation and generative AI to SIGGRAPH 2024, the premier computer graphics conference, which will take place July 28 Aug. 1 in Denver.
More than 20 papers from NVIDIA Research introduce innovations advancing synthetic data generators and inverse rendering tools that can help train next-generation models. NVIDIA's AI research is making simulation better by boosting image quality and unlocking new ways to create 3D representations of real or imagined worlds.
The papers focus on diffusion models for visual generative AI, physics-based simulation and increasingly realistic AI-powered rendering. They include two technical Best Paper Award winners and collaborations with universities across the U.S., Canada, China, Israel and Japan as well as researchers at companies including Adobe and Roblox.
These initiatives will help create tools that developers and businesses can use to generate complex virtual objects, characters and environments. Synthetic data generation can then be harnessed to tell powerful visual stories, aid scientists' understanding of natural phenomena or assist in simulation-based training of robots and autonomous vehicles.
Diffusion Models Improve Texture Painting, Text-to-Image Generation Diffusion models, a popular tool for transforming text prompts into images, can help artists, designers and other creators rapidly generate visuals for storyboards or production, reducing the time it takes to bring ideas to life.
Two NVIDIA-authored papers are advancing the capabilities of these generative AI models.
ConsiStory, a collaboration between researchers at NVIDIA and Tel Aviv University, makes it easier to generate multiple images with a consistent main character - an essential capability for storytelling use cases such as illustrating a comic strip or developing a storyboard. The researchers' approach introduces a technique called subject-driven shared attention, which reduces the time it takes to generate consistent imagery from 13 minutes to around 30 seconds.
ConsiStory is capable of generating a series of images featuring the same character. NVIDIA researchers last year won the Best in Show award at SIGGRAPH's Real-Time Live event for AI models that turn text or image prompts into custom textured materials. This year, they're presenting a paper that applies 2D generative diffusion models to interactive texture painting on 3D meshes, enabling artists to paint in real time with complex textures based on any reference image.
Kick-Starting Developments in Physics-Based Simulation Graphics researchers are narrowing the gap between physical objects and their virtual representations with physics-based simulation - a range of techniques to make digital objects and characters move the same way they would in the real world.
Several NVIDIA Research papers feature breakthroughs in the field, including SuperPADL, a project that tackles the challenge of simulating complex human motions based on text prompts (see video at top).
Using a combination of reinforcement learning and supervised learning, the researchers demonstrated how the SuperPADL framework can be trained to reproduce the motion of more than 5,000 skills - and can run in real time on a consumer-grade NVIDIA GPU.
Another NVIDIA paper features a neural physics method that applies AI to learn how objects - whether represented as a 3D mesh, a NeRF or a solid object generated by a text-to-3D model - would behave as they are moved in an environment.
https://blogs.nvidia.com/wp-content/uploads/2024/07/Simplicits.mp4
A paper written in collaboration with Carnegie Mellon University researchers develops a new kind of renderer - one that, instead of modeling physical light, can perform thermal analysis, electrostatics and fluid mechanics. Named one of five best papers at SIGGRAPH, the method is easy to parallelize and doesn't require cumbersome model cleanup, offering new opportunities for speeding up engineering design cycles.
In the example above, the renderer performs a thermal analysis of the Mars Curiosity rover, where keeping temperatures within a specific range is critical to mission success.
Additional simulation papers introduce a more efficient technique for modeling hair strands and a pipeline that accelerates fluid simulation by 10x.
Raising the Bar for Rendering Realism, Diffraction Simulation Another set of NVIDIA-authored papers present new techniques to model visible light up to 25x faster and simulate diffraction effects - such as those used in radar simulation for training self-driving cars - up to 1,000x faster.
A paper by NVIDIA and University of Waterloo researchers tackles free-space diffraction, an optical phenomenon where light spreads out or bends around the edges of objects. The team's method can integrate with path-tracing workflows to increase the efficiency of simulating diffraction in complex scenes, offering up to 1,000x acceleration. Beyond rendering visible light, the model could also be used to simulate the longer wavelengths of radar, sound or radio waves.
Simulation of cellular signal coverage in a city. Path tracing samples numerous paths - multi-bounce light rays traveling through a scene - to create a photorealistic picture. Two SIGGRAPH papers improve sampling quality for ReSTIR, a path-tracing algorithm first introduced by NVIDIA and Dartmouth College researchers at SIGGRAPH 2020 that has been key to bringing path tracing to games and other real-time rendering products.
One of these papers, a collaboration with the University of Utah, shares a new way to reuse calculated paths that increases effective sample count by up to 25x, significantly boosting image quality. The other improves sample quality by randomly mutating a subset of the light's path. This helps denoising algorithms perform be
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
14/05/2026
Sweetwater and Airstream have announced a custom-built Dolby Atmos mobile recording studio inside an Airstream trailer, set to tour music festivals, schools, tr...
14/05/2026
The American Association of Professional Baseball (AAPB) has announced a new par...
14/05/2026
ESPN has announced plans to transform Santa Monica Beach into a broadcast hub du...
14/05/2026
Amagi has announced a significant update to Amagi CLOUDPORT, its cloud-based broadcast playout platform. The update includes 250-plus features shipped in FY25-2...
14/05/2026
Clear-Com will exhibit at InfoComm 2026 (Booth N7005, June 17-19, Las Vegas Convention Center), introducing a new product that builds on Arcadia Central Station...
14/05/2026
Ikegami will exhibit at BroadcastAsia 2026 (Stand 5D3-1, Singapore Expo, May 20-22), introducing two new viewfinders alongside its existing camera, control, and...
14/05/2026
Grass Valley has announced that dB Broadcast has delivered new IP-based outside ...
14/05/2026
NAGRAVISION, a Kudelski Group company, has announced a partnership with the World Professional Billiards and Snooker Association (WPBSA) to launch Play Snooker,...
14/05/2026
Belden Inc. has announced a definitive agreement to acquire RUCKUS Networks from Vistance Networks for approximately $1.85 billion. The transaction has been app...
14/05/2026
NVIDIA has released the Content Localization Blueprint, a modular reference arch...
14/05/2026
Disney has announced that Disney will be the exclusive U.S. streaming home of the Banana Bowl, the Banana Ball league season championship, streaming live this ...
14/05/2026
Arkona technologies and technology partner manifold will demonstrate their production solutions on the Magna Systems and Engineering stand (Booth 5D1-1) at Broa...
14/05/2026
Haivision will host a webinar on Thursday, May 21 at 10 a.m. ET / 4 p.m. CET cov...
14/05/2026
The CW Network and ESPN have announced a sublicense broadcast agreement for The CW to televise ACC football and men's and women's college basketball gam...
14/05/2026
The agreement marks Scripps Sports' first NBA local rights deal...
14/05/2026
A new report from education-technology company Wiingy testing post-ChatGPT predictions against three years of real-world data has identified broadcasting as one...
14/05/2026
Global Citizen and FIFA have announced that Madonna, Shakira, and BTS will headl...
14/05/2026
LOS ANGELES, CA, May 14, 2026 - The nonprofit Sundance Institute announced today the cohort selected for the 2026 Episodic Lab program, taking place at Dunaway ...
14/05/2026
At Spotify, we're focused on making every listening experience feel intentio...
14/05/2026
Spotify recently welcomed songwriters, artists, executives, and music students t...
14/05/2026
New articulations, ostinatos, Motion Scoring Articulation Sets & more
Sonuscore's flagship cinematic string library has just been treated to a significa...
14/05/2026
World-class studio opens on T rkiye's Aegean coast
P r Recording & Residence have announced their official opening, introducing a new world-class reside...
14/05/2026
Now supports channel layouts up to 9.1.6
Nugen Audio have just released an update for their AI-powered dialogue intelligibility and compliance tool. Set to ...
14/05/2026
New recordings & one-key chord tool
UVI have just announced the release of Orchestral Suite 2, a ground-up redesign of their all-in-one symphonic orchestra ...
14/05/2026
Two new arrivals & expanded factory content
Rob Papen's all-encompassing plug-in and virtual instrument collection has just been treated to another upda...
14/05/2026
Embed QR codes into DAW sessions
FSK Audio's latest plug-in doesn't process audio, but serves as an organisational tool that allows QR codes to be e...
14/05/2026
SBS Board appoints Jane Palfreyman Managing Director
13 May, 2026
Media releases
The Special Broadcasting Service (SBS) Board of Directors is pleased to an...
14/05/2026
Transforming bold ideas into market-ready productions: Digital Originals returns
14 May, 2026
Media releases
SBS, NITV and Screen Australia have announced ...
14/05/2026
Australia Uncovered Returns to SBS with Bold New Season Featuring John Safran on...
14/05/2026
Rohde & Schwarz transforms spectrum complexity into situational awareness and ef...
14/05/2026
Rohde & Schwarz and Quantum Systems join forces to redefine EW and C-UAS-enabled...
14/05/2026
Rohde & Schwarz showcases STANAG aligned ARDRONIS Counter UAS capability at NATO...
14/05/2026
Code of Silence has won the BAFTA for Best Drama Series at Sunday night's ceremony at the Royal Festival Hall.
The series, starring Rose Ayling-Ellis and w...
14/05/2026
Soldiers equipped with Falcon IV radios will soon gain a sense-and-protect capa...
14/05/2026
Artists concept of the L3Harris Next Gen RTG in flight configuration, designed to provide 250 watts of reliable power for decades-long missions in deep space....
14/05/2026
Vivid Broadcast was embracing remote production long before it became the industry norm. Now, with Calrec's True Control 2.0-enabled Argo M and Type R conso...
14/05/2026
Car ad spend rises sharply in March as more auto buyers turn to electric, hybrid...
14/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
14/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
14/05/2026
CueScript's CueiT 4.0 Wins Future's Best of Show Award, Presented at 2026 NAB Show by TV Tech
CueScript, a leading international developer of professio...
14/05/2026
Expert-Led Education Sessions and Development of Online Training Program Accelerate IPMX Adoption and Deployment
The Alliance for IP Media Solutions (AIMS) to...
14/05/2026
Klvr is launching in the United States with a professional-grade rechargeable battery solution that cuts costs and improves performance across live entertainmen...
14/05/2026
Shooting into the depths of Bedlam with URSA Cine 17K 65
Brie Clayton May 14, 2026
0 Comments
Indie feature film paired digital 65mm capture with a Bl...
14/05/2026
WeMakeColor expands with Baselight, becoming hybrid color facility
Caroline Shawley May 14, 2026
0 Comments
Boutique Mexican-based studio integrates B...
14/05/2026
Berklee's Summer in the City Returns with Free Concerts Throughout Boston Ar...
14/05/2026
Chelsey Green Named to Billboard's 2026 Women in Music List The Berklee professor and chair of the Recording Academy Board of Trustees joins other high-pr...