Sony Pixel Power calrec Sony

NVIDIA Researchers Harness Real-Time Gen AI to Build Immersive Desert World

31/07/2024

NVIDIA researchers used NVIDIA Edify, a multimodal architecture for visual generative AI, to build a detailed 3D desert landscape within a few minutes in a live demo at SIGGRAPH's Real-Time Live event on Tuesday.

During the event - one of the prestigious graphics conference's top sessions - NVIDIA researchers showed how, with the support of an AI agent, they could build and edit a desert landscape from scratch within five minutes. The live demo highlighted how generative AI can act as an assistant to artists by accelerating ideation and generating custom secondary assets that would otherwise have been sourced from a repository.

By drastically decreasing ideation time, these AI technologies will empower 3D artists to be more productive and creative - giving them the tools to explore concepts faster and expedite parts of their workflows. They could, for example, generate the background assets or 360 HDRi environments that the scene needs in minutes, instead of spending hours finding or creating them.

From Idea to 3D Scene in Three Minutes Creating a full 3D scene is a complex, time-consuming task. Artists must support their hero asset with plenty of background objects to create a rich scene, then find an appropriate background and an environment map to light it. Due to time constraints, they've often had to make a trade-off between rapid results and creative exploration.

With the support of AI agents, creative teams can achieve both goals: quickly bring concepts to life and continue iterating to achieve the right look.

In the Real-Time Live demo, the researchers used an AI agent to instruct an NVIDIA Edify-powered model to generate dozens of 3D assets, including cacti, rocks and the skull of a bull - with previews produced in just seconds.

They next directed the agent to harness other models to create potential backgrounds and a layout of how the objects would be placed in the scene - and showcased how the agent could adapt to last-minute changes in creative direction by quickly swapping the rocks for gold nuggets.

With a design plan in place, they prompted the agent to create full-quality assets and render the scene as a photorealistic image in NVIDIA Omniverse USD Composer, an app for virtual world-building.

NVIDIA Edify Accelerates Environment Generation NVIDIA Edify models can help creators focus on hero assets while accelerating the creation of background environments and objects using AI-powered scene generation tools. The Real-Time Live demo showcased two Edify models:

Edify 3D generates ready-to-edit 3D meshes from text or image prompts. Within seconds, the model can generate previews, including rotating animations of each object, to help creators rapidly prototype before committing to a specific design.

Edify 360 HDRi uses text or image prompts to generate up to 16K high-dynamic range images (HDRi) of nature landscapes, which can be used as backgrounds and to light scenes.

During the demo, the researchers also showcased an AI agent powered by a large language model, and USD Layout, an AI model that generates scene layouts using OpenUSD, a platform for 3D workflows.

At SIGGRAPH, NVIDIA also announced that two leading creative content companies are giving designers and artists new ways to boost productivity with generative AI using tools powered by NVIDIA Edify.

Shutterstock has launched in commercial beta its Generative 3D service, which lets creators quickly prototype and generate 3D assets using text or image prompts. Its 360 HDRi generator based on Edify also entered early access.

Getty Images updated its Generative AI by Getty Images service with the latest version of NVIDIA Edify. Users can now create images twice as fast, with improved output quality and prompt adherence, and advanced controls and fine-tuning.

Harnessing Universal Scene Description in NVIDIA Omniverse The 3D objects, environment maps and layouts generated using Edify models are structured with USD, a standard format for describing and composing 3D worlds. This compatibility allows artists to immediately import Edify-powered creations into Omniverse USD Composer.

Within Composer, they can use popular digital content creation tools to further modify the scene by, for example, changing the position of objects, modifying their appearance or adjusting lighting.

Real-Time Live is one of the most anticipated events at SIGGRAPH, featuring about a dozen real-time applications including generative AI, virtual reality and live performance capture technology. Watch the replay below.
LINK: https://blogs.nvidia.com/blog/real-time-3d-generative-ai-research-sigg...
See more stories from nvidia

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

18/11/2026

Eventide launch SplitEQ 2

Dynamic bands, unmasking features & new stereo tools Launched in 2021, Eventide's SplitEQ plug-in introduced an interesting new approach to EQ, with the...

18/11/2026

IK Multimedia announce Tonex Parametric

Parametric Tone Models emulate control responses & interactions IK Multimedia have just announced the launch of Parametric Tone Models, a new technology tha...

18/11/2026

Shure launch the MV360 Spatial Audio Microphone

Captures immersive audio on phone, tablet or computer via USB-C Shure have just announced the launch of the MV360 Spatial Audio Microphone, a compact USB-C ...

18/11/2026

Live from London, its Saturday night! Saturday Night Live UK returns 16 January on Sky and NOW

Wednesday 18 November 2026 Live from London, it's Saturday night! Saturday ...

18/11/2026

Sky Kids Investigates: Being a Boy

BAFTA award-winning series sees 16-year-old reporter explore topics including toxic digital influencers and disrespectful attitudes to girls in a groundbreaking...

18/11/2026

Choosing a display for TMxCore

TMxCore has no built-in display. If you use TMxCore with a network display, you may not need a dedicated display at all. If you prefer a directly connected scre...

18/11/2026

TeleData Accelerates XGS-PON Service Rollout in Germany and Unifies its Network with Harmonic's cOS Broadband Platform

Key Takeaways TeleData is building a unified DOCSIS and fiber network with Ha...

18/11/2026

Successfully achieved BSI C5 attestation

Arvato Systems Expands BSI-C5 Testing Greater Confidence in Cloud Security and Regulatory Resilience Successful BSI-C5 Retest Certification in accordance wi...

18/11/2026

RT to premiere new three-part documentary series Able

Brendan O'Connor joins six disabled job seekers as they navigate the barriers of finding work and challenge perceptions of disability in the workplace Begi...

18/11/2026

When writing becomes a weapon : New true-crime podcast series to reveal the impact of anonymous poison-pen letter case

Poison Ink begins Friday 20 November 2026 on RT Listen and RT Radio 1 Listen ...

18/11/2026

RT Choice Music Prize 2027 Key Dates Announcement

RT Choice Music Prize In association with IMRO and IRMA 2027 KEY DATES Irish Album of the Year 2026 Shortlist 18th January Irish Artist of the Year 2026 ...

17/11/2026

Freqport introduce FreqLift plug-in

Multiband dynamics plug-in boasts FT1 integration Freqport's latest plug-in combines multiband upward and downward dynamics with the company's renow...

17/11/2026

Studio 5X: Debut monitors from Teufel Audio

Hi-fi experts launch two pro-audio models Berlin-based hi-fi experts Teufel Audio have recently branched out into the pro-audio world with their first pairs...

17/11/2026

EastWest Black Friday 2026

A year of ComposerCloud+ for $99 EastWest's annual Black Friday Sale is already live, and new users are being offered one year of the all-encompassing C...

17/11/2026

SOS Awards: Make Your Vote Count!

Pick your favourite gear from 2026 The annual SOS Awards are now underway, and as always, we're asking readers to help us choose the best pro-audio rele...

17/11/2026

Production capacity expanded at SGL Carbons Ried im Innkreis site

As part of an ongoing series production program for a German automaker, production capacity has been increased at SGL Carbon's Austrian site in Ried im Innk...

17/11/2026

Clear-Com Delivers Portable Wireless Systems for Secure Aircraft Communications Testing

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

17/11/2026

Sky announces major free upgrade to the Sky Glass and Sky Stream experience with the launch of the new Sky OS

Tuesday 17 November 2026 Sky announces major free upgrade to the Sky Glass and ...

17/11/2026

Passion, Betrayal and Scandal: Sky Arts Reveals the Man Behind the Music in Dangerous Debussy, Premiering 1 December

Tuesday 17 November 2026 Passion, Betrayal and Scandal: Sky Arts Reveals the Ma...

17/11/2026

Apple Podcasts names Baby, this is Keke\u00A0Palmer the 2026 Show of the Year - UPDATE - Posted on 17 November 2026

Today, Apple Podcasts named Baby, this is Keke Palmer its Show of the Year, hono...

16/11/2026

New plug-in suite from Berry Effects

Creative effects designed to encourage experimentation Berry Effects is the brainchild of Abe and Ralph, a pair of multi-instrumentalists and audio engineer...

16/11/2026

Anukari 1.1 now available

Physics-based synth gets first major update Anukari have just released a new version of their innovative physics-based software synth, marking the instrumen...

16/11/2026

Hit'n'Mix RipX DAW 9 arrives

Both versions kitted out with new tools & improvements Hit'n'Mix have just launched the latest major version of their innovative DAW software, with ...

16/11/2026

Eventide to launch SplitEQ 2

Dynamic bands, unmasking features & new stereo tools Launched in 2021, Eventide's SplitEQ plug-in introduced an interesting new approach to EQ, with the...

16/11/2026

Rohde & Schwarz Japan demonstrates multi-vendor ASA-ML communication with highperformance oscilloscope

Rohde & Schwarz Japan demonstrates multi-vendor ASA-ML communication with high p...

16/11/2026

CNAO and Hitachi launch advanced rotating proton therapy system in Italy

November 16, 2026 Hitachi system enables proton beams to be delivered from 360 degrees around the patient, expanding treatment capacity and supporting more pre...

16/11/2026

SES and ITU Expand Partner2Connect Digital-learning Initiative to 30 African Schools

Initiative in Malawi, Burundi, Zambia and Zimbabwe will leverage SES satellite s...

16/11/2026

U sees new original drama Fleet Street from the creators of Miss Scarlet

Images available HERE UKTV has announced Fleet Street (6x60'), a new period crime drama from Miss Scarlet creators Rachael New and Ben Edwards, coming to f...

16/11/2026

Sky and NOW bring some of the UKs biggest video podcasts to the big screen at no extra cost with Platform Media as first partner

From Graham Norton to Olivia Attwood and Joe Marler, a new collection of hit vid...

16/11/2026

Can Digital Product Passports help meet climate goals?

As countries gather to discuss climate targets at COP 31 this week, one question that is at the heart of debates is how to measure the environmental impact of t...

15/11/2026

Yamaha launch MGX, URX & CC1 updates

Mixers, interfaces & DAW controller receive new firmware Yamaha have just launched a trio of firmware updates that bring some powerful new functionality to ...

14/11/2026

Rotary Exciter & Resonator Clamps from ADDAC System

Modular innovators introduce two guitar-based products ADDAC System's recently introduced Four String Series makes it possible to integrate physical str...

13/11/2026

HLabs reveal the CL089

Studer-inspired 500-series PWM compressor unveiled The HLabs range already includes a couple of Studer-inspired offerings in the form of the PRE169 and EQ16...

13/11/2026

Freedom of Choice White Paper

Download Now! To view the white paper, please enter the following details: -- First Name* First Name Company* Country* Please select your countryA...

13/11/2026

Apple HomeView available today - UPDATE - Posted on 13 November 2026

Beginning today, November 13, Apple HomeView is available for purchase at Apple Store locations, on the Apple Store online, and in the Apple Store app in select...

12/11/2026

UVI release Twin 88 Keys

Blend between concert grand & vintage electric pianos UVI's latest release combines a concert grand with a vintage electric piano in a single instrument...

12/11/2026

Universal Audio reintroduce UAD Cooper Time Cube Delay

Native version of popular effects plug-in arrives Many of the plug-ins that used to require Universal Audios Apollo interfaces or DSP accelerators have made...

12/11/2026

Audient launch the iD Mk3 line-up

Four next-generation interfaces announced Following on from the release of their new flagship Thunderbolt interfaces, Audient have refreshed the design of t...

12/11/2026

Rohde & Schwarz and Connektica showcase automated RF test systems for satellite payloads and radar at Space Tech Expo

Rohde & Schwarz and Connektica showcase automated RF test systems for satellite ...

12/11/2026

Red Seat Ventures Announces Exclusive Partnership with Bryce Crawford and The Bryce Crawford Podcast

Red Seat Ventures Announces Exclusive Partnership with Bryce Crawford and The Br...

12/11/2026

More Pets, More Laughs, and More Chaos: The Big Pet Project is back

Airing Sunday 15 November on RT One and RT Player at 5.10pm A new series of The Big Pet Project kicks off this Sunday, brightening our winter evenings with a...

12/11/2026

U unveils first look teaser for brand-new drama, The Cadburys

Image available HERE Teaser available HERE A teaser for The Cadburys (6x60') has been released, introducing audiences to the core family of George (Harry ...

12/11/2026

Jeremiah Slovarp on building Jereco from the ground up in rural Montana

An island in rural MontanaJeremiah Slovarp owns Jereco in Bozeman, Montana, and teaches music technology and recording arts at Montana State University. He star...

12/11/2026

Introducing Ask the AI GP'

Who am I and whats an AI GP? Im Kathryn Hodgkinson, and Ive recently qualified as an Artificial Intelligence Governance Professional (AIGP), a certification awa...

12/11/2026

RT Coverage of European Political Community Summit in Dublin

RT will provide extensive coverage of the European Political Community Summit in Dublin across television, radio and online on Thursday, 12 November 2026. As p...

11/11/2026

Spitfire Audio & Eric Whitacre launch Eternity

Third collaboration with Grammy-winning composer & conductor Spitfire Audio have announced the release of Eternity, the third sample library to be created a...

11/11/2026

Modbap release Wax Theory

Eurorack experts launch vinyl-inspired plug-in When praised Eurorackers Modbap revealed their first software effect recently, they stated it was the first r...

11/11/2026

If your fraud tool detects invalid traffic, what happens next?

Fraud detection and removal tools play an important role in defending advertising budgets against invalid traffic. A robust fraud tool, independently accredited...

11/11/2026

Irish culture and music take centre stage at COP31 event in Turkiye this Friday in partnership with RT lyric fm

RT lyric fm is partnering with the Department of Climate, Energy, and the Envir...