Sony Pixel Power calrec Sony

NVIDIA Researchers Harness Real-Time Gen AI to Build Immersive Desert World

31/07/2024

NVIDIA researchers used NVIDIA Edify, a multimodal architecture for visual generative AI, to build a detailed 3D desert landscape within a few minutes in a live demo at SIGGRAPH's Real-Time Live event on Tuesday.

During the event - one of the prestigious graphics conference's top sessions - NVIDIA researchers showed how, with the support of an AI agent, they could build and edit a desert landscape from scratch within five minutes. The live demo highlighted how generative AI can act as an assistant to artists by accelerating ideation and generating custom secondary assets that would otherwise have been sourced from a repository.

By drastically decreasing ideation time, these AI technologies will empower 3D artists to be more productive and creative - giving them the tools to explore concepts faster and expedite parts of their workflows. They could, for example, generate the background assets or 360 HDRi environments that the scene needs in minutes, instead of spending hours finding or creating them.

From Idea to 3D Scene in Three Minutes Creating a full 3D scene is a complex, time-consuming task. Artists must support their hero asset with plenty of background objects to create a rich scene, then find an appropriate background and an environment map to light it. Due to time constraints, they've often had to make a trade-off between rapid results and creative exploration.

With the support of AI agents, creative teams can achieve both goals: quickly bring concepts to life and continue iterating to achieve the right look.

In the Real-Time Live demo, the researchers used an AI agent to instruct an NVIDIA Edify-powered model to generate dozens of 3D assets, including cacti, rocks and the skull of a bull - with previews produced in just seconds.

They next directed the agent to harness other models to create potential backgrounds and a layout of how the objects would be placed in the scene - and showcased how the agent could adapt to last-minute changes in creative direction by quickly swapping the rocks for gold nuggets.

With a design plan in place, they prompted the agent to create full-quality assets and render the scene as a photorealistic image in NVIDIA Omniverse USD Composer, an app for virtual world-building.

NVIDIA Edify Accelerates Environment Generation NVIDIA Edify models can help creators focus on hero assets while accelerating the creation of background environments and objects using AI-powered scene generation tools. The Real-Time Live demo showcased two Edify models:

Edify 3D generates ready-to-edit 3D meshes from text or image prompts. Within seconds, the model can generate previews, including rotating animations of each object, to help creators rapidly prototype before committing to a specific design.

Edify 360 HDRi uses text or image prompts to generate up to 16K high-dynamic range images (HDRi) of nature landscapes, which can be used as backgrounds and to light scenes.

During the demo, the researchers also showcased an AI agent powered by a large language model, and USD Layout, an AI model that generates scene layouts using OpenUSD, a platform for 3D workflows.

At SIGGRAPH, NVIDIA also announced that two leading creative content companies are giving designers and artists new ways to boost productivity with generative AI using tools powered by NVIDIA Edify.

Shutterstock has launched in commercial beta its Generative 3D service, which lets creators quickly prototype and generate 3D assets using text or image prompts. Its 360 HDRi generator based on Edify also entered early access.

Getty Images updated its Generative AI by Getty Images service with the latest version of NVIDIA Edify. Users can now create images twice as fast, with improved output quality and prompt adherence, and advanced controls and fine-tuning.

Harnessing Universal Scene Description in NVIDIA Omniverse The 3D objects, environment maps and layouts generated using Edify models are structured with USD, a standard format for describing and composing 3D worlds. This compatibility allows artists to immediately import Edify-powered creations into Omniverse USD Composer.

Within Composer, they can use popular digital content creation tools to further modify the scene by, for example, changing the position of objects, modifying their appearance or adjusting lighting.

Real-Time Live is one of the most anticipated events at SIGGRAPH, featuring about a dozen real-time applications including generative AI, virtual reality and live performance capture technology. Watch the replay below.
LINK: https://blogs.nvidia.com/blog/real-time-3d-generative-ai-research-sigg...
See more stories from nvidia

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/10/2026

Warm Audio launch the Mod Series

Three new compact pedals announced Warm Audio have just introduced a new guitar pedal line-up that offers compact, pedalboard-friendly versions of some of t...

06/10/2026

WaveMachine Labs Drumagog 6 arrives

Drum-replacement tool gets major overhaul WaveMachine Labs have announced that the latest version of their drum-replacement software is now available, and i...

06/10/2026

Arturia update the AstroLab

Firmware update implements user-requested features Arturia's stage-going keyboard series has just received a significant update that addresses some of t...

06/10/2026

Adhoc notification: SGL Carbon reports preliminary sales and earnings figures for the first nine months and raises its forecast for 2026

(4:51 PM) Wiesbaden, October 06, 2026. Based on business performance to date, pa...

06/10/2026

Official trailer released for The Good Daughter ahead of its 12 November launch on Sky and NOW

Tuesday 6 October 2026 Official trailer released for The Good Daughter ahead of...

06/10/2026

Vocal intelligibility was outstanding Front of House Magazine reviews 6388 CORE+

Savanyu reports getting more gain from the sound system, which he credits to the capsules asymmetrical supercardioid pickup pattern. Even with less-than-ideal...

06/10/2026

RT to explore C.S. Lewis's Belfast roots in new documentary, The Lion, The Witch and the Ulsterman

Andrew Trimble delves into the author's Belfast upbringing Thursday, 8 Octo...

05/10/2026

Austrian Audio introduce the OC616

New multi-pattern LDC revealed Austrian Audio have announced the upcoming launch of a new multi-pattern large-diaphragm capacitor mic that occupies the midd...

05/10/2026

IK Multimedia Tonex 2 Player now available

Software gains Tonex Board rig support When IK Multimedia launched the Tonex Board, they mentioned that it would soon be followed by a significant update to...

05/10/2026

fedDSP release quadCHO

Offers a modern take on classic chorus effects fedDSP's latest creation has been designed to offer a modern take on the classic chorus effect, combining...

05/10/2026

FOX Deepens Investment in the Creator Economy, Expanding Leadership Team to Accelerate FOX Creator Studios

FOX Deepens Investment in the Creator Economy, Expanding Leadership Team to Acce...

05/10/2026

RT to provide comprehensive coverage of Budget 2027 on TV, radio and online

RT will provide comprehensive coverage and analysis of Budget 2027 across online, radio and television on Tuesday 6 October, with extensive reporting and analy...

04/10/2026

Shure's MV6 gets Gen 2 upgrade

Dedicated streaming mic gets an overhaul Following on from the success of their dedicated streaming microphone, the MV6, Shure have announced the launch of ...

02/10/2026

Roland update Zenology GX for iPad

v1.9.3 introduces AUv3 support Roland have just released an update that kits their free iPad-based software synth out with AUv3 support, meaning it can now ...

02/10/2026

MOTU Digital Performer 12 now available

Dolby Atmos support, AI-powered stem separation & more The latest version of MOTU's DAW software is now available, and marks a major step forward with t...

02/10/2026

iFi audio reveal the GR2 MT

Portable DAC created in collaboration with Steve Levine British hi-fi experts iFi audio have unveiled a new Master Tuned variant of their praised iDSD GR2 p...

02/10/2026

Inside the Pirate Ecosystem: How Illegal Streaming Devices Put Consumers at Risk

In our latest blog, Tim Pearson looks at streaming piracy from a different lens, focusing on digital trust, consumer risk, and the future of subscriber protecti...

02/10/2026

Ambient Orbit returns to RT lyric fm and RT Listen this Sunday for a ninth series with 12 new episodes

Featuring performances recorded in Cork, Kilkenny, Wesmeath and Dublin culminati...

02/10/2026

Crystal Lake, a Friday the 13th prequel series, coming to Sky & NOW on 19 October

Friday 2 October 2026 Crystal Lake, a Friday the 13th' prequel series, com...

02/10/2026

Sky VIP helps families celebrate the Christmas season with 5,000 free tickets to LEGOLAND Windsor Resort

Friday 2 October 2026 Sky VIP helps families celebrate the Christmas season wit...

02/10/2026

RT Investigates: Fertility Uncovered

How the fertility sector in Ireland remains unregulated Undercover filming reveals how without proper regulation the promotion of controversial fertility treat...

02/10/2026

DIY SOS: The Big Build Ireland Returns for Series 5

Transforming Homes, Transforming Lives Presenter Baz Ashmawy and his team take on four life-changing builds across Kildare, Limerick, Wicklow and Offaly in the...

01/10/2026

Phoenix from Spitfire Audio & BT

Third collaboration with celebrated composer Spitfire Audio have once again teamed up with Grammy-nominated composer, producer and technologist BT, creating...

01/10/2026

Novation launch the FLpad

FL Studio gets dedicated grid controller Novation have teamed up with FL Studio developers Image-Line to create another dedicated controller for the popular...

01/10/2026

Volt Gen 2 & Volt Max interfaces from Universal Audio

Six new USB interfaces introduced Universal Audio's USB audio interface line-up has just been refreshed, gaining six new models aimed at musicians, prod...

01/10/2026

Siretta SNYPER-5G Shortlisted for the IoT Global Awards 2026

Siretta's SNYPER-5G cellular network analyser has been shortlisted for the IoT Global Awards 2026. The IoT Global Awards recognise products, services and o...

01/10/2026

Mesh Broadcast Services and Argo M - A Perfect Fit

Mesh Broadcast Services Fits Big-Truck Audio Power into Compact Eclipse Unit with Calrec Argo M Canadian OB company Mesh Broadcast Services has fitted its Eclip...

01/10/2026

X-Rite Pantone Launches Spectura to Advance Connected Color Quality from Lab to Production

X-Rite Pantone Launches Spectura to Advance Connected Color Quality from Lab to ...

01/10/2026

Nominees revealed for 2026 Sky Arts Awards

Thursday 1 October 2026 Nominees revealed for 2026 Sky Arts Awards Current slide, 0 0, undefined1 0 Irish National Opera and Jennifer Walshe: MARS Jacob Al...

01/10/2026

Vital TV antenna replaced at Sudbury

Vital TV antenna replaced at SudburyHelicopter and broadcast engineers work together to upgrade TV services for 1.5M in the East -- Share to Linkedin Octobe...

01/10/2026

Arqiva appoints Simon Duffy as Chair

Arqiva appoints Simon Duffy as ChairSimon Duffy joins as Chair effective 01 October 2026 -- Share to Linkedin October 1, 2026 Press Office 01 October 2026...

01/10/2026

The Boys are Back! The 2 Johnnies Late Night Lock In returns for Season 4

Season 4 of the multi-award-winning hit entertainment series The 2 Johnnies Late Night Lock In is back, serving up another round of unpredictable laughs, unforg...

01/10/2026

RT lyric fm's award-winning The Lyric Feature returns for new autumn series

New season begins Sunday, 4 October at 6pm on RT lyric fm and RT Listen RT lyric fm's arts and culture documentary series The Lyric Feature returns on S...

01/10/2026

RT Supporting the Arts is supporting 32 cultural events nationwide this October

RT is proud to continue its commitment to supporting and celebrating the arts across Ireland this October, highlighting a vibrant programme of theatre, music, ...

30/09/2026

Sync Audio release MegaMorph

Add an envelope generator to any plug-in Sync Audio's latest creation is a handy utility plug-in that can be used to combine and modulate other effects ...

30/09/2026

Strymon launch the La Brea

All-analogue tape-style drive joins Series A Strymon's reputation was built on their digital knowhow, so many were surprised (and intrigued) when they a...

30/09/2026

Sonuscore The Pulse: Synth Wave & Epic Atmospheres

Two new expansion packs released Sonuscore have just introduced two new expansion packs for The Pulse, its production engine instrument for modern cinematic...

30/09/2026

Clear-Com's Arcadia Central Station Brings Professional Production Communications to...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

30/09/2026

SES and Sky Sign Multi-Year Satellite Capacity Agreement

Luxembourg, September 30, 2026 - SES and Sky have extended their long-standing partnership in a new multi-year agreement for direct-to-home (DTH) satellite serv...

30/09/2026

Harmonic Launches Recon Product Family Developed in Partnership with Comcast

New Solution Expands Harmonic's Network Intelligence Portfolio and Brings Comcast-Developed Fiber Monitoring Technology to Broadband Operators, Providing Re...

30/09/2026

Claire Brock and Sophie Morris discover how consumers can shop smarter in new RT documentary series

How to Shop Well Now starts Monday at 9.35pm on RT One and RT Player On the...

29/09/2026

Zynaptiq introduce Loud & Wide

Two new plug-ins launch alongside updated bundles Zynaptiq have just announced the launch of two new plug-ins, alongside new and improved versions of two of...

29/09/2026

Wes Audio unveil the ngOmniBox

All-in-one bus processor revealed Wes Audio's ng product range has come a long way since it was first introduced, and now includes a tasty selection of ...

29/09/2026

First Baptist Nashville Drastically Upgrades Production Communications with...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

29/09/2026

CMA Imaging, Sun Chemical, and X-Rite Pantone Help Brands Accelerate Metal Packaging Color Approval

CMA Imaging, Sun Chemical, and X-Rite Pantone Help Brands Accelerate Metal Packa...

29/09/2026

SES Successfully Prices 500 million Eurobond

NOT FOR RELEASE, PUBLICATION OR DISTRIBUTION IN OR INTO OR TO ANY PERSON LOCATED OR RESIDENT IN, OR AT ANY ADDRESS IN, THE UNITED STATES OF AMERICA, ITS TERRITO...