Sony Pixel Power calrec Sony

NVIDIA Researchers Harness Real-Time Gen AI to Build Immersive Desert World

31/07/2024

NVIDIA researchers used NVIDIA Edify, a multimodal architecture for visual generative AI, to build a detailed 3D desert landscape within a few minutes in a live demo at SIGGRAPH's Real-Time Live event on Tuesday.

During the event - one of the prestigious graphics conference's top sessions - NVIDIA researchers showed how, with the support of an AI agent, they could build and edit a desert landscape from scratch within five minutes. The live demo highlighted how generative AI can act as an assistant to artists by accelerating ideation and generating custom secondary assets that would otherwise have been sourced from a repository.

By drastically decreasing ideation time, these AI technologies will empower 3D artists to be more productive and creative - giving them the tools to explore concepts faster and expedite parts of their workflows. They could, for example, generate the background assets or 360 HDRi environments that the scene needs in minutes, instead of spending hours finding or creating them.

From Idea to 3D Scene in Three Minutes Creating a full 3D scene is a complex, time-consuming task. Artists must support their hero asset with plenty of background objects to create a rich scene, then find an appropriate background and an environment map to light it. Due to time constraints, they've often had to make a trade-off between rapid results and creative exploration.

With the support of AI agents, creative teams can achieve both goals: quickly bring concepts to life and continue iterating to achieve the right look.

In the Real-Time Live demo, the researchers used an AI agent to instruct an NVIDIA Edify-powered model to generate dozens of 3D assets, including cacti, rocks and the skull of a bull - with previews produced in just seconds.

They next directed the agent to harness other models to create potential backgrounds and a layout of how the objects would be placed in the scene - and showcased how the agent could adapt to last-minute changes in creative direction by quickly swapping the rocks for gold nuggets.

With a design plan in place, they prompted the agent to create full-quality assets and render the scene as a photorealistic image in NVIDIA Omniverse USD Composer, an app for virtual world-building.

NVIDIA Edify Accelerates Environment Generation NVIDIA Edify models can help creators focus on hero assets while accelerating the creation of background environments and objects using AI-powered scene generation tools. The Real-Time Live demo showcased two Edify models:

Edify 3D generates ready-to-edit 3D meshes from text or image prompts. Within seconds, the model can generate previews, including rotating animations of each object, to help creators rapidly prototype before committing to a specific design.

Edify 360 HDRi uses text or image prompts to generate up to 16K high-dynamic range images (HDRi) of nature landscapes, which can be used as backgrounds and to light scenes.

During the demo, the researchers also showcased an AI agent powered by a large language model, and USD Layout, an AI model that generates scene layouts using OpenUSD, a platform for 3D workflows.

At SIGGRAPH, NVIDIA also announced that two leading creative content companies are giving designers and artists new ways to boost productivity with generative AI using tools powered by NVIDIA Edify.

Shutterstock has launched in commercial beta its Generative 3D service, which lets creators quickly prototype and generate 3D assets using text or image prompts. Its 360 HDRi generator based on Edify also entered early access.

Getty Images updated its Generative AI by Getty Images service with the latest version of NVIDIA Edify. Users can now create images twice as fast, with improved output quality and prompt adherence, and advanced controls and fine-tuning.

Harnessing Universal Scene Description in NVIDIA Omniverse The 3D objects, environment maps and layouts generated using Edify models are structured with USD, a standard format for describing and composing 3D worlds. This compatibility allows artists to immediately import Edify-powered creations into Omniverse USD Composer.

Within Composer, they can use popular digital content creation tools to further modify the scene by, for example, changing the position of objects, modifying their appearance or adjusting lighting.

Real-Time Live is one of the most anticipated events at SIGGRAPH, featuring about a dozen real-time applications including generative AI, virtual reality and live performance capture technology. Watch the replay below.
LINK: https://blogs.nvidia.com/blog/real-time-3d-generative-ai-research-sigg...
See more stories from nvidia

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

02/10/2026

RT Investigates: Fertility Uncovered

How the fertility sector in Ireland remains unregulated Undercover filming reveals how without proper regulation the promotion of controversial fertility treat...

02/10/2026

DIY SOS: The Big Build Ireland Returns for Series 5

Transforming Homes, Transforming Lives Presenter Baz Ashmawy and his team take on four life-changing builds across Kildare, Limerick, Wicklow and Offaly in the...

01/10/2026

Phoenix from Spitfire Audio & BT

Third collaboration with celebrated composer Spitfire Audio have once again teamed up with Grammy-nominated composer, producer and technologist BT, creating...

01/10/2026

Novation launch the FLpad

FL Studio gets dedicated grid controller Novation have teamed up with FL Studio developers Image-Line to create another dedicated controller for the popular...

01/10/2026

Volt Gen 2 & Volt Max interfaces from Universal Audio

Six new USB interfaces introduced Universal Audio's USB audio interface line-up has just been refreshed, gaining six new models aimed at musicians, prod...

01/10/2026

Siretta SNYPER-5G Shortlisted for the IoT Global Awards 2026

Siretta's SNYPER-5G cellular network analyser has been shortlisted for the IoT Global Awards 2026. The IoT Global Awards recognise products, services and o...

01/10/2026

Mesh Broadcast Services and Argo M - A Perfect Fit

Mesh Broadcast Services Fits Big-Truck Audio Power into Compact Eclipse Unit with Calrec Argo M Canadian OB company Mesh Broadcast Services has fitted its Eclip...

01/10/2026

X-Rite Pantone Launches Spectura to Advance Connected Color Quality from Lab to Production

X-Rite Pantone Launches Spectura to Advance Connected Color Quality from Lab to ...

01/10/2026

Nominees revealed for 2026 Sky Arts Awards

Thursday 1 October 2026 Nominees revealed for 2026 Sky Arts Awards Current slide, 0 0, undefined1 0 Irish National Opera and Jennifer Walshe: MARS Jacob Al...

01/10/2026

Vital TV antenna replaced at Sudbury

Vital TV antenna replaced at SudburyHelicopter and broadcast engineers work together to upgrade TV services for 1.5M in the East -- Share to Linkedin Octobe...

01/10/2026

Arqiva appoints Simon Duffy as Chair

Arqiva appoints Simon Duffy as ChairSimon Duffy joins as Chair effective 01 October 2026 -- Share to Linkedin October 1, 2026 Press Office 01 October 2026...

01/10/2026

The Boys are Back! The 2 Johnnies Late Night Lock In returns for Season 4

Season 4 of the multi-award-winning hit entertainment series The 2 Johnnies Late Night Lock In is back, serving up another round of unpredictable laughs, unforg...

01/10/2026

RT lyric fm's award-winning The Lyric Feature returns for new autumn series

New season begins Sunday, 4 October at 6pm on RT lyric fm and RT Listen RT lyric fm's arts and culture documentary series The Lyric Feature returns on S...

01/10/2026

RT Supporting the Arts is supporting 32 cultural events nationwide this October

RT is proud to continue its commitment to supporting and celebrating the arts across Ireland this October, highlighting a vibrant programme of theatre, music, ...

30/09/2026

Sync Audio release MegaMorph

Add an envelope generator to any plug-in Sync Audio's latest creation is a handy utility plug-in that can be used to combine and modulate other effects ...

30/09/2026

Strymon launch the La Brea

All-analogue tape-style drive joins Series A Strymon's reputation was built on their digital knowhow, so many were surprised (and intrigued) when they a...

30/09/2026

Sonuscore The Pulse: Synth Wave & Epic Atmospheres

Two new expansion packs released Sonuscore have just introduced two new expansion packs for The Pulse, its production engine instrument for modern cinematic...

30/09/2026

Clear-Com's Arcadia Central Station Brings Professional Production Communications to...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

30/09/2026

Harmonic Launches Recon Product Family Developed in Partnership with Comcast

New Solution Expands Harmonic's Network Intelligence Portfolio and Brings Comcast-Developed Fiber Monitoring Technology to Broadband Operators, Providing Re...

30/09/2026

Claire Brock and Sophie Morris discover how consumers can shop smarter in new RT documentary series

How to Shop Well Now starts Monday at 9.35pm on RT One and RT Player On the...

29/09/2026

Zynaptiq introduce Loud & Wide

Two new plug-ins launch alongside updated bundles Zynaptiq have just announced the launch of two new plug-ins, alongside new and improved versions of two of...

29/09/2026

Wes Audio unveil the ngOmniBox

All-in-one bus processor revealed Wes Audio's ng product range has come a long way since it was first introduced, and now includes a tasty selection of ...

29/09/2026

First Baptist Nashville Drastically Upgrades Production Communications with...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

29/09/2026

SES Successfully Prices 500 million Eurobond

NOT FOR RELEASE, PUBLICATION OR DISTRIBUTION IN OR INTO OR TO ANY PERSON LOCATED OR RESIDENT IN, OR AT ANY ADDRESS IN, THE UNITED STATES OF AMERICA, ITS TERRITO...

29/09/2026

The energy transition will only succeed if it lasts

We tend to think we live in a digital world, with hopes and fears around artificial intelligence (AI), quantum computing, data centres and the next big technolo...

29/09/2026

Apple releases new guide to help families build healthy digital habits - UPDATE - Posted on 29 September 2026

Today, in partnership with the American Academy of Pediatrics (AAP), Apple relea...

29/09/2026

Final Cut Camera now supports variable aperture on iPhone\u00A018\u00A0Pro - UPDATE - Posted on 29 September 2026

Final Cut Camera, the professional filming app for iPhone, receives a major upda...

29/09/2026

RT lyric fm launch the hunt for Choirs for Christmas

RT lyric fm is proud to announce the annual Choirs for Christmas competition callout. Warm up those vocal chords and join us on RT lyric fm for a celebration ...

28/09/2026

Scaler Music introduce Scaler EQ Pro

EQ plug-in can now be played via MIDI Scaler Music have recently released a new and improved version of their patented musical EQ plug-in, kitting it out wi...

28/09/2026

The Asura from Animal Factory Amps

New synth developed in collaboration with philterSoup Boutique effects pedal and Eurorack manufacturer Animal Factory Amps have announced that the new compa...

28/09/2026

Rohde & Schwarz adds an integrated multi-channel pulse analysis option to its FSWX signal and spectrum analyzer

Rohde & Schwarz adds an integrated multi-channel pulse analysis option to its FS...

28/09/2026

Sky launches Full Fibre 1.6 Gbps for millions of homes

Monday 28 September 2026 Sky launches Full Fibre 1.6 Gbps for millions of homes Sky has launched a new Full Fibre 1.6 Gbps product, rolling out from today, gi...

28/09/2026

Arvato Systems Highlights Its Role for Automakers and Suppliers

Arvato Systems Highlights It's Role for Automotive Manufacturers and Suppliers TISAX Arvato Systems has successfully completed the TISAX Level 3 assess...

28/09/2026

Crimecall returns for a brand-new series

Crimecall, presented by Carla O'Brien, returns tonight for a brand new series at 9.35pm on RT One and RT Player. In tonight's episode, alongside appe...

28/09/2026

RT SHORT STORY COMPETITION 2026 - SHORTLISTED STORIES ANNOUNCED

CELEBRATING 40 YEARS AT THE HEART OF NEW IRISH WRITING LIVE FROM POETRY IRELAND, DUBLIN AND ON RT RADIO 1 FROM 7PM DETAILS: www.rte.ie/writing | FOLLOW: #r...

27/09/2026

Boss launch the EX-4 Effects Expander

New compact pedal packs in 120 effects The latest multi-effects pedal from Boss is a compact unit that promises to give any pedalboard a massive boost in s...

26/09/2026

Native Instruments update Maschine

Launched alongside three new expansion packs In celebration of their 30th anniversary, Native Instruments have released a major update for their Maschine 3 ...

25/09/2026

Antares release AutoTune Advanced

Algorithm update & new DVA vibrato-detection engine A new flagship version of Antares' iconic pitch-correction software has arrived, and along with a co...

25/09/2026

Two notes to launch the Captor X Pro

New flagship unit to arrive in early 2027 Two notes Audio Engineering have revealed that a new and improved version of their hugely popular reactive load bo...

25/09/2026

Finalist 2 from Tim Exile

AI-free mixing tool gets an upgrade Launched in October 2025, Tim Exiles Finalist is an algorithmic mixing tool that's been designed for those who don&#...

25/09/2026

Rohde & Schwarz Mobile Test Summit 2026 puts the spotlight on 6G - registrations open

Rohde & Schwarz Mobile Test Summit 2026 puts the spotlight on 6G - registrations...

25/09/2026

IBC 2026: When Intelligence Became the Industry's New Competitive Advantage

In our latest blog, Tim Pearson reflects on IBC 2026 and considers the main learnings against an industry that saw AI finally coming out of the labs and into pr...

25/09/2026

How to watch an unmissable weekend of womens football on Sky Sports and NOW

Friday 25 September 2026 How to watch an unmissable weekend of women's football on Sky Sports and NOW Sky Sports and NOW will broadcast seven live games f...

25/09/2026

YAGA trailer released, coming exclusively to Sky and NOW on 31 October in the UK and Ireland

Friday 25 September 2026 YAGA trailer released, coming exclusively to Sky and N...

25/09/2026

'Watch this space: a new strategic direction for UK media'.

Watch this space: a new strategic direction for UK media. Arqiva has submitted its response to the Governments Green Paper on the future of television distribut...

25/09/2026

Last chance to apply to be part of this year's Late Late Toy Show

Want to be part of this year's Late Late Toy Show? Final call for applications in search for this year's stars The most wonderful night of the year is...