Sony Pixel Power calrec Sony

NVIDIA Researchers Harness Real-Time Gen AI to Build Immersive Desert World

31/07/2024

NVIDIA researchers used NVIDIA Edify, a multimodal architecture for visual generative AI, to build a detailed 3D desert landscape within a few minutes in a live demo at SIGGRAPH's Real-Time Live event on Tuesday.

During the event - one of the prestigious graphics conference's top sessions - NVIDIA researchers showed how, with the support of an AI agent, they could build and edit a desert landscape from scratch within five minutes. The live demo highlighted how generative AI can act as an assistant to artists by accelerating ideation and generating custom secondary assets that would otherwise have been sourced from a repository.

By drastically decreasing ideation time, these AI technologies will empower 3D artists to be more productive and creative - giving them the tools to explore concepts faster and expedite parts of their workflows. They could, for example, generate the background assets or 360 HDRi environments that the scene needs in minutes, instead of spending hours finding or creating them.

From Idea to 3D Scene in Three Minutes Creating a full 3D scene is a complex, time-consuming task. Artists must support their hero asset with plenty of background objects to create a rich scene, then find an appropriate background and an environment map to light it. Due to time constraints, they've often had to make a trade-off between rapid results and creative exploration.

With the support of AI agents, creative teams can achieve both goals: quickly bring concepts to life and continue iterating to achieve the right look.

In the Real-Time Live demo, the researchers used an AI agent to instruct an NVIDIA Edify-powered model to generate dozens of 3D assets, including cacti, rocks and the skull of a bull - with previews produced in just seconds.

They next directed the agent to harness other models to create potential backgrounds and a layout of how the objects would be placed in the scene - and showcased how the agent could adapt to last-minute changes in creative direction by quickly swapping the rocks for gold nuggets.

With a design plan in place, they prompted the agent to create full-quality assets and render the scene as a photorealistic image in NVIDIA Omniverse USD Composer, an app for virtual world-building.

NVIDIA Edify Accelerates Environment Generation NVIDIA Edify models can help creators focus on hero assets while accelerating the creation of background environments and objects using AI-powered scene generation tools. The Real-Time Live demo showcased two Edify models:

Edify 3D generates ready-to-edit 3D meshes from text or image prompts. Within seconds, the model can generate previews, including rotating animations of each object, to help creators rapidly prototype before committing to a specific design.

Edify 360 HDRi uses text or image prompts to generate up to 16K high-dynamic range images (HDRi) of nature landscapes, which can be used as backgrounds and to light scenes.

During the demo, the researchers also showcased an AI agent powered by a large language model, and USD Layout, an AI model that generates scene layouts using OpenUSD, a platform for 3D workflows.

At SIGGRAPH, NVIDIA also announced that two leading creative content companies are giving designers and artists new ways to boost productivity with generative AI using tools powered by NVIDIA Edify.

Shutterstock has launched in commercial beta its Generative 3D service, which lets creators quickly prototype and generate 3D assets using text or image prompts. Its 360 HDRi generator based on Edify also entered early access.

Getty Images updated its Generative AI by Getty Images service with the latest version of NVIDIA Edify. Users can now create images twice as fast, with improved output quality and prompt adherence, and advanced controls and fine-tuning.

Harnessing Universal Scene Description in NVIDIA Omniverse The 3D objects, environment maps and layouts generated using Edify models are structured with USD, a standard format for describing and composing 3D worlds. This compatibility allows artists to immediately import Edify-powered creations into Omniverse USD Composer.

Within Composer, they can use popular digital content creation tools to further modify the scene by, for example, changing the position of objects, modifying their appearance or adjusting lighting.

Real-Time Live is one of the most anticipated events at SIGGRAPH, featuring about a dozen real-time applications including generative AI, virtual reality and live performance capture technology. Watch the replay below.
LINK: https://blogs.nvidia.com/blog/real-time-3d-generative-ai-research-sigg...
See more stories from nvidia

Europe Stories

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

14/03/2026

HISONG announce the AirStudio S1

Combines mic, USB interface & wireless IEMs Following a successful Kickstarter campaign, HISONG have announced that their innovative AirStudio S1 device is ...

13/03/2026

A New Era of Personalization: Shape Your Taste Profile on Spotify

Spotify has always been built around your taste. More than 80% of listeners say personalization is what they love most about us. Now we're taking that even ...

13/03/2026

Spotify Debuts Legends Club for Popular German-Language Podcasts With Kaulitz Hills'

The new Spotify Legends Club has opened its doors. Its members: select German-sp...

13/03/2026

Klevgrand release OneShot2

Pushing drum sampler technology into new territories The latest version of Klevgrand's software drum sampler has just arrived, boasting a newly designe...

13/03/2026

IK Multimedia update ARC On-Ear

Expanded headphone support & engine improvements IK Multimedia's recently introduced ARC On-Ear system brings the power of their monitoring-correction s...

13/03/2026

UVI introduce Mosaiq 26

Extra sound collections, more presets & new Keys category UVI's rhythm and pattern instrument has just received a major update that introduces four new ...

13/03/2026

VEON Delivers Record Digital Growth: 4Q25 Digital Revenues Grow 84% to 20.1% of Total, Driving 17% Revenue and 29% EBITDA Growth in 4Q25

13 Mar 2026 VEON Delivers Record Digital Growth: 4Q25 Digital Revenues Grow 84%...

13/03/2026

Sky Adds Blood on Snow to Original Film Slate in Acquisition Headlined by Benedict Cumberbatch and Aaron TaylorJohnson

Friday 13 March 2026 Sky Adds Blood on Snow to Original Film Slate in Acquisiti...

13/03/2026

RT announces Rick O'Shea as new presenter on RT Radio 1's Arena

RT has announced today that Rick O'Shea is the new presenter of Arena RT Radio 1's flagship weeknight arts and culture programme. Rick has been pres...

13/03/2026

Lights! Camera! Action! The 98th Oscars set to air live as RT backs the Irish nominees

Lights! Camera! Action! The 98th Oscars set to air live as RT backs the Irish n...

12/03/2026

Milano Cortina 2026: Yospace helps ad-funded rights-holders claim advertising gold

Staines-upon-Thames, UK, 11th March, 2026 - Yospace, the trusted leader in Dyna...

12/03/2026

Mon Laferte Leads All-Women Spotify Session as EQUAL Celebrations Kick Off in Latin America

In Latin America, women are shaping music and defining its future. To kick off t...

12/03/2026

Mon Laferte lidera la edicin EQUAL de Spotify Sessions, mientras comienzan las celebraciones de EQUAL en Latinoamrica

En Am rica Latina, las mujeres est n moldeando la m sica y definiendo su futuro....

12/03/2026

As Spotify Turns 20, the Most Global and Diverse Music Industry in History Has Taken Shape

Let's turn back the clock 20 years: The music landscape was a world away fro...

12/03/2026

Bad Bunny Brings the Sounds of Puerto Rico to Tokyo for Spotify's Billions Club Live

Bad Bunny is no stranger to Spotify's Billions Club. In fact, he has a whopp...

12/03/2026

At the London Book Fair, Spotify Shares Our Vision for the Future of Reading

Spotify was at the London Book Fair this week, joining conversations across the publishing industry about how people can make reading part of their daily lives....

12/03/2026

Ohlhorst Digital & Tokyo Dawn Labs launch Ancora

Mastering tool improves mono compatibility Tokyo Dawn Labs' Ohlhorst Digital range is a series of mastering-focused plug-ins developed by Jan Ohlhorst, ...

12/03/2026

Lewitt partner with Elgato

Wave FX processor integrated into four products Lewitt have teamed up with Elgato to create a new processor for the company's Wave Next product range, i...

12/03/2026

Mix Notes iOS App by David Thomas

Free tool for annotating audio files Mix Notes is a new, free iOS App that provides users with a simple way to annotate their audio files. It's been cre...

12/03/2026

Duck 2 from Devious Machines

Side-chain ducking tool gets an upgrade Devious Machines' popular side-chaining and envelope-shaping tool has just been kitted out with an improved enve...

12/03/2026

MPG Awards 2026: Shortlist announced

Ceremony to take place on 16 April 2026 The MPG (Music Producers Guild) have revealed the full shortlist for this year's MPG Awards, which will be takin...

12/03/2026

Overloud introduce Gem Comp160

Emulates three classic dbx 160 variants The latest arrival to Overloud's Gem Series plug-in range faithfully recreates not one, but three versions of th...

12/03/2026

Grainferno from Baby Audio

New granular soft synth announced Said to be their most advanced software synthesizer to date, Baby Audio's latest release has been built on a new granu...

12/03/2026

Bitwig Studio 6 launches

Latest version now live! Edit 11 March 2026 - Bitwig Studio 6 is now live, and available for all to download! The latest version of Bitwig's DAW softwa...

12/03/2026

Stereo Miking: The Sound On Sound Guide

Latest free eBook now available! Designed for recording engineers, audio-technology students and technically minded musicians, our latest free eBook deliver...

12/03/2026

Rohde & Schwarz Cybersecurity expands SITLine network encryptor portfolio - more bandwidth, higher port density, future-proof architecture

Rohde & Schwarz Cybersecurity expands SITLine network encryptor portfolio - more...

12/03/2026

Rohde & Schwarz to showcase future-proof EMC testing solutions at EMV 2026

Rohde & Schwarz to showcase future-proof EMC testing solutions at EMV 2026 Rohde & Schwarz will participate in EMV 2026, Europe's premier trade fair and c...

12/03/2026

Blue Lucy's 6 Key Tenets

Modern media operations demand a platform that unites automation, orchestration, and human oversight without compromise. In this post, we explore the six key te...

12/03/2026

Blue Lucy Technology

A deep dive into the platform Architecture The Blue Lucy platform follows a distributed microservices architecture, meaning the overall operational capability...

12/03/2026

Blue Lucy Brings Order to the AI Wild West at NAB 2026

Orchestration platform enables broadcasters to deploy multiple AI models safely with full auditability, rights protection, and regulatory oversight. LONDON, En...

12/03/2026

Riedel Expands Managed Technology Division in the Americas, Taps Jan Schaffner to Lead Regional Growth

Wuppertal March 12, 2026 Riedel Expands Managed Technology Division in the Ame...

12/03/2026

Harmonic Redefines the Economics of Video Playout with New Spectrum X Plus Media Server

Advanced Media Server Delivers Double the Channel Density at Half the Cost per C...

12/03/2026

Jam-packed weekend of Irish entertainment, sport and music across RT for St Patrick's Day

The Late Late Show Show St Patrick's Day special Dancing with the Stars f...

11/03/2026

SES Brings Satellite Connectivity to Refugees in Chad

First Medium-Earth Orbit (MEO) deployment of the emergency.lu platform for refugees and their host communities' use provides dependable broadband for humani...

11/03/2026

Reign extended for CLASSIC CAR KINGS with two more series ordered for U and U&YESTERDAY

Following a successful first series, UKTV today announces the commission of two ...

11/03/2026

Sky and CANAL+ launch new partnership to develop English-language drama

Wednesday 11 March 2026 Sky and CANAL launch new partnership to develop English-language drama Sky and CANAL are today announcing a strategic co commissioni...

11/03/2026

NTCA, Cartesian Release New Report on the Business Case for USF

NTCA, Cartesian Release New Report on the Business Case for USF March 11, 2026 Network Economics News NTCA - March 11, 2026 - As the FCC and Congr...

11/03/2026

The 2026 RT Short Story Competition is now open for entries

TELL US YOUR (SHORT) STORIES The 2026 RT Short Story Competition is now open for entries Recognising and rewarding the best new Irish fiction writing for...

11/03/2026

Celtic Media Festival 2026 Nominees Announced

RT 's The Traitors Ireland is among the nominees for the 2026 Celtic Media Festival Torc Awards for Excellence, announced today....

10/03/2026

VEON's Largest Market Pakistan Almost Triples Mobile Spectrum in Reform Push; Jazz Secures Largest Allocation with 190 MHz

10 Mar 2026 VEON's Largest Market Pakistan Almost Triples Mobile Spectrum i...

09/03/2026

Duality Strings Bundle from VSL

Contains all six dual-ensemble libraries VSL's Duality Strings series offers an intriguing alternative to your average string library, capturing two str...

09/03/2026

The 1975 to receive MPG Award

Outstanding Contribution To UK Music Photo: Samuel Bradley Ahead of their upcoming MPG Awards, the Music Producers Guild (MPG) have revealed the latest win...

09/03/2026

Strymon reveal the PCH X1 & X2

Two new high-quality DI boxes announced Boasting some impressive technical specifications and versatile routing options, Strymon's latest active DI boxe...

09/03/2026

Sonora Cinematic introduce Pure Steel String

Latest MPE-capable Soundbox library released The follow-up release for Sonora Cinematic's Pure Nylon has arrived, and becomes the latest addition to the...