Sony Pixel Power calrec Sony

NVIDIA Research Takes NeurIPS Attendees on AI Road Trip

04/12/2018

Grab the steering wheel. Step on the accelerator. Take a joyride through a 3D urban neighborhood that looks like Tokyo, or New York, or maybe Rio de Janeiro - all imagined by AI.

We've introduced at this week's NeurIPS conference AI research that allows developers to render fully synthetic, interactive 3D worlds. While still early stage, this work shows promise for a variety of applications, including VR, autonomous vehicle development and architecture.

The tech is among several NVIDIA projects on display here in Montreal. Attendees huddled around a green and black racing chair in our booth have been wowed by the demo, which lets drivers navigate around an eight-block world rendered by the neural network.

Visitors to the booth hopped into the driver's seat to tour the virtual environment. Azin Nazari, a University of Waterloo grad student, was impressed with the AI-painted scene, which can switch between the streets of Boston, Germany, or even the Grand Theft Auto game environment at sunset.

The demo uses Unreal Engine 4 to generate semantic layouts of scenes. A deep neural network trained on real-world videos fills in the features - depicting an urban scene filled with buildings, cars, streets and other objects.

This is the first time neural networks have been used with a computer graphics engine to render new, fully synthetic worlds, say NVIDIA researchers Ting-Chun Wang and Ming-Yu Liu.

With this ability, developers will be able to rapidly create interactive graphics at a much lower cost than traditional virtual modeling, Wang said.

Called vid2vid, the AI model behind this demo uses a deep learning method known as GANs to render photorealistic videos from high-level representations like semantic layouts, edge maps and poses. As the deep learning network trains, it becomes better at making videos that are smooth and visually coherent, with minimal flickering between frames.

Hitting a new state-of-the-art result, the researchers' model can synthesize 30-second street scene videos in 2K resolution. By training the model on different video sequences, the model can paint scenes that look like different cities around the world.

For those in Montreal this week, stop by our booth - No. 209 - to sit behind the wheel and try it out for yourself.

A TITAN Tangles with DOPE Two of the latest pieces of NVIDIA hardware - the new TITAN RTX GPU and the NVIDIA DGX-2 system - are also under the spotlight in the NVIDIA booth.

NeurIPS attendees stopped to marvel at the new NVIDIA TITAN RTX GPU. Opposite of them, attendees are flocking to a table stacked with an odd assortment of items - cans of tomato soup and spam, a box of crackers, a mustard bottle. It may not sound like much, but this demo is DOPE. Literally.

DOPE, or Deep Object Pose Estimation, is an algorithm that detects the pose of known objects using a single RGB camera. It's an ability that's essential for robots to grasp these objects.

Giving new meaning to hands-on demos, booth visitors can pick up the cracker box and cans, moving them across the table and changing their orientation. A screen above displays the neural network's inferences, tracking the objects' edges as they shift around the scene.

It's a $30 camera, very cheap, very accessible for anyone interested in robotics, said NVIDIA researcher Jonathan Tremblay. The tool, trained entirely on computer-generated image data, is publicly available on GitHub.

DOPE can determine the edges of these household objects,even when they're partly hidden behind other objects, or moved around by booth visitors. Booth visitors can also feast their eyes on stunning demos of real-time ray tracing. Running on a single Quadro RTX 6000 GPU, our Star Wars demo features beautiful, cinema-quality reflections enabled by NVIDIA RTX technology.

And while a few conspiracy theorists still question whether the Apollo 11 mission actually landed on the moon, a ray-traced recreation of one iconic lunar landing image shows that the photo looks just as it should if it were taken on the moon.

Data scientists exploring the booth will see the new TITAN RTX in action with the RAPIDS data analytics software, quickly manipulating a dataset of all movie ratings by IMDB users. Other demos showcase the computing power NVIDIA TensorRT software provides for inference, both in data centers and at the edge.

The NVIDIA booth at NeurIPS is open all week from 10am to 7pm. For more, see our full schedule of activities.
LINK: https://blogs.nvidia.com/blog/2018/12/04/nvidia-research-neurips-demos...
See more stories from nvidia

Most recent headlines

09/11/2025

Dalet Unveils Agentic AI Media Workflows at IBC2025

Dalet today announced a transformative leap forward for media operations: Agentic Artificial Intelligence (AI) that unifies the Dalet ecosystem under one natura...

22/10/2025

Prime Video Inks Deal To Present NFL Black Friday Game Worldwide

Prime Video Inks Deal To Present NFL Black Friday Game Worldwide By SVG Staff Wednesday, October 22, 2025 - 10:06 am Print This Story | Subscribe Story ...

22/10/2025

NBA Tip-Off: ESPN Goes 1080p HDR End-to-End, Flipping HDR Switch on REMI and REMCO Shows

NBA Tip-Off: ESPN Goes 1080p HDR End-to-End, Flipping HDR Switch on REMI and REM...

22/10/2025

FloSports Empowers Division II, III Athletic Departments With Turnkey Production Suite for Livestreaming Production

FloSports Empowers Division II, III Athletic Departments With Turnkey Production...

22/10/2025

Wall Street Video Summit Debuts, Bringing Together 200 Financial Enterprise Video Executives in NYC

Wall Street Video Summit Debuts, Bringing Together 200 Financial Enterprise Vide...

22/10/2025

Dueling Pianos: International Chopin Piano Competition Is as Competitive as a Ballgame - and Has Amazing Audio

Dueling Pianos: International Chopin Piano Competition Is as Competitive as a Ba...

22/10/2025

Celebrate the Anniversaries of Shakira's Landmark Albums With Spotify-Exclusive EP and Video Special

In 1995, a young Colombian artist released an album that would change Latin pop ...

22/10/2025

SGL Carbon expands sustainable energy supply and invests in photovoltaic system at Meitingen site

Over the past few months, a photovoltaic system has been installed on a three-he...

22/10/2025

Orion Meets SLS: L3Harris Technology Ready to go to the Moon

The Orion spacecraft for NASA's Artemis II mission is stacked on the Space Launch System (SLS) rocket in High Bay 3 of the Vehicle Assembly Building at Kenn...

22/10/2025

Hybrid SATCOM: Delivering Resilient and Agile Connectivity Today

L3Harris' Hybrid SATCOM is resilient by design, offering path diversity that eliminates vulnerabilities by routing data across the best available networks i...

22/10/2025

The 2025 NAB Show New York Opens With More Than 12,000 Attendees Expected

WASHINGTON, D.C. Organizers of NAB Show New York said they are expecting more than 12,000 registered attendees from about 100 countries along with 260 exhibitor...

22/10/2025

The 2025 NAB Show New York Set to Open with More Than 12,000 Attendees Expected

WASHINGTON, D.C The organizers of The 2025 NAB Show New York have announced that they are expecting more than 12,000 registered attendees from about 100 countr...

22/10/2025

Masque Sound and Jaffe Holden Create Transformative Perfo...

Masque Sound, a leading theatrical sound reinforcement, installation and design company, supplied an extensive gear package of professional-grade equipment for ...

22/10/2025

Lightware UCX-3x3-TPX-RX20 sets new standard for connecte...

Lightware, a global leader in signal management and AV connectivity solutions, is seeing strong market momentum for the UCX-3x3-TPX-RX20, a compact transmitter-...

22/10/2025

Chyron Releases PAINT 10.2 Telestration Platform

MELVILLE, N.Y. Chyron has released PAINT 10.2, the latest update for its telestration platform, adding support for SMPTE ST 2110 IP workflows, expanding brandin...

22/10/2025

NBCUniversal Invests in ATSC 3.0 Authority Behind Run3TV

WASHINGTON Run3TV today said NBCUniversal is joining as an investor in the ATSC 3.0 Framework Authority, which develops the Run3TV NextGen TV application platfo...

22/10/2025

swXtch.io to Feature SRT-X Gateway, groundSwXtch at NAB Show New York

ATLANTA swXtch.io will feature two new networking solutions extending the company's reach across more cloud and on-prem workflows at NAB Show New York, set ...

22/10/2025

HBO Max Increases Prices for All Tiers

The Warner Bros. Discoverys HBO Max streaming services has increased prices for all its streaming tiers effectively immediately for new customers. Existing cust...

22/10/2025

OpenDrives Inks Agreement With Versatile Distribution Services

LOS ANGELES OpenDrives has signed a new distribution partnership deal with Versatile Distribution Services (VDS) to strengthen its channel and streamline how it...

22/10/2025

The 2025 NAB Show New York Set to Open with More Than 12,000 Attendees

WASHINGTON, D.C The organizers of The 2025 NAB Show New York have announced that they are expecting more than 12,000 registered attendees from about 100 countr...

22/10/2025

Samora Pinderhughes Brings Immersive Sound to Berklee's Signature Series

Samora Pinderhughes Brings Immersive Sound to Berklee's Signature Series The artist and composer, who's worked with Herbie Hancock, Robert Glasper, Co...

22/10/2025

BMI Day at Berklee Celebrates Composer Fil Eisler and Awards Scholarship to Student Jack Ryan

BMI Day at Berklee Celebrates Composer Fil Eisler and Awards Scholarship to Stud...

22/10/2025

Tribeca Announces Star-Studded Lineup of Membership Events Featuring Tracy Morgan, Alex Rodriguez, and Lucy Liu

October 22nd, 2025 TRIBECA ANNOUNCES STAR-STUDDED LINEUP OF MEMBERSHIP EVENTS F...

22/10/2025

Rohde & Schwarz and TRUMPF cooperate in drone defense

Rohde & Schwarz and TRUMPF cooperate in drone defense Rohde & Schwarz and TRUMPF partner to deliver a comprehensive drone defense solution combining Rohde & S...

22/10/2025

ARTE Enhances Live Production Capabilities with Grass Valley's NativeIP Solutions

European Broadcaster Upgrades To Grass Valley's NativeIP LDX 135 Cameras And...

22/10/2025

Everyone Gets a Better Deal on Verizon with New FOX One Perk

Everyone Gets a Better Deal on Verizon with New FOX One Perk The $15 FOX One streaming service perk is yet another way Verizon continues to add savings for cu...

22/10/2025

First look promo Hidden Assets Series 3

First Look Hidden Assets Series 3 Premieres on 9th November 9:30pm on RT One & RT Player WATCH HERE Promo Link: Hidden Assets Series 3 | RT The Crimin...

21/10/2025

NAB New York 2025: Although AES Show Is on Its Own, Audio Will Be a Major Part of the East Coast Expo

NAB New York 2025: Although AES Show Is on Its Own, Audio Will Be a Major Part o...

21/10/2025

NAB New York 2025: Business of Broadcast and Media,' Future of Content' Are Themes for Two-Day Show

NAB New York 2025: Business of Broadcast and Media,' Future of Content'...

21/10/2025

SVG All-Stars: Ethan Folz, Senior Director, Digital Operations and Quality of Experience, DTC Products, Tech, and Operations, NBA

SVG All-Stars: Ethan Folz, Senior Director, Digital Operations and Quality of Ex...

21/10/2025

NBA on NBC/Peacock: Livestream Offers Graphic Overlays, Predictive Gaming, Ancillary Camera Angles, Real-Time Highlights

NBA on NBC/Peacock: Livestream Offers Graphic Overlays, Predictive Gaming, Ancil...

21/10/2025

NBA on NBC/Peacock: At the Front Bench With Producer Frank DiGraci and Director Pierre Moossa

NBA on NBC/Peacock: At the Front Bench With Producer Frank DiGraci and Director ...

21/10/2025

NBA on NBC/Peacock: NBC Sports, NEP Build Ultra-Flexible Production Plan That Seamlessly Blends Onsite, REMI Models

NBA on NBC/Peacock: NBC Sports, NEP Build Ultra-Flexible Production Plan That Se...

21/10/2025

What to Watch: 6 Indigenous-Led Contemporary Stories Supported by the Documentary Film Program

Indigenous storytelling has been at the heart of the work of the Sundance Instit...

21/10/2025

2026 Sundance Film Festival Announces Park City Legacy Program Featuring Archival Screenings, Special Talks, and Culmination Event

Top L-R: Mysterious Skin, American Dream Second Row L-R: Little Miss Sunshine, D...

21/10/2025

DEADBEAT' Delivered a Raw Communal Party With Tame Impala and The Dare in Brooklyn

Last week, Spotify and Columbia Records transformed Pier 4 at the Brooklyn Army ...

21/10/2025

SBS Learn's Dharug Ngurra resource empowers classrooms to meaningfully celebrate NSW Aboriginal Languages Week

SBS Learn's Dharug Ngurra resource empowers classrooms to meaningfully celeb...

21/10/2025

Turning Viewers into Promoters: What Rising NPS Scores Tell Us About the Power of Experience

As global operators simplify and evolve their digital platforms, NPS improvement...

21/10/2025

L3Harris Successfully Completes Important Milestone for Army SATCOM Program

Critical Design Review completion is a key milestone on the path toward Wideband Global Satellite Communications certification for the network in 2026, opening ...

21/10/2025

In the Undersea Domain - Reliability is Key

New Australian undersea training range to implement and improve warfighting tactics, proficiency and safety; enable joint/allied training that contributes to pr...

21/10/2025

WWTV Bridges 48 Miles with Bold IP Studio Upgrade, Powered by Clear-Com and Key Code Media

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

21/10/2025

The Gauge: Poland | September 2025

September, the beginning of autumn, brought an expected revival to the TV market, largely due to the new fall TV schedules. The time spent in front of the TV sc...

21/10/2025

Nielsen: September Football Blitz Leads to Historic Monthly Spike in Broadcast Viewership

Broadcast Booms with 20% Uptick vs. August, Achieving Largest Monthly Increase ...

21/10/2025

THE GAUGE: MEXICO SEPTEMBER 2025

During September, streaming's share of TV viewing in Mexico settled at 24.5%, a marginal shift of -0.5 share points from the previous month. Disclaimer: YU...

21/10/2025

BBright, GlobalM Successfully Trial End-to-End UHD Interoperability

RENNES, France BBright and GlobalM have conducted a technical trial validating Ultra HD interoperability across the entire contribution chain in the cloud, achi...

21/10/2025

Kokusai Denki To Debut New 4K Camera at 2025 NAB Show New York

Kokusai Denki Electric America will mark the U.S. debut of a new 4K camera at the 2025 NAB New York, Oct. 22-23. Now available, the Z-HD6500-S1 UHD/HD productio...

21/10/2025

Triveni Digital to Showcase Industrys Most Comprehensive...

Triveni Digital, a trusted leader in ATSC 1.0 and 3.0 service delivery, data broadcasting, and quality assurance solutions, will showcase its entire NEXTGEN TV ...

21/10/2025

Radio Azzurra Advances to Digital Workflow with DHD SX2 A...

Radio Azzurra FM, longest-running radio station in the province of Novara, northwest Italy, has invested in an DHD SX2 audio routing and mixing console for inte...

21/10/2025

Globecast Appoints G Morgan as EVP of Sales for Globecast...

Globecast, the leading provider of broadcast, media and entertainment managed services, has announced the appointment of G Morgan as Executive Vice President of...