Grab the steering wheel. Step on the accelerator. Take a joyride through a 3D urban neighborhood that looks like Tokyo, or New York, or maybe Rio de Janeiro - all imagined by AI.
We've introduced at this week's NeurIPS conference AI research that allows developers to render fully synthetic, interactive 3D worlds. While still early stage, this work shows promise for a variety of applications, including VR, autonomous vehicle development and architecture.
The tech is among several NVIDIA projects on display here in Montreal. Attendees huddled around a green and black racing chair in our booth have been wowed by the demo, which lets drivers navigate around an eight-block world rendered by the neural network.
Visitors to the booth hopped into the driver's seat to tour the virtual environment. Azin Nazari, a University of Waterloo grad student, was impressed with the AI-painted scene, which can switch between the streets of Boston, Germany, or even the Grand Theft Auto game environment at sunset.
The demo uses Unreal Engine 4 to generate semantic layouts of scenes. A deep neural network trained on real-world videos fills in the features - depicting an urban scene filled with buildings, cars, streets and other objects.
This is the first time neural networks have been used with a computer graphics engine to render new, fully synthetic worlds, say NVIDIA researchers Ting-Chun Wang and Ming-Yu Liu.
With this ability, developers will be able to rapidly create interactive graphics at a much lower cost than traditional virtual modeling, Wang said.
Called vid2vid, the AI model behind this demo uses a deep learning method known as GANs to render photorealistic videos from high-level representations like semantic layouts, edge maps and poses. As the deep learning network trains, it becomes better at making videos that are smooth and visually coherent, with minimal flickering between frames.
Hitting a new state-of-the-art result, the researchers' model can synthesize 30-second street scene videos in 2K resolution. By training the model on different video sequences, the model can paint scenes that look like different cities around the world.
For those in Montreal this week, stop by our booth - No. 209 - to sit behind the wheel and try it out for yourself.
A TITAN Tangles with DOPE Two of the latest pieces of NVIDIA hardware - the new TITAN RTX GPU and the NVIDIA DGX-2 system - are also under the spotlight in the NVIDIA booth.
NeurIPS attendees stopped to marvel at the new NVIDIA TITAN RTX GPU. Opposite of them, attendees are flocking to a table stacked with an odd assortment of items - cans of tomato soup and spam, a box of crackers, a mustard bottle. It may not sound like much, but this demo is DOPE. Literally.
DOPE, or Deep Object Pose Estimation, is an algorithm that detects the pose of known objects using a single RGB camera. It's an ability that's essential for robots to grasp these objects.
Giving new meaning to hands-on demos, booth visitors can pick up the cracker box and cans, moving them across the table and changing their orientation. A screen above displays the neural network's inferences, tracking the objects' edges as they shift around the scene.
It's a $30 camera, very cheap, very accessible for anyone interested in robotics, said NVIDIA researcher Jonathan Tremblay. The tool, trained entirely on computer-generated image data, is publicly available on GitHub.
DOPE can determine the edges of these household objects,even when they're partly hidden behind other objects, or moved around by booth visitors. Booth visitors can also feast their eyes on stunning demos of real-time ray tracing. Running on a single Quadro RTX 6000 GPU, our Star Wars demo features beautiful, cinema-quality reflections enabled by NVIDIA RTX technology.
And while a few conspiracy theorists still question whether the Apollo 11 mission actually landed on the moon, a ray-traced recreation of one iconic lunar landing image shows that the photo looks just as it should if it were taken on the moon.
Data scientists exploring the booth will see the new TITAN RTX in action with the RAPIDS data analytics software, quickly manipulating a dataset of all movie ratings by IMDB users. Other demos showcase the computing power NVIDIA TensorRT software provides for inference, both in data centers and at the edge.
The NVIDIA booth at NeurIPS is open all week from 10am to 7pm. For more, see our full schedule of activities.
Most recent headlines
04/08/2024
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet, a leading technology and service provider for media-rich organizations, a...
29/04/2024
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......
29/04/2024
Codemill aims to revolutionize media workflow efficiency at this years NAB Show by introducing Just-In-Time (JIT) playback technology in Accurate.Video Validate...
29/04/2024
April 29, 2024
-- TF1 Chooses Broadpeak to Power Targeted Advertising for New...
29/04/2024
LOS ANGELES Allen Media Group (AMG) has partnered with LG Electronics to bring 223 Local Now FAST channels to LG's free streaming service, LG Channels, avai...
29/04/2024
OTTAWA Ross Video has announced the introduction of Raiden, a data-driven weather graphics software that combines data gathering, processing, and visualization ...
29/04/2024
Panalux, a leading rental provider of lighting and power solutions for the motion-picture industry and part of Panavision's end-to-end service offerings for...
29/04/2024
Cobalt Iron Inc., a leading provider of SaaS-based enterprise data protection, today announced that it has received a patent on its technology for dynamic autho...
29/04/2024
SDVI, the leading platform provider for cloud-native media supply chains, today announced that Rally Access Workstation, a fully managed solution for editing in...
29/04/2024
Premier Sports, a premium sports broadcaster, has selected QuickLink's Remote Commentary solution for introducing professional, high-quality remote commenta...
29/04/2024
Glookast has chosen Jigsaw24 Media as the only UK channel partner to represent their portfolio of ingest and workflow optimisation products. The agreement, sign...
29/04/2024
Clear-Com played a pivotal role in the seamless coverage of the recent solar eclipse on April 8, 2024. Leveraging its cutting-edge Eclipse HX Digital Matrix i...
29/04/2024
PlayBox Neo will promote its complete range of television channel management, graphic branding and playout solutions to EMEA region media content owners and bro...
29/04/2024
Lingo, RuPaul's word-twisting game show, returns for season two on CBS Friday, May 24. Two episodes air that night, and stream on Paramount Plus, too....
29/04/2024
ESPN and Amazon Prime Video are reportedly close to scoring television rights to the National Basketball Association, according to published reports....
29/04/2024
Judge Judy and Hot Bench, CBS Media Ventures' genre-leading court shows, have been renewed through the 2025-26 TV season in more than 95% of the country, Gr...
29/04/2024
Premier Sports, an Irish-based premium sports broadcaster, has selected QuickLink's Remote Commentary solution for introducing professional, high-quality re...
29/04/2024
The awards celebrate the craft of behind-the-scenes TV talent and the best programmes of 2023
By Matthew Corrigan
Published: April 29, 2024
The awards cel...
29/04/2024
The team at Milk had to create and deliver the VFX and environment work for the royal residences featured in the drama from scratch
By Jenny Priestley
Publis...
29/04/2024
CEO Bob Bakish is expected to leave the company as early as today, with a new leadership committee likely to run the company on an interim basis
By Jenny Pries...
29/04/2024
Albena Ivanova, director, media and entertainment and strategic products at CHAOS talks to TVBEurope about her route into the industry
By TVBEurope Staff
Pub...
29/04/2024
The acquisition gives Grand Technix the opportunity to expand its footprint in the audio visual and broadcast technology sectors
By Jenny Priestley
Published...
29/04/2024
29 04 2024 - Media release Screen Australia announces James J. Robinson's debut feature First Light
First Light
Principal Photography is underway on Firs...
29/04/2024
Capitol Broadcasting recently became the inaugural company honored with inductio...
29/04/2024
Tonight on Smoke and Mirrors: Fanyana feels embarrassed about his sexual mishapDon't miss Monday, 29 April's riveting episode of South African soapie Sm...
29/04/2024
Talk about commitment. When startup SEA.AI, an NVIDIA Metropolis partner, set out to create a system that would use AI to scan the seas to enhance maritime safe...
28/04/2024
Mediahaus delivers the first SRT live-streaming sports production over 5G with U...
27/04/2024
On April 26, L3Harris Chair and CEO Christopher E. Kubasik joined CNBC's Mor...
27/04/2024
PORTLAND, Oregon Audinate Group Limited, the developer of the Dante AV-over-IP solution, announced significant new additions to Dante Connect, its cloud-based D...
27/04/2024
TORONTO Bell Media has launched 10 English and French-language FAST channels featuring entertainment, factual, news, and sports programming. The new free stream...
27/04/2024
An extensive new analysis of the news segments in the broadcast evening news programs of ABC, CBS, NBC and PBS has found that broadcasters devoted most of their...
27/04/2024
GERMANTOWN, Md. EchoStar's Hughes Network Systems has opened a new manufacturing facility and private 5G incubation center in Germantown, Maryland....
27/04/2024
Harry Pappas, one of three brothers who founded Pappas Telecasting Companies in 1971, died April 24. He was 78 years old....
27/04/2024
ATLANTA and LONDON Mexican telecommunications and broadcast company Televisa has selected Synamedia for an overhaul of its broadcast distribution....
27/04/2024
Participate in the Survey - The Impact of AI on Media and the Creative Industry
Pascal Wagner April 26, 2024
0 Comments
By participating in this surve...
27/04/2024
SDVI Rally Access Workstation Earns Two Top Awards at 2024 NAB Show
Brie Clayton April 26, 2024
0 Comments
SDVI, the leading platform provider for clo...
27/04/2024
Berklee's Music and Health Institute Launches Community Health Musician Cert...
27/04/2024
Charter Communications reported higher first-quarter profits despite continued cord-cutting and competition for broadband customers....
27/04/2024
Two environmentally-focused groups are partnering to engage the unscripted TV world in finding better ways to address climate change. Reality of Change is an ec...
27/04/2024
Sarah Garcia has been promoted to weekend anchor at KTLM McAllen, Texas, known as Telemundo 40. Starting April 27, she will anchor Noticias Telemundo 40 weekend...
27/04/2024
CBS Sports said it launched a new 24-hour free, ad supported streaming television (FAST) channel devoted to the UEFA Champions League....
27/04/2024
Comcast chairman and CEO Brian Roberts received $35.4 million in compensation in 2023, up 11% from the previous year, according to a proxy statement filed by th...
27/04/2024
Art Happens Here With John Lithgow, which sees the actor study dance, ceramics, silk-screen printing and vocal jazz with students in Los Angeles, debuts on PBS ...
27/04/2024
Remember Leave It to Beaver? Bewitched? Dragnet? When cable ratings were rising?...
27/04/2024
Next up for the weekend binge at Catchy Comedy is Gomer Pyle, U.S.M.C. Every weekend, Catchy Comedy features The Catchy Binge, a marathon of a classic sitcom....
26/04/2024
Sundance Film Festival CDMX 2024 kicks-off today with screenings in 5 theaters in Mexico City and the opening-night film, FRIDA, directed by Carla Guti rrez...
26/04/2024
[Editor's Note: This interview is part of a larger feature about the women d...
26/04/2024
Once again this year, SGL Carbon opened its doors to interested children and young people. On the occasion of the German Girls and Boys Day, which took place on...
Grab the steering wheel. Step on the accelerator. Take a joyride through a 3D urban neighborhood that looks like Tokyo, or New York, or maybe Rio de Janeiro - all imagined by AI.
