NVIDIA Research Wins Autonomous Driving Challenge, Innovation Award at CVPR
15/06/2023
The competition had more than 400 submissions from nearly 150 teams across 10 regions.
3D occupancy prediction is the process of forecasting the status of each voxel in a scene, that is, each data point on a 3D bird's-eye-view grid. Voxels can be identified as free, occupied or unknown.
Critical to the development of safe and robust self-driving systems, 3D occupancy grid prediction provides information to autonomous vehicle (AV) planning and control stacks using state-of-the-art convolutional neural networks and transformer models, which are enabled by the NVIDIA DRIVE platform.
NVIDIA's winning solution features two important AV advancements, said Zhiding Yu, senior research scientist for learning and perception at NVIDIA. It demonstrates a state-of-the-art model design that yields excellent bird's-eye-view perception. It also shows the effectiveness of visual foundation models with up to 1 billion parameters and large-scale pretraining in 3D occupancy prediction.
Perception for autonomous driving has evolved over the past years from handling 2D tasks, such as detecting objects or free spaces in images, to reasoning about the world in 3D with multiple input images.
This now provides a flexible and precise fine-grained representation of objects in complex traffic scenes, which is critical for achieving the safety perception requirements for autonomous driving, according to Jose Alvarez, director of AV applied research and distinguished scientist at NVIDIA.
Yu will present the NVIDIA Research team's award-winning work at CVPR's End-to-End Autonomous Driving Workshop on Sunday, June 18, at 10:20 a.m. PT, as well as at the Vision-Centric Autonomous Driving Workshop on Monday, June 19, at 4:00 p.m. PT.
In addition to winning first place in the challenge, NVIDIA will receive at the event an Innovation Award, recognizing its fresh insights into the development of view transformation modules, with substantially improved performance compared to previous approaches, according to the CVPR workshop committee.
Read NVIDIA's technical report on the submission.
Safer Vehicles With 3D Occupancy Prediction While traditional 3D object detection - detecting and representing objects in a scene, often using 3D bounding boxes - is a core task in AV perception, it has its limitations. For example, it lacks expressiveness, meaning the bounding boxes might not represent enough real-world information. It also requires defining taxonomies and ground truths for all possible objects, even ones rarely seen in the real world, such as road hazards that may have fallen off a truck.
In contrast, 3D occupancy prediction provides rich information about the world to a self-driving vehicle's planning stack, which is necessary for end-to-end autonomous driving.
Software-defined vehicles can be continuously upgraded with new developments that are proven and validated over time. State-of-the-art software updates that evolve from research initiatives, such as the ones recognized at CVPR, are enabling new features and safer driving capabilities.
The NVIDIA DRIVE platform offers a path to production for automakers, providing full-stack hardware and software for safe and secure AV development, from the car to the data center.
More on the CVPR Challenge
The 3D Occupancy Prediction Challenge at CVPR required participants to develop algorithms that solely used camera input during inference. Participants could use open-source datasets and models, facilitating the exploration of data-driven algorithms and large-scale models. The organizers provided a baseline sandbox for the latest state-of-the-art 3D occupancy prediction algorithms in real-world scenarios.
NVIDIA at CVPR NVIDIA is presenting nearly 30 papers and presentations at CVPR. Experts who'll discuss autonomous driving include:
Jose Alvarez on emerging challenges for 3D perception in AVs during the End-to-End Autonomous Driving Workshop: Emerging Tasks and Challenges Workshop; and on optimizing large deep models for real-time inference at the Embedded Vision Workshop.
Nikolai Smolyanskiy, director of deep learning at NVIDIA, on real-time traffic prediction for AVs during the End-to-End Autonomous Driving Workshop: Perception, Prediction, Planning and Simulation.
Robin Jenkin, distinguished engineer at NVIDIA, on image quality in fisheye cameras at the OmniCV Workshop, held in conjunction with CVPR.
Xinshuo Weng, research scientist for AV research at NVIDIA, on vision solutions for autonomous driving during the Vision-Centric Autonomous Driving Workshop.
View other talks on the agenda and learn more about NVIDIA at CVPR, which runs June 18-22.
Featured image courtesy of OccNet and Occ3D.
LINK: | https://blogs.nvidia.com/blog/2023/06/15/autonomous-driving-challenge-... |
See more stories from nvidia |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
19/05/2024
TV Techs Weekly Product Wrap-Up
Missed any of our product coverage during your busy week? The TV Tech weekly product and services news wrap-up provides links to all of our coverage from May 13...
19/05/2024
The CW Shares Its 2024-2025 Lineup
LeVar Burton will host the new game show Trivial Pursuit on The CW, while Raven-Symon will host Scrabble....
19/05/2024
Biden, Trump Agree to Debates on CNN, ABC
President Joe Biden and former President Donald Trump have agreed to debates, set for June 27 on CNN and September 10 on ABC....
19/05/2024
End of the Line for Young Sheldon' on May 16
Young Sheldon signs off after seven seasons on CBS, when the series finale airs Thursday, May 18. Jim Parsons and Mayim Bialik reprise their roles as Sheldon Co...
18/05/2024
If Bundling Is Back, What's the Ideal Bundle?
PORTSMOUTH, N.H. Bundling is back in a big way, with all the major streaming companies and many pay TV operators exploring ways to simplify the consumer experie...
18/05/2024
FCC to Vote on LPTV Rules during June Open Meeting
WASHINGTON, D.C. Federal Communications Commission Chairwoman Jessica Rosenworcel has announced a tentative agenda for the June Open Commission Meeting schedule...
18/05/2024
Matthews Launches New Multipurpose Grip Rail Telescopic Grid Pipe Solution
Matthews Studio Equipment has introduced Grip Rail, which the company said offers a better way to mount equipment on location, in the studio, or on the fly....
18/05/2024
IAB Tech Labs, Google Partner on New First Party Data Solution
In a notable development in the industry-wide effort to address privacy concerns while improving efficacy of marketing efforts in a cookieless ad landscape, IAB...
18/05/2024
TV Tech Weekly Product Wrap-Up
Missed any of our product coverage during your busy week? The TV Tech weekly product and services news wrap-up provides links to all of our coverage from May 13...
18/05/2024
DHD Elevates the Art of Podcast Production
DHD Elevates the Art of Podcast Production Brie Clayton May 17, 2024 0 Comments Hero image: the DHD DX2 base and expansion modules Latest-generation ...
17/05/2024
Aerojet Rocketdyne's Camden Site Leverages Modernization Investments to Accelerate Solid Rocket Motor Production
Aerojet Rocketdyne has worked to modernize facilities at its Camden, Arkansas, l...
17/05/2024
FCC Plans to Revise LPTV Rules
The FCC has issued a Notice of Proposed Rulemaking (NPRM) that would revise rules governing low power TV stations (LPTV) in a number of areas, including online ...
17/05/2024
Demystifying Post-Production: Introducing Cinema 4D Particles Week 4
Demystifying Post-Production: Introducing Cinema 4D Particles Week 4 Brie Clayton May 17, 2024 0 Comments With the spring release of Maxon One, we...
17/05/2024
Takashi Yamazaki Film Godzilla Minus One Graded with DaVinci Resolve Studio
Takashi Yamazaki Film Godzilla Minus One Graded with DaVinci Resolve Studio Brie Clayton May 17, 2024 0 Comments Hero image credit: 2023 TOHO CO., LT...
17/05/2024
Sterling Event Group Streamlines Live Event Productions with AJA
Sterling Event Group Streamlines Live Event Productions with AJA Brie Clayton May 17, 2024 0 Comments Live event productions only happen once, which ...
17/05/2024
Meet the product manager
Muster Ngobi, product manager at LYNX Technik tells TVBEurope how the ever-evolving media industry provides a truly dynamic working environment By Matthew Corr...
17/05/2024
TV, Streaming Schedule for 2024 NFL Regular Season Is Released
NEW YORK As declines in linear TV viewing make the ongoing popularity of live sports, particularly football, central to financial success of the TV industry, th...
17/05/2024
Netflix Ad Tier Hits 40M Monthly Active Users
During Netflixs second Upfront presentation to advertisers, Amy Reinhard, Netflix's president of advertising, walked advertisers through the continued growt...
17/05/2024
Scripps Promotes Jeff Kiernan to VP, Local News
CINCINNATI The E.W. Scripps Company has added to its leadership team for news by promoting Jeff Kiernan a veteran journalist and general manager of Scripps'...
17/05/2024
Survey: New Disney-Fox-WBD Sports Streamer May Hurt Pay TV Sub Counts
Top executives from Disney, Fox and Warner Bros. Discovery have consistently insisted that their joint venture to launch the Venu Sports streaming bundle in the...
17/05/2024
Caitlin Clark's WNBA Debut Set Viewing Records
ESPN has announced that its coverage of Caitlin Clark's WNBA debut in the Indiana Fever versus the Connecticut Sun season opener was the most-watched WNBA g...
17/05/2024
ATEM Mini Extreme ISO switcher and Blackmagic Pocket Cinema Camera 4K
ATEM Mini Extreme ISO switcher and Blackmagic Pocket Cinema Camera 4K Brie Clayton May 16, 2024 0 Comments Blackmagic Design announced today that Yoic...
17/05/2024
Pixomondo's Virtual Production Academy Expands with Programs at Sony PCL, Vook, and Vancouver Film School
Pixomondo's Virtual Production Academy Expands with Programs at Sony PCL, Vo...
17/05/2024
WBD Upfront Show Offers Peeks at House of the Dragon,' White Lotus,' Biden-Trump Debate
The Warner Bros. Discovery upfront presentation took place Wednesday, May 15 at ...
17/05/2024
The Black Keys, Jelly Roll, Kate Hudson Set To Perform on The Voice' Finale
Season 25 of The Voice wraps on NBC Tuesday, May 21, with performances from The Black Keys, Jelly Roll, Kate Hudson, Lainey Wilson, Muni Long, Thomas Rhett and ...
17/05/2024
CNN Boss Mark Thompson's Plan Includes More News in More Categories on More Devices (Upfronts)
New CNN CEO Mark Thompson spelled out his plan for the struggling news network d...
17/05/2024
Netflix To Launch In-House Advertising Tech Platform
Netflix, a newcomer to the advertising business, said it plans to launch an in-house advertising technology platform....
17/05/2024
Netflix Plots TV Takeover at Upfront Presentation
Netflix shared some programming projects at an upfront presentation in New York. Those include the basketball-themed comedy series Running Point, a Mindy Kaling...
17/05/2024
Plex Geek Week Sale Offers 20% Off Plex Lifetime Pass
Plex is offering movie and music collectors a 20% discount off its Lifetime Plex Pass as part of its Geek Week sale....
17/05/2024
GroupM Names Toby Jenner as President, GroupM Clients
Giant media buyer GroupM said it named Toby Jenner as global president, Group M Clients, a new position at the company....
17/05/2024
Clients of Independent Agencies Boost Programmatic Buying
Smaller advertisers are increasingly buying connected TV programmatically, according to a new report from FreeWheel, Comcast's ad-tech unit....
17/05/2024
TCLtvPlus Adds Streaming Music Channels From Vevo
TCLtvPlus, the streaming app on smart TVs made by TCL, has added live linear channel from music-video programmer Vevo....
17/05/2024
StackAdapt Adopts Data From Samba TV for Programmatic Campaigns
StackAdapt said it made a deal to integrate data from Samba TV into its programmatic advertising platform....
17/05/2024
Tonight on Skeem Saam: Lehasa gets a rude awakening when Kgosi blackmails him
Tonight on Skeem Saam: Lehasa gets a rude awakening when Kgosi blackmails himDon't miss Friday, 17 May's riveting episode of South African soapie Skeem ...
17/05/2024
Tonight on House of Zwide: Dorothy is blown away by Ona's sketches for her wedding dress
Tonight on House of Zwide: Dorothy is blown away by Ona's sketches for her w...
17/05/2024
Tonight on Scandal: Dintle has a visit from her past that leaves her very unsettled
Tonight on Scandal: Dintle has a visit from her past that leaves her very unsett...
17/05/2024
Save Time and Money with WO Traffic v24.0
WO Traffic provides a solid foundation from which stations can manage, execute, and scale end-to-end ad trafficking and sales, both today and into the future. W...
17/05/2024
Broadcast Innovation in India: How AI and Automated Production Helps Smaller Sports Grow
Broadcast Innovation in India: How AI and Automated Production Helps Smaller Spo...
17/05/2024
SVG Sports Cloud Production Forum Gives Refresher Course on Cloud-Based Tools, Ecosystem
SVG Sports Cloud Production Forum Gives Refresher Course on Cloud-Based Tools, E...
17/05/2024
WNBA Tip-Off 2024: Scripps Sports Constructs New Studio for Second Season of WNBA Friday Night Spotlight on ION
WNBA Tip-Off 2024: Scripps Sports Constructs New Studio for Second Season of WNB...
17/05/2024
SVG College Summit 2024: Auburn's War Eagle Productions Breaks Down How They Produce Live Gymnastics Broadcasts
SVG College Summit 2024: Auburn's War Eagle Productions Breaks Down How They...
17/05/2024
Netflix & Shondaland Announce the Song List and Soundtrack for 'Bridgerton' Season 3: Part 1
Back to All News Netflix & Shondaland Announce the Song List and Soundtrack for...
17/05/2024
Skeem Saam: Thursday's episode, 16 May 2024 [video]
Skeem Saam: Thursday's episode, 16 May 2024 [video]Missed an episode of Skeem Saam? No problem! Watch the latest episode of your favourite South African soa...
17/05/2024
Prison Journalism: Letter to my mothers
Prison Journalism: Letter to my mothersThabo Mthembu was incarcerated in Pollsmoor Prison from 2014 to 2019. Read Thabo's story by Thabo Mthembu 17-05-20...
17/05/2024
Paul McCartney becomes UK's first billionaire musician
Paul McCartney becomes UK's first billionaire musicianMusic icon Paul McCartney has become the UK's first billionaire musician, according to the Sunday ...
17/05/2024
Tonight on Smoke and Mirrors: Sakhile advises Tiny against sabotaging Petunia
Tonight on Smoke and Mirrors: Sakhile advises Tiny against sabotaging PetuniaDon't miss Friday, 17 May's riveting episode of South African soapie Smoke ...
17/05/2024
RT'S Operation Transformation comes to a close after 17 seasons
RT has today announced that Operation Transformation (OT) is to end after 17 seasons. As series come to an end each year, RT undertakes an editorial review to...
17/05/2024
Studio One: Your Binaural Beats Lab
By Craig Anderton When I heard about binaural beats, I was interested-I like beats, and I'm into binaural audio. But this has nothing to do with either o...