Making moves to accelerate self-driving car development, NVIDIA was today named an Autonomous Grand Challenge winner at the Computer Vision and Pattern Recognition (CVPR) conference, running this week in Seattle.
Building on last year's win in 3D Occupancy Prediction, NVIDIA Research topped the leaderboard this year in the End-to-End Driving at Scale category with its Hydra-MDP model, outperforming more than 400 entries worldwide.
This milestone shows the importance of generative AI in building applications for physical AI deployments in autonomous vehicle (AV) development. The technology can also be applied to industrial environments, healthcare, robotics and other areas.
The winning submission received CVPR's Innovation Award as well, recognizing NVIDIA's approach to improving any end-to-end driving model using learned open-loop proxy metrics.
In addition, NVIDIA announced NVIDIA Omniverse Cloud Sensor RTX, a set of microservices that enable physically accurate sensor simulation to accelerate the development of fully autonomous machines of every kind.
How End-to-End Driving Works The race to develop self-driving cars isn't a sprint but more a never-ending triathlon, with three distinct yet crucial parts operating simultaneously: AI training, simulation and autonomous driving. Each requires its own accelerated computing platform, and together, the full-stack systems purpose-built for these steps form a powerful triad that enables continuous development cycles, always improving in performance and safety.
To accomplish this, a model is first trained on an AI supercomputer such as NVIDIA DGX. It's then tested and validated in simulation - using the NVIDIA Omniverse platform and running on an NVIDIA OVX system - before entering the vehicle, where, lastly, the NVIDIA DRIVE AGX platform processes sensor data through the model in real time.
Building an autonomous system to navigate safely in the complex physical world is extremely challenging. The system needs to perceive and understand its surrounding environment holistically, then make correct, safe decisions in a fraction of a second. This requires human-like situational awareness to handle potentially dangerous or rare scenarios.
AV software development has traditionally been based on a modular approach, with separate components for object detection and tracking, trajectory prediction, and path planning and control.
End-to-end autonomous driving systems streamline this process using a unified model to take in sensor input and produce vehicle trajectories, helping avoid overcomplicated pipelines and providing a more holistic, data-driven approach to handle real-world scenarios.
Watch a video about the Hydra-MDP model, winner of the CVPR Autonomous Grand Challenge for End-to-End Driving:
Navigating the Grand Challenge This year's CVPR challenge asked participants to develop an end-to-end AV model, trained using the nuPlan dataset, to generate driving trajectory based on sensor data.
The models were submitted for testing inside the open-source NAVSIM simulator and were tasked with navigating thousands of scenarios they hadn't experienced yet. Model performance was scored based on metrics for safety, passenger comfort and deviation from the original recorded trajectory.
NVIDIA Research's winning end-to-end model ingests camera and lidar data, as well as the vehicle's trajectory history, to generate a safe, optimal vehicle path for five seconds post-sensor input.
The workflow NVIDIA researchers used to win the competition can be replicated in high-fidelity simulated environments with NVIDIA Omniverse. This means AV simulation developers can recreate the workflow in a physically accurate environment before testing their AVs in the real world. NVIDIA Omniverse Cloud Sensor RTX microservices will be available later this year. Sign up for early access.
In addition, NVIDIA ranked second for its submission to the CVPR Autonomous Grand Challenge for Driving with Language. NVIDIA's approach connects vision language models and autonomous driving systems, integrating the power of large language models to help make decisions and achieve generalizable, explainable driving behavior.
Learn More at CVPR More than 50 NVIDIA papers were accepted to this year's CVPR, on topics spanning automotive, healthcare, robotics and more. Over a dozen papers will cover NVIDIA automotive-related research, including:
Hydra-MDP: End-to-End Multimodal Planning With Multi-Target Hydra-Distillation
Winner of CVPR's End-to-End Driving at Scale challenge
Read the NVIDIA technical blog
Producing and Leveraging Online Map Uncertainty in Trajectory Prediction
CVPR best paper award finalist
Driving Everywhere With Large Language Model Policy Adaptation
See DRIVE Labs: LLM-Based Road Rules Guide Simplifies Driving
Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?
Improving Distant 3D Object Detection Using 2D Box Supervision
Dynamic LiDAR Resimulation Using Compositional Neural Fields
BEVNeXt: Reviving Dense BEV Frameworks for 3D Object Detection
PARA-Drive: Parallelized Architecture for Real-Time Autonomous Driving
Sanja Fidler, vice president of AI research at NVIDIA, will speak on vision language models at the CVPR Workshop on Autonomous Driving.
Learn more about NVIDIA Research, a global team of hundreds of scientists and engineers focused on topics including AI, computer graphics, computer vision, self-driving cars and robotics.
See notice regarding software product information.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
09/06/2026
Media buyers and sellers can now compare YouTube reach from computer, mobile, an...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
A project aimed at modernizing scheduling operations across Mediaset's channel portfolio
Mediagenix, a global leader in smart content solutions to profitab...
09/06/2026
tvONE, an ACT Entertainment brand, debuts its most powerful video processor ever built: the 4RU CALICO PRO (C7-PRO-4200), at InfoComm 2026 (Booth N6813). Engine...
09/06/2026
Composer and Conductor Eric Whitacre to Receive Honorary Doctorate at Berklee Va...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Technology collaboration to validate AMPP and Lawo HOME orchestration integration, showcasing Dynamic Media Facility principles in practice.
Grass Valley and ...
09/06/2026
Bitmovin, a leading provider of video streaming solutions, today announced that Axel Springer SE, international media and technology company, has deployed Playe...
09/06/2026
LiveU, the global leader in live IP-video solutions, today announced a landmark deployment with the Oceania Football Confederation (OFC) that has brought Video ...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/06/2026
Two Alumni Win Tony Awards Mike Morris and Cedric Leiba Jr. won awards for Best Orchestrations and Best Play, respectively.
June 8, 2026
By
Tori Donahue
...
09/06/2026
Enni Continues to Rely on Arvato Systems - And Will Be Using AEP.EnerS4 Billing Solution
Arvato Systems to implement transformation project for SAP S/4HANA Ut...
09/06/2026
These special programmes will highlight RT 's connection with the Irish diaspora
This year, RT is marking 100 years of public broadcasting in Ireland with...
08/06/2026
The two execs discuss the goals and the challenges of building a huge multi-cult...
08/06/2026
This industry legend has been a road warrior since the early '90s and is, today, a lynchpin on College GameDay
The sports-production industry continues to ...
08/06/2026
DAZN has agreed a multi-year rights partnership with Extreme Fighting Championship (EFC), expanding its global combat sports portfolio.
DAZN will broadcast EFC...
08/06/2026
As fans move across broadcast, streaming, social, mobile and creator-led platforms, and they expect every angle, in real time, TVU Networks has released a new e...
08/06/2026
Infront has further strengthened the 2026 Diamond League's international bro...
08/06/2026
Grass Valley has announced the appointment of Sam Craig as Vice President, Global Pre-Sales. Based in the United States, Craig will lead Grass Valley's glob...
08/06/2026
SMPTE has announced its summer 2026 education lineup covering IP networking and SMPTE ST 2110, including two standalone courses, a 13-week boot camp, and a hand...
08/06/2026
Sportradar Group AG has announced a multi-year global agreement with Kalshi, a p...
08/06/2026
FIFA and Gamefam have announced the launch of a FIFA World Cup 2026 event on Roblox, running June 5 through July 31, 2026. The event centers on FIFA Super Socce...
08/06/2026
A collaboration of NHL Productions, Monumental Sports, and Michael Levitt Produc...
08/06/2026
CBS Sports production staffer Bryce Adair has died at the age of 31 after sustaining injuries during a car accident on Wednesday while in Ohio working the the P...
08/06/2026
Behind The Mic provides a roundup of recent news regarding on-air talent, including new deals, departures, and assignments compiled from press releases and repo...
08/06/2026
WMT Digital today announced the launch of WMT Fan Intelligence, designed to unif...
08/06/2026
The Heat are the seventh NBA team to air their games over-the-air next season...
08/06/2026
Paramount and UFC have announced an expansion of their media rights partnership making Paramount the exclusive home of UFC Numbered Event main cards in Canada ...
08/06/2026
The Qatar Football Association (QFA), in cooperation with Sponix and broadcaster...
08/06/2026
Project B has announced the appointment of Host Broadcast Services (HBS) as Offi...
08/06/2026
The Buckeyes now produce and stream upwards of 200 sports events annually with a...
08/06/2026
At Spotify, our commitment to the LGBTQIA community is year-round. Through GLOW, our global music program, we celebrate and amplify the contributions of queer ...
08/06/2026
Get Hands-on With Keyboard & Synth Brands
GearExpo UK wouldn't be complete without some synth action, and we've got some of the industry's most ...
08/06/2026
50 popular in-ear monitoring system profiles added
The latest update for IK Multimedia's headphone-correction system has just arrived, and introduces ca...
08/06/2026
Manny Marroquin signature cans upgraded with SLAM Technology
The flagship model in Audeze's Manny Marroquin Signature Series has just been treated to an...
08/06/2026
Air domain supremacy redefined - New counter UAS, space solutions and directiona...
08/06/2026
he BBC and BritBox have announced that Edward Bluemel (We Might Regret This, My ...
08/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
08/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
Making moves to accelerate self-driving car development, NVIDIA was today named an Autonomous Grand Challenge winner at the Computer Vision and Pattern Recognition (CVPR) conference, running this week in Seattle.
