
Making moves to accelerate self-driving car development, NVIDIA was today named an Autonomous Grand Challenge winner at the Computer Vision and Pattern Recognition (CVPR) conference, running this week in Seattle.
Building on last year's win in 3D Occupancy Prediction, NVIDIA Research topped the leaderboard this year in the End-to-End Driving at Scale category with its Hydra-MDP model, outperforming more than 400 entries worldwide.
This milestone shows the importance of generative AI in building applications for physical AI deployments in autonomous vehicle (AV) development. The technology can also be applied to industrial environments, healthcare, robotics and other areas.
The winning submission received CVPR's Innovation Award as well, recognizing NVIDIA's approach to improving any end-to-end driving model using learned open-loop proxy metrics.
In addition, NVIDIA announced NVIDIA Omniverse Cloud Sensor RTX, a set of microservices that enable physically accurate sensor simulation to accelerate the development of fully autonomous machines of every kind.
How End-to-End Driving Works The race to develop self-driving cars isn't a sprint but more a never-ending triathlon, with three distinct yet crucial parts operating simultaneously: AI training, simulation and autonomous driving. Each requires its own accelerated computing platform, and together, the full-stack systems purpose-built for these steps form a powerful triad that enables continuous development cycles, always improving in performance and safety.
To accomplish this, a model is first trained on an AI supercomputer such as NVIDIA DGX. It's then tested and validated in simulation - using the NVIDIA Omniverse platform and running on an NVIDIA OVX system - before entering the vehicle, where, lastly, the NVIDIA DRIVE AGX platform processes sensor data through the model in real time.
Building an autonomous system to navigate safely in the complex physical world is extremely challenging. The system needs to perceive and understand its surrounding environment holistically, then make correct, safe decisions in a fraction of a second. This requires human-like situational awareness to handle potentially dangerous or rare scenarios.
AV software development has traditionally been based on a modular approach, with separate components for object detection and tracking, trajectory prediction, and path planning and control.
End-to-end autonomous driving systems streamline this process using a unified model to take in sensor input and produce vehicle trajectories, helping avoid overcomplicated pipelines and providing a more holistic, data-driven approach to handle real-world scenarios.
Watch a video about the Hydra-MDP model, winner of the CVPR Autonomous Grand Challenge for End-to-End Driving:
Navigating the Grand Challenge This year's CVPR challenge asked participants to develop an end-to-end AV model, trained using the nuPlan dataset, to generate driving trajectory based on sensor data.
The models were submitted for testing inside the open-source NAVSIM simulator and were tasked with navigating thousands of scenarios they hadn't experienced yet. Model performance was scored based on metrics for safety, passenger comfort and deviation from the original recorded trajectory.
NVIDIA Research's winning end-to-end model ingests camera and lidar data, as well as the vehicle's trajectory history, to generate a safe, optimal vehicle path for five seconds post-sensor input.
The workflow NVIDIA researchers used to win the competition can be replicated in high-fidelity simulated environments with NVIDIA Omniverse. This means AV simulation developers can recreate the workflow in a physically accurate environment before testing their AVs in the real world. NVIDIA Omniverse Cloud Sensor RTX microservices will be available later this year. Sign up for early access.
In addition, NVIDIA ranked second for its submission to the CVPR Autonomous Grand Challenge for Driving with Language. NVIDIA's approach connects vision language models and autonomous driving systems, integrating the power of large language models to help make decisions and achieve generalizable, explainable driving behavior.
Learn More at CVPR More than 50 NVIDIA papers were accepted to this year's CVPR, on topics spanning automotive, healthcare, robotics and more. Over a dozen papers will cover NVIDIA automotive-related research, including:
Hydra-MDP: End-to-End Multimodal Planning With Multi-Target Hydra-Distillation
Winner of CVPR's End-to-End Driving at Scale challenge
Read the NVIDIA technical blog
Producing and Leveraging Online Map Uncertainty in Trajectory Prediction
CVPR best paper award finalist
Driving Everywhere With Large Language Model Policy Adaptation
See DRIVE Labs: LLM-Based Road Rules Guide Simplifies Driving
Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?
Improving Distant 3D Object Detection Using 2D Box Supervision
Dynamic LiDAR Resimulation Using Compositional Neural Fields
BEVNeXt: Reviving Dense BEV Frameworks for 3D Object Detection
PARA-Drive: Parallelized Architecture for Real-Time Autonomous Driving
Sanja Fidler, vice president of AI research at NVIDIA, will speak on vision language models at the CVPR Workshop on Autonomous Driving.
Learn more about NVIDIA Research, a global team of hundreds of scientists and engineers focused on topics including AI, computer graphics, computer vision, self-driving cars and robotics.
See notice regarding software product information.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
06/09/2026
June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...
06/08/2026
The broadcaster's 14-race schedule begins in Iowa and ends in November with ...
06/08/2026
In-venue and creative video staffers at the professional and collegiate level ha...
06/08/2026
As media organizations consolidate teams, technology platforms, and content libr...
06/08/2026
Firmware updates introduce Dolby's next-generation picture engine, content-aware optimization, and new motion and ambient-light tools...
06/08/2026
TNT Sports will have wall-to-wall coverage of the upcoming FIBA Women's Bask...
06/08/2026
swXtch.io (Stand 5.MR13) has unveiled groundSwXtch for Audio over IP (AoIP), a software application that lets broadcasters and media organizations move audio in...
06/08/2026
At IBC2026, Riedel Communications (Stands: 10.A24, 10.A31, 10.A38) will bring modern media production to life with the Live Production Experience - a connected ...
06/08/2026
The first live-sports director to receive the prestigious honor, eight-time Emmy...
06/08/2026
NBC Sports will continue to present the Preakness Stakes on NBC and Peacock thro...
06/08/2026
Cobalt Digital (Stand 8.F90) continues to reinforce its commitment to delivering...
06/08/2026
Wave Central has promoted promotion Jeff Daubert to Director of Sales, Americas.
In his expanded role, Daubert will lead Wave Central's sales strategy and ...
06/08/2026
KMH Integration is expanding its ability to serve media, broadcast, and IT organizations by adding Keith Hanadel, an accomplished architect with decades of indu...
06/08/2026
Advanced Systems Group (ASG) has promoted Michele Ferreira from Vice President of its Systems Integration team to the newly created position of Chief Business O...
06/08/2026
Demonstrations will include new JPEG XS, Dolby audio, cloud-gateway, stream-processing, and distribution capabilities...
06/08/2026
The deal includes three premium mobile units, engineering personnel, existing br...
06/08/2026
Broadcast Management Group produced Amazon Prime's inaugural Obsessed Fest a...
06/08/2026
Exhibit will feature new variable-ND functionality, OLED viewfinders, remote-camera tools, and UHD production monitors...
06/08/2026
Compact full-frame E-mount lens targets sports, wildlife, and other long-range shooting applications...
06/08/2026
Live broadcast will honor Roger Federer and Mary Carillo on Aug. 29, with onsite...
06/08/2026
End-zone board receives higher-resolution LED technology and an updated Show Control system ahead of the 2026 football season...
06/08/2026
New 16- and 32-pad MIDI controllers now available
Fender have just announced that the two new performance-focused controllers that were unveiled at NAMM 202...
06/08/2026
Standalone version, performance improvements & more
Lewitt have just released a significant update for their speaker and room virtualisation software, intro...
06/08/2026
Combines celeste samples with synth engine
After launching earlier in 2026 with deFORM, ebbandflow have returned with their first sampled acoustic instrumen...
06/08/2026
SGL Carbon's consolidated sales in the first half of 2026 totaled 394.2 million, down 13.0% from the prior year (H1 2025: 453.2 million). On the one hand,...
06/08/2026
The BBC has announced casting for the forthcoming six-part series Hercule from Mammoth Screen and Agatha Christie Limited.
Joining Bluemel are Henry Ashton (A ...
06/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/08/2026
Proven offering builds on more than 20,000 live sporting events with greater automation, flexibility, and operational control
LTN , the industry leader in tran...
06/08/2026
Hornets Tech, a specialist in broadcast connectivity and IP video, is bringing a new range of encoders, decoders and an IPTV platform to IBC2026.
Broadcast in...
06/08/2026
Introducing Adobe for ChatGPT: Create, edit and get work done - all in ChatGPT
Deepti Pradeep August 6, 2026
0 Comments
The Adobe plugin in ChatGPT br...
06/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/08/2026
At IBC2026, MediaKind will make its first major appearance as a unified global powerhouse in video, showcasing one of the world's most comprehensive video i...
06/08/2026
Big Blue Marble (#5.A63) will demonstrate how its integrated technology and operational expertise help media companies scale premium services with less complexi...
06/08/2026
LA JOLLA, CA-Scripps Research has received more than $500,000 in first-year fund...
06/08/2026
LA JOLLA, CA-Viruses are masters at invading our cells thanks to specialized proteins that coat their surfaces. When scientists design vaccines, they often crea...
06/08/2026
LA JOLLA, CA-The brain has its own immune system, which detects threats and mounts a defense. A growing body of evidence has shown that in Alzheimer's disea...
06/08/2026
LA JOLLA, CA-Scripps Research chemist Jin-Quan Yu has been elected to the National Academy of Sciences (NAS), one of the highest honors a scientist can achieve....
06/08/2026
LA JOLLA, CA-Scripps Research ranked third in the inaugural 2026 Cure Innovation Index recognizing the top-performing institutes and centers across the United S...
06/08/2026
Benjamin Cravatt, the Gilula Chair of Chemical Biology and a professor of chemis...
06/08/2026
LA JOLLA, CA-Dennis Burton, professor and the James & Jessie Minor Chair in Immu...
06/08/2026
LA JOLLA, CA-Inside every human cell, proteins are constantly being tagged with small chemical modifications after they're produced. Known as post-translati...
06/08/2026
LA JOLLA-Scripps Research has established the Ian Wilson Endowed Chair, a new fa...
06/08/2026
Scripps Research's Skaggs Graduate School of Chemical and Biological Science...
06/08/2026
LA JOLLA, CA-Professor Jin-Quan Yu of Scripps Research has been elected to the Fellowship of the Royal Society, the U.K.'s national academy of sciences and ...
06/08/2026
LA JOLLA, CA-For years, researchers have been hoping for vaccines that protect people against not just one strain of HIV, but every strain of the quickly mutati...
06/08/2026
LA JOLLA, CA-The Calibr-Skaggs Institute for Innovative Medicines, the nonprofit...
06/08/2026
LA JOLLA, CA-Building the complex 3D molecules needed for new medicines has alwa...
06/08/2026
LA JOLLA, CA-Fentanyl and related variants of the synthetic opioid kill more Americans each year than car accidents and gun violence combined. In too-high doses...