
Making moves to accelerate self-driving car development, NVIDIA was today named an Autonomous Grand Challenge winner at the Computer Vision and Pattern Recognition (CVPR) conference, running this week in Seattle.
Building on last year's win in 3D Occupancy Prediction, NVIDIA Research topped the leaderboard this year in the End-to-End Driving at Scale category with its Hydra-MDP model, outperforming more than 400 entries worldwide.
This milestone shows the importance of generative AI in building applications for physical AI deployments in autonomous vehicle (AV) development. The technology can also be applied to industrial environments, healthcare, robotics and other areas.
The winning submission received CVPR's Innovation Award as well, recognizing NVIDIA's approach to improving any end-to-end driving model using learned open-loop proxy metrics.
In addition, NVIDIA announced NVIDIA Omniverse Cloud Sensor RTX, a set of microservices that enable physically accurate sensor simulation to accelerate the development of fully autonomous machines of every kind.
How End-to-End Driving Works The race to develop self-driving cars isn't a sprint but more a never-ending triathlon, with three distinct yet crucial parts operating simultaneously: AI training, simulation and autonomous driving. Each requires its own accelerated computing platform, and together, the full-stack systems purpose-built for these steps form a powerful triad that enables continuous development cycles, always improving in performance and safety.
To accomplish this, a model is first trained on an AI supercomputer such as NVIDIA DGX. It's then tested and validated in simulation - using the NVIDIA Omniverse platform and running on an NVIDIA OVX system - before entering the vehicle, where, lastly, the NVIDIA DRIVE AGX platform processes sensor data through the model in real time.
Building an autonomous system to navigate safely in the complex physical world is extremely challenging. The system needs to perceive and understand its surrounding environment holistically, then make correct, safe decisions in a fraction of a second. This requires human-like situational awareness to handle potentially dangerous or rare scenarios.
AV software development has traditionally been based on a modular approach, with separate components for object detection and tracking, trajectory prediction, and path planning and control.
End-to-end autonomous driving systems streamline this process using a unified model to take in sensor input and produce vehicle trajectories, helping avoid overcomplicated pipelines and providing a more holistic, data-driven approach to handle real-world scenarios.
Watch a video about the Hydra-MDP model, winner of the CVPR Autonomous Grand Challenge for End-to-End Driving:
Navigating the Grand Challenge This year's CVPR challenge asked participants to develop an end-to-end AV model, trained using the nuPlan dataset, to generate driving trajectory based on sensor data.
The models were submitted for testing inside the open-source NAVSIM simulator and were tasked with navigating thousands of scenarios they hadn't experienced yet. Model performance was scored based on metrics for safety, passenger comfort and deviation from the original recorded trajectory.
NVIDIA Research's winning end-to-end model ingests camera and lidar data, as well as the vehicle's trajectory history, to generate a safe, optimal vehicle path for five seconds post-sensor input.
The workflow NVIDIA researchers used to win the competition can be replicated in high-fidelity simulated environments with NVIDIA Omniverse. This means AV simulation developers can recreate the workflow in a physically accurate environment before testing their AVs in the real world. NVIDIA Omniverse Cloud Sensor RTX microservices will be available later this year. Sign up for early access.
In addition, NVIDIA ranked second for its submission to the CVPR Autonomous Grand Challenge for Driving with Language. NVIDIA's approach connects vision language models and autonomous driving systems, integrating the power of large language models to help make decisions and achieve generalizable, explainable driving behavior.
Learn More at CVPR More than 50 NVIDIA papers were accepted to this year's CVPR, on topics spanning automotive, healthcare, robotics and more. Over a dozen papers will cover NVIDIA automotive-related research, including:
Hydra-MDP: End-to-End Multimodal Planning With Multi-Target Hydra-Distillation
Winner of CVPR's End-to-End Driving at Scale challenge
Read the NVIDIA technical blog
Producing and Leveraging Online Map Uncertainty in Trajectory Prediction
CVPR best paper award finalist
Driving Everywhere With Large Language Model Policy Adaptation
See DRIVE Labs: LLM-Based Road Rules Guide Simplifies Driving
Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?
Improving Distant 3D Object Detection Using 2D Box Supervision
Dynamic LiDAR Resimulation Using Compositional Neural Fields
BEVNeXt: Reviving Dense BEV Frameworks for 3D Object Detection
PARA-Drive: Parallelized Architecture for Real-Time Autonomous Driving
Sanja Fidler, vice president of AI research at NVIDIA, will speak on vision language models at the CVPR Workshop on Autonomous Driving.
Learn more about NVIDIA Research, a global team of hundreds of scientists and engineers focused on topics including AI, computer graphics, computer vision, self-driving cars and robotics.
See notice regarding software product information.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
02/05/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
01/05/2026
January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...
09/04/2026
Staines-upon-Thames, UK, 09, April, 2026 - Yospace, the trusted leader in Dynam...
09/04/2026
just:play pro 2026 and just:live pro 2026 Sneak Preview News for NAB 2026
More Details:At NAB 2026, ToolsOnAir will showcase just:play pro 2026 and just:live p...
09/04/2026
just:in mac pro 2026 - The Next Level of Professional Recording on macOS at NAB ...
09/04/2026
Zixi will demonstrate IP-based live video workflow solutions at NAB Show 2026 (Booth W2057).
The industry is moving quickly toward IP-based distribution as br...
09/04/2026
Global women's elite sports revenues are expected to reach at least $3 billi...
09/04/2026
Monitor engineer Gavin Tempany mixed Kylie Minogue s Tension Tour on a Solid Sta...
09/04/2026
KOKUSAI DENKI Electric America will exhibit at NAB Show 2026 (Booth C5507), debu...
09/04/2026
With the 2025-26 NBA regular season concluded and the playoffs beginning next we...
09/04/2026
Telestream and Mimir have announced an integration connecting Telestream's V...
09/04/2026
Bitmovin has expanded its Live Encoding and Observability solutions to provide r...
09/04/2026
The Nashville Predators and Scripps Sports have announced a multi-year media rights agreement covering local preseason, regular season, and first-round playoff ...
09/04/2026
Advanced Systems Group, LLC has announced a partnership with Beam Dynamics to offer the Beam Asset and License Intelligence Platform to its clients. The platfor...
09/04/2026
Lawo has unveiled Edge One, a combined video and audio stagebox for broadcast and Pro AV workflows. The device will be on display at NAB Show (Booth C2108, Apri...
09/04/2026
The Society of Motion Picture and Television Engineers (SMPTE) will host the SMPTE ST 2110 IP Media Roadshow on Tuesday, April 21, 2026, at the Las Vegas Conven...
09/04/2026
The Atlanta Braves have completed upgrades to video displays in and around Truist Park ahead of the 2026 MLB season. The upgrades include the Delta Out-of-Town ...
09/04/2026
The University of Southern California has contracted Daktronics (NASDAQ: DAKT) of Brookings, South Dakota, to manufacture and install 22 LED displays across fou...
09/04/2026
Backlight, the media technology company behind Iconik and Wildmoka, will showcase its Creative Operations Platform at NAB Show 2026 (Booth N2829, April 19-22). ...
09/04/2026
MotoAmerica and V10 Entertainment have announced a partnership to broadcast MotoAmerica Superbike racing on VICE TV for the 2026 season. Coverage begins live on...
09/04/2026
Proton Camera Innovations has announced the appointment of Tod Musgrave as US Sa...
09/04/2026
Designed specifically for live sports broadcasting, new platform features IP-nat...
09/04/2026
Blending 1990s DNA, modern motion theory, and a distinctly colorful brand identi...
09/04/2026
Technical capability is essential, but long-term success often depends on how we...
09/04/2026
15 feature films, including fiction and documentaries, along with six short film...
09/04/2026
Spotify has always been about putting listeners in the driver's seat. Today, people don't just want more ways to spend their time; they want that time t...
09/04/2026
Our Chief Public Affairs Officer Dustee Jenkins shares how we're building a more positive experience for families on Spotify.
As Spotify's Chief Public...
09/04/2026
Festival season is upon us. From sun-soaked weekends out west to iconic stages in Chicago and New York, fans are getting ready to see their favorite artists liv...
09/04/2026
O Spotify sempre teve como foco colocar os ouvintes no controle. Hoje, as pessoas n o querem apenas mais formas de passar o tempo - elas querem que esse tempo s...
09/04/2026
Read the original note in English here.
Nossa Chief Public Affairs Officer, Dustee Jenkins, compartilha como estamos construindo uma experi ncia mais positiva ...
09/04/2026
New synth focuses on sci-fi scoring
Following their formation and debut releases in December 2025, Smokestack Sounds - the brainchild of composer and produc...
09/04/2026
Latest version set for May 2026 launch
Reason Studios have revealed that the latest version of their DAW software will be launching in May 2026. Currently a...
09/04/2026
New EQ aimed at mix-bus & mastering duties
Shy Audio's first two releases focused on the past, delivering recreations of the budget mixers that were com...
09/04/2026
Based on John Galsworthy's novels known collectively as The Forsyte Saga a...
09/04/2026
The Forsytes has been renewed for a third season before the period drama has even premiered on PBS Masterpiece.
The adaptation of John Galsworthy's novel, ...
09/04/2026
IThe BBC has commissioned new drama The Witch Farm, starring Gabrielle Creevy (T...
09/04/2026
The next big thing To help broadcasters fully embrace dynamic hybrid workflows, Calrec will make a major announcement that unlocks even more freedom for broadca...
09/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
09/04/2026
Purpose Built Monitoring From Live Production to Master Control to OTT, Across On Prem and Cloud Environments
At the 2026 NAB Show (April 19-22, Las Vegas Con...
09/04/2026
Purpose Built Monitoring From Live Production to Master Control to OTT, Across On Prem and Cloud Environments
At the 2026 NAB Show (April 19-22, Las Vegas Con...
09/04/2026
New advances meet surge in demand for broadcast-grade IP migration as C-band spectrum auctions approach
LTN announces major enhancements to its purpose-built g...
09/04/2026
Hitomi Broadcast has expanded its sales team with the addition of Nicola Milburn as Technical Sales Manager. In this role, Nicola will work with customers and p...
09/04/2026
Revolutionary combined solution brings sub-second latency, resilient delivery, and workflow orchestration to global broadcasters and digital platforms
Layercak...
09/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...