
Making moves to accelerate self-driving car development, NVIDIA was today named an Autonomous Grand Challenge winner at the Computer Vision and Pattern Recognition (CVPR) conference, running this week in Seattle.
Building on last year's win in 3D Occupancy Prediction, NVIDIA Research topped the leaderboard this year in the End-to-End Driving at Scale category with its Hydra-MDP model, outperforming more than 400 entries worldwide.
This milestone shows the importance of generative AI in building applications for physical AI deployments in autonomous vehicle (AV) development. The technology can also be applied to industrial environments, healthcare, robotics and other areas.
The winning submission received CVPR's Innovation Award as well, recognizing NVIDIA's approach to improving any end-to-end driving model using learned open-loop proxy metrics.
In addition, NVIDIA announced NVIDIA Omniverse Cloud Sensor RTX, a set of microservices that enable physically accurate sensor simulation to accelerate the development of fully autonomous machines of every kind.
How End-to-End Driving Works The race to develop self-driving cars isn't a sprint but more a never-ending triathlon, with three distinct yet crucial parts operating simultaneously: AI training, simulation and autonomous driving. Each requires its own accelerated computing platform, and together, the full-stack systems purpose-built for these steps form a powerful triad that enables continuous development cycles, always improving in performance and safety.
To accomplish this, a model is first trained on an AI supercomputer such as NVIDIA DGX. It's then tested and validated in simulation - using the NVIDIA Omniverse platform and running on an NVIDIA OVX system - before entering the vehicle, where, lastly, the NVIDIA DRIVE AGX platform processes sensor data through the model in real time.
Building an autonomous system to navigate safely in the complex physical world is extremely challenging. The system needs to perceive and understand its surrounding environment holistically, then make correct, safe decisions in a fraction of a second. This requires human-like situational awareness to handle potentially dangerous or rare scenarios.
AV software development has traditionally been based on a modular approach, with separate components for object detection and tracking, trajectory prediction, and path planning and control.
End-to-end autonomous driving systems streamline this process using a unified model to take in sensor input and produce vehicle trajectories, helping avoid overcomplicated pipelines and providing a more holistic, data-driven approach to handle real-world scenarios.
Watch a video about the Hydra-MDP model, winner of the CVPR Autonomous Grand Challenge for End-to-End Driving:
Navigating the Grand Challenge This year's CVPR challenge asked participants to develop an end-to-end AV model, trained using the nuPlan dataset, to generate driving trajectory based on sensor data.
The models were submitted for testing inside the open-source NAVSIM simulator and were tasked with navigating thousands of scenarios they hadn't experienced yet. Model performance was scored based on metrics for safety, passenger comfort and deviation from the original recorded trajectory.
NVIDIA Research's winning end-to-end model ingests camera and lidar data, as well as the vehicle's trajectory history, to generate a safe, optimal vehicle path for five seconds post-sensor input.
The workflow NVIDIA researchers used to win the competition can be replicated in high-fidelity simulated environments with NVIDIA Omniverse. This means AV simulation developers can recreate the workflow in a physically accurate environment before testing their AVs in the real world. NVIDIA Omniverse Cloud Sensor RTX microservices will be available later this year. Sign up for early access.
In addition, NVIDIA ranked second for its submission to the CVPR Autonomous Grand Challenge for Driving with Language. NVIDIA's approach connects vision language models and autonomous driving systems, integrating the power of large language models to help make decisions and achieve generalizable, explainable driving behavior.
Learn More at CVPR More than 50 NVIDIA papers were accepted to this year's CVPR, on topics spanning automotive, healthcare, robotics and more. Over a dozen papers will cover NVIDIA automotive-related research, including:
Hydra-MDP: End-to-End Multimodal Planning With Multi-Target Hydra-Distillation
Winner of CVPR's End-to-End Driving at Scale challenge
Read the NVIDIA technical blog
Producing and Leveraging Online Map Uncertainty in Trajectory Prediction
CVPR best paper award finalist
Driving Everywhere With Large Language Model Policy Adaptation
See DRIVE Labs: LLM-Based Road Rules Guide Simplifies Driving
Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?
Improving Distant 3D Object Detection Using 2D Box Supervision
Dynamic LiDAR Resimulation Using Compositional Neural Fields
BEVNeXt: Reviving Dense BEV Frameworks for 3D Object Detection
PARA-Drive: Parallelized Architecture for Real-Time Autonomous Driving
Sanja Fidler, vice president of AI research at NVIDIA, will speak on vision language models at the CVPR Workshop on Autonomous Driving.
Learn more about NVIDIA Research, a global team of hundreds of scientists and engineers focused on topics including AI, computer graphics, computer vision, self-driving cars and robotics.
See notice regarding software product information.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
09/10/2026
September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026
New Sports Intelligence helps providers better unders...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
18/09/2026
IBC 2026 Tech Moves Beyond the Gloss and Into the Rack If you spent any time in the halls of the RAI this year, you noticed a clear shift in conversation. The c...
18/09/2026
In-venue and creative video staffers at the professional and collegiate level ha...
18/09/2026
Qvest has appointed Jens Miedek as Senior Vice President Sales, Media and Entertainment. Before joining Qvest, Miedek spent 16 years at Riedel Communications an...
18/09/2026
Fonn Group has acquired full ownership of everviz, a cloud-native platform for interactive charts, maps, and data-driven graphics, and will rebrand it as Teikna...
18/09/2026
Other World Computing (OWC) has announced the acquisition of OpenDrives, a provider of software-defined video and rich media storage management solutions. The a...
18/09/2026
Kaltura and Verimatrix have announced a partnership integrating Verimatrix's Digital Rights Management and security capabilities into Kaltura's Cloud TV...
18/09/2026
The sixth edition of the World Nomad Games combined traditional sports, large-scale cultural performances, and some decidedly modern broadcast technology. Held ...
18/09/2026
DAZN and Super League Basketball (SLB) have extended their partnership for the 2026-27 season. Every Championship, Cup, and Play-Off fixture will be available l...
18/09/2026
Nielsen has announced that its Streaming Content Ratings (SCR) product will move from weekly to daily data delivery, with clients now receiving viewership data ...
18/09/2026
ESPN will present LALIGA's ElCl sico on ABC for the first time, with FC Barcelona vs. Real Madrid airing Sunday, October 25 at 4 p.m. ET. A one-hour pre-mat...
18/09/2026
The University of Pennsylvania's Division of Recreation and Intercollegiate ...
18/09/2026
The Charlotte Hornets have announced DAZN as their exclusive direct-to-consumer streaming partner for the 2026-27 NBA season. The service launches immediately, ...
18/09/2026
Broadcast sports' original medium will let drivers keep on hearing the plays thanks to a new bill set to pass the Senate....
18/09/2026
Fourteen iPhone 18 Pro devices - eight connected over a T-Mobile Private 5G Netw...
18/09/2026
The Minnesota Lynx have announced that their final local broadcast of the 2026 regular season will air free on FOX 9 following the shutdown of Victory . The Ly...
18/09/2026
Monumental Sports Network (MNMT) has announced that its Monumental+ streaming service is now available as a subscription through Prime Video, giving Capitals an...
18/09/2026
WTGL, the women's team golf league created by TMRW Sports in partnership with the LPGA, has announced its inaugural season schedule. The season premieres Su...
18/09/2026
Ratings Roundup is a rundown of recent ratings news and is derived from press re...
18/09/2026
Studio Network Solutions (SNS) has won Best Journal Article at the 2026 IAMT Impact Awards for What Video Editors Need When Everything Is Changing Around Them, ...
18/09/2026
10 new voice models join line-up
The latest expansion for IK Multimedia's AI-powered vocal-modelling software has arrived, delivering a set of 10 new vo...
18/09/2026
A day of hands-on synthesis, sound design & performance
On Saturday 26 September 2026, The Museum of Synthesisers will be hosting a full day of hands-on syn...
18/09/2026
HPA is supporting Fix It or Risk It, a non-commercial, industry-wide public-service campaign helping organizations across the media and entertainment supply cha...
18/09/2026
AgileTV has successfully wrapped up its participation at IBC 2026 in Amsterdam, following four days of conversations with customers, partners and industry profe...
18/09/2026
aconnic AG (ISIN: DE000A0LBKW6), Munich, invites its shareholders and investors to a Virtual Investor Conference on Tuesday, September 29th, 2026, at 11.00 am.
...
18/09/2026
DHD reports a high level of interest in its range of audio production equipment on all four days of the September 11-14 International Broadcasting Convention in...
18/09/2026
Sonnet Announces Thunderbolt 5 eGPU With 850-Watt Power Supply and Integrated Do...
18/09/2026
DeckBridge adds live Resolve playback and Fairlight controls to Stream Deck
Brie Clayton September 17, 2026
0 Comments
DeckBridge starting profiles ac...
18/09/2026
Learn to arrange tracks using Color With Live's Free Stencil Pack
Brie Clayton September 17, 2026
0 Comments
Stencils are Color With Live's or...
18/09/2026
Berklee Establishes Susan Tedeschi Scholarship in Honor of Grammy-Winning Alumna The scholarship is announced as Tedeschi returns to headline the Berklee Bloc...
18/09/2026
The inside scoop on attention-grabbing market assets from those in the know 17 September 2026
(L-R): Sophie Green, Todd Brown and Edwina Waddy
Find this episo...
18/09/2026
Friday 18 September 2026
The new iPhone 18 Pro, iPhone 18 Pro Max, Apple Watch ...
18/09/2026
Senior Colorist Siggy Ferstl of Company 3 has been grading The Boys since the sh...
17/09/2026
Lions vs. Bills will also be the first regular-season game at new Highmark Stadi...
17/09/2026
Teradek has announced Bolt 7, a wireless video and data system that adds an integrated 900MHz radio to the Bolt's zero-delay video pipeline. The 900MHz chan...
17/09/2026
DAZN has announced three appointments to its executive leadership team, all reporting to CEO Shay Segev effective immediately.
Patrick Delany has been appointe...
17/09/2026
Monumental Sports and Entertainment (MSE) has announced a leadership restructuring. Zach Leonsis has been named President and Vice Chairman, a newly created pos...
17/09/2026
CP Communications has been named Best of Florida for Audio-Visual Services, and its subsidiary Red House Streaming has been named Best Movie and Recording Studi...
17/09/2026
Scripps Sports and ION have announced a broadcast partnership for the Shriners Children's East-West Bowl, the nation's oldest college all-star football ...
17/09/2026
The 17th annual espnW: Women + Sports Summit, presented by Toyota, will take place October 14-16 at the Ojai Valley Inn in Ojai, California, with virtual attend...
17/09/2026
The Professional Audio Manufacturers Alliance (PAMA) and Shure Incorporated have...
17/09/2026
Lithuanian broadcaster LNK Group has completed a migration of playout and media management for its five national television networks - LNK, BTV, TV1, InfoTV, an...
17/09/2026
Net Insight has announced a pan-Asian live media network created with its regional partners, giving broadcasters, production companies, and media service provid...
17/09/2026
After a high school football injury, the Orlando native found a new path in video production, gaining experience on ESPN college football broadcasts, Tampa Bay ...
17/09/2026
Popular DAW gains free pitch-correction tool
Image-Line have teamed up with Antares to kit their popular DAW software out with a built-in pitch-correction p...
17/09/2026
Promises unprecedented realism, dynamic nuance and clarity
Gibson have teamed up with acoustic pickup experts Baggs, creating a next-generation' pickup...
17/09/2026
Two new libraries join percussion line-up
VSL (Vienna Symphonic Library) have just launched two new libraries that bring some intriguing new instruments int...
17/09/2026
Hardware & plug-in versions gain new features
Arturia have just released a free update that brings some significant new features to their MiniFreak synthesi...