
Making moves to accelerate self-driving car development, NVIDIA was today named an Autonomous Grand Challenge winner at the Computer Vision and Pattern Recognition (CVPR) conference, running this week in Seattle.
Building on last year's win in 3D Occupancy Prediction, NVIDIA Research topped the leaderboard this year in the End-to-End Driving at Scale category with its Hydra-MDP model, outperforming more than 400 entries worldwide.
This milestone shows the importance of generative AI in building applications for physical AI deployments in autonomous vehicle (AV) development. The technology can also be applied to industrial environments, healthcare, robotics and other areas.
The winning submission received CVPR's Innovation Award as well, recognizing NVIDIA's approach to improving any end-to-end driving model using learned open-loop proxy metrics.
In addition, NVIDIA announced NVIDIA Omniverse Cloud Sensor RTX, a set of microservices that enable physically accurate sensor simulation to accelerate the development of fully autonomous machines of every kind.
How End-to-End Driving Works The race to develop self-driving cars isn't a sprint but more a never-ending triathlon, with three distinct yet crucial parts operating simultaneously: AI training, simulation and autonomous driving. Each requires its own accelerated computing platform, and together, the full-stack systems purpose-built for these steps form a powerful triad that enables continuous development cycles, always improving in performance and safety.
To accomplish this, a model is first trained on an AI supercomputer such as NVIDIA DGX. It's then tested and validated in simulation - using the NVIDIA Omniverse platform and running on an NVIDIA OVX system - before entering the vehicle, where, lastly, the NVIDIA DRIVE AGX platform processes sensor data through the model in real time.
Building an autonomous system to navigate safely in the complex physical world is extremely challenging. The system needs to perceive and understand its surrounding environment holistically, then make correct, safe decisions in a fraction of a second. This requires human-like situational awareness to handle potentially dangerous or rare scenarios.
AV software development has traditionally been based on a modular approach, with separate components for object detection and tracking, trajectory prediction, and path planning and control.
End-to-end autonomous driving systems streamline this process using a unified model to take in sensor input and produce vehicle trajectories, helping avoid overcomplicated pipelines and providing a more holistic, data-driven approach to handle real-world scenarios.
Watch a video about the Hydra-MDP model, winner of the CVPR Autonomous Grand Challenge for End-to-End Driving:
Navigating the Grand Challenge This year's CVPR challenge asked participants to develop an end-to-end AV model, trained using the nuPlan dataset, to generate driving trajectory based on sensor data.
The models were submitted for testing inside the open-source NAVSIM simulator and were tasked with navigating thousands of scenarios they hadn't experienced yet. Model performance was scored based on metrics for safety, passenger comfort and deviation from the original recorded trajectory.
NVIDIA Research's winning end-to-end model ingests camera and lidar data, as well as the vehicle's trajectory history, to generate a safe, optimal vehicle path for five seconds post-sensor input.
The workflow NVIDIA researchers used to win the competition can be replicated in high-fidelity simulated environments with NVIDIA Omniverse. This means AV simulation developers can recreate the workflow in a physically accurate environment before testing their AVs in the real world. NVIDIA Omniverse Cloud Sensor RTX microservices will be available later this year. Sign up for early access.
In addition, NVIDIA ranked second for its submission to the CVPR Autonomous Grand Challenge for Driving with Language. NVIDIA's approach connects vision language models and autonomous driving systems, integrating the power of large language models to help make decisions and achieve generalizable, explainable driving behavior.
Learn More at CVPR More than 50 NVIDIA papers were accepted to this year's CVPR, on topics spanning automotive, healthcare, robotics and more. Over a dozen papers will cover NVIDIA automotive-related research, including:
Hydra-MDP: End-to-End Multimodal Planning With Multi-Target Hydra-Distillation
Winner of CVPR's End-to-End Driving at Scale challenge
Read the NVIDIA technical blog
Producing and Leveraging Online Map Uncertainty in Trajectory Prediction
CVPR best paper award finalist
Driving Everywhere With Large Language Model Policy Adaptation
See DRIVE Labs: LLM-Based Road Rules Guide Simplifies Driving
Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?
Improving Distant 3D Object Detection Using 2D Box Supervision
Dynamic LiDAR Resimulation Using Compositional Neural Fields
BEVNeXt: Reviving Dense BEV Frameworks for 3D Object Detection
PARA-Drive: Parallelized Architecture for Real-Time Autonomous Driving
Sanja Fidler, vice president of AI research at NVIDIA, will speak on vision language models at the CVPR Workshop on Autonomous Driving.
Learn more about NVIDIA Research, a global team of hundreds of scientists and engineers focused on topics including AI, computer graphics, computer vision, self-driving cars and robotics.
See notice regarding software product information.
North America Stories
25/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
25/03/2026
Providing wide view timing visibility across the entire production chain...
25/03/2026
Continuing development drives advances in security, availability, access and connectivity...
25/03/2026
Caudalie, the renowned French cosmetics brand, has unveiled a state-of-the-art 200-seat auditorium at its new headquarters in the historic Marais district of ce...
25/03/2026
Telestream, a global leader in media workflow technologies, today announced expanded integration with Adobe Premiere, Adobe Media Encoder (AME), and Frame.io, d...
25/03/2026
Marshall Electronics is expanding its lineup of high-performance POV cameras designed for broadcast, live production and professional AV applications with the d...
25/03/2026
OOONA, a global provider of professional management and production tools for the media localization industry, announced today that it has been awarded the TPN G...
25/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
25/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
25/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
25/03/2026
SipRadius, specialists in secure, low-latency media transport, will drive innovation and interoperability still further with the launch of the SipMX Alliance at...
25/03/2026
QuickLink, a leading provider of award-winning video production and remote contribution solutions, will showcase its award-winning StudioPro ecosystem at The 2...
25/03/2026
Alfalite, the only European manufacturer of LED screens, will once again be present at NAB Show, the leading global event for the broadcast, media and entertain...
25/03/2026
PC, a leading provider of integrated communication solutions, will make its NAB 2026 Show debut in Booth C 3341. The company will highlight the newly branded On...
25/03/2026
Open video transport network simplifies satellite transition with new partnerships and global reach as spectrum auction nears
LTN will demonstrate how its purp...
25/03/2026
Test & measurement innovator, Leader Electronics, will present the full range of Leader, PHABRIX and LeaderPhabrix T&M solutions at the NAB Show, which takes pl...
25/03/2026
MNC Software, a global leader in network management and operational support systems tailored to the broadcast and media industry, today announced the appointmen...
25/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
25/03/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
25/03/2026
Starfish highlights flexible TS Splicer releases and new Monitoring Dashboard at...
25/03/2026
XLNTSOUND Elevates Video Production with Blackmagic Design
Brie Clayton March 24, 2026
0 Comments
Audio company upgrades workflow with Blackmagic Cine...
25/03/2026
First Time Exhibitor IPC Introduces One Link Keypanels for One Connect Intercom ...
25/03/2026
At the half-time whistle of the UEFA EURO 2020 round of 16 football match betwee...
24/03/2026
Utah Scientific to Showcase a Variety of Hybrid SDI/IP Innovations at the 2026 N...
24/03/2026
Mediaproxy will showcase an updated version of its LogPlayer interface at NAB Sh...
24/03/2026
C gep de Jonqui re, a public college in Qu bec, has upgraded its TV studio complex with five Calrec Brio consoles and a Dante IP network. The installation was c...
24/03/2026
The American Association of Professional Baseball (AAPB) has announced new and r...
24/03/2026
National Telecom Public Company Limited (NT) used Ateme's KYRION platform fo...
24/03/2026
Grass Valley has expanded its relationship with ImSoPROD, the TV production entity of FDJ United, with the deployment of LDX C98 compact cameras across its nati...
24/03/2026
The E.W. Scripps Company is launching Scripps Sports Network (SSN), a free, ad-s...
24/03/2026
NEP Group has launched NEP Platform, a new software orchestration system that un...
24/03/2026
Daktronics has partnered with the Arizona Diamondbacks to design, manufacture and install a new LED video display and three ribbon boards at Chase Field in Phoe...
24/03/2026
Grass Valley has completed an upgrade of University of Pittsburgh Athletics'...
24/03/2026
Daktronics is upgrading eight LED displays at Wrigley Field in Chicago, totaling more than 8,300 square feet, using the Daktronics Renew product line. The upgra...
24/03/2026
Advanced Systems Group has appointed Kevin Poole as Senior Project and Support Manager within the ASG Workflow and Tools practice. The position is newly created...
24/03/2026
In an increasingly streaming-centric world, protecting high-value live sports co...
24/03/2026
Mediaproxy will showcase an updated version of its LogPlayer interface at NAB Show, April 19-22 in Las Vegas, booth W1423. The update includes AI tools, native ...
24/03/2026
The production studio has worked with content juggernauts such as MrBeast, The R...
24/03/2026
The event will also feature a State of the Industry address from sports-media veteran and strategic advisor Patrick Crakes....
24/03/2026
Victory , a free sports streaming service owned by A Parent Media Co. (APMC), has launched its NWSL Sunday Night Soccer franchise. The platform says the launch ...
24/03/2026
Sports content in free streaming is still relatively scant, but it's growing, right along with its monetization capabilities
Streaming-tech company Wurl re...
24/03/2026
Directed by Greg DeHart, the doc will feature Sports Broadcasting Hall of Famers...
24/03/2026
For the first time ever, Tubi - Fox's free streaming service - is working w...
24/03/2026
L3Harris ramps up production of its VAMPIRE C-UxS system....
24/03/2026
For more than 70 years, L3Harris has delivered essential fuzes and safe-and-arm solutions that bring the might to multi-domain battlefields across the globe, ...
24/03/2026
Grass Valley has strengthened its long-standing relationship with ImSoPROD, the TV production entity of the FDJ United, with the deployment of Grass Valley LDX ...
24/03/2026
At the 2026 NAB Show in Las Vegas, Utah Scientific will spotlight its expanding portfolio of hybrid SDI/IP routing, conversion, control, and signal management s...
24/03/2026
Fresh off its global reveal at ISE 2026 in Barcelona, the new V410 live 4K encoder/decoder from Miri Technologies Inc. will make its North American debut at the...
24/03/2026
Cinegy GmbH, premier provider of software-defined television technology, will show how its solutions answer the real challenges facing content creators and broa...
24/03/2026
Canberra-based radio and online broadcast network ArtSound FM (https://artsound.fm/) has invested in DHD audio mixing consoles for two new studios at its headqu...