A new approach to autonomous driving is pursuing a solo career.
Researchers at MIT are developing a single deep neural network (DNN) to power autonomous vehicles, rather than a system of multiple networks. The research, published at COMPUTEX this week, used NVIDIA DRIVE AGX Pegasus to run the network in the vehicle, processing mountains of lidar data efficiently and in real time.
AV sensors generate an enormous amount of data - a fleet of just 50 vehicles driving six hours a day generates about 1.6 petabytes of sensor data a day. If all that data were stored on 1GB flash drives, they'd cover more than 100 football fields.
Self-driving cars must process this data instantaneously to perceive and safely navigate their surrounding environment. However, due to the volume of data, it's extremely difficult for a single DNN to perform this processing, which is why most approaches use multiple networks and high-definition maps.
In their paper, the MIT team detailed how it's attempting a new self-driving strategy with a single DNN, beginning with the task of real-time lidar sensor data processing.
By leveraging the high-performance, energy-efficient NVIDIA DRIVE AGX Pegasus, the team was able to engineer new accelerations to the computation of lidar in order to achieve, and even exceed, this goal, operating 15 times faster than current state-of-the-art systems.
Improving Efficiency Many AV systems in development today leverage a high-definition map in addition to an array of DNNs to process sensor data. The combination enables an AV to quickly locate itself in space and detect other road users, traffic signs and other objects.
While this method provides the redundancy and diversity necessary for safe autonomous driving, it's difficult to implement in areas that haven't been mapped.
Furthermore, AV systems that leverage lidar sensing need to process more than 2 million points in their surroundings every second. Unlike 2-dimensional image data, lidar points are extremely sparse in 3D space, presenting a huge challenge for modern compute hardware, as architectures are not tailored to this form of data.
The MIT team developed new improvements to achieve much more speed and energy efficiency beyond base architectures.
MIT's DNN is designed to perform the same functions as an entire self-driving system. This complete functionality is achieved by training the network on enormous amounts of human driving data, teaching it to approach driving holistically as a human driver would, rather than breaking it out into specific tasks.
While this method is still in development, it has significant potential benefits.
Running a single DNN in the vehicle is markedly more efficient than multiple dedicated networks, opening up compute headroom for other features. It's also more flexible, since the DNN relies on its training, rather than a map, to navigate unseen roads. The efficiency improvements also allowed for processing much larger amounts of rich perception data in real-time.
Supercharging Performance with NVIDIA DRIVE When combined with high-performance, central compute, MIT found that its DNN is even more adept.
NVIDIA DRIVE AGX Pegasus is an AI supercomputer designed for level 4 and level 5 autonomous systems. It uses the power of two NVIDIA Xavier SoCs and two NVIDIA Turing GPUs to achieve an unprecedented 320 trillion operations per second of performance.
MIT researchers set out to develop the DNN on a compute system that wasn't just powerful, but also common among AV systems currently in development.
We wanted to have a very flexible and modular AV system, and NVIDIA is the leader in this field, said Alexander Amini, a Ph.D. student at MIT co-leading the project. Pegasus is able to handle the input streams from various sensors, making it easy for developers to implement their DNNs.
The DNN's lidar perception capabilities are just the beginning of the MIT researchers' self-driving development goals. Amini said the team is looking to tackle combined sensor streams, more complex interaction with other vehicles, as well as adverse weather conditions - all with NVIDIA DRIVE on board.
Most recent headlines
23/12/2025
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
23/12/2025
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
23/12/2025
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
23/12/2025
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
23/12/2025
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
23/12/2025
Taking the Stage at Carnegie Hall-On a Global Scale Boston Conservatory Orchestra students reflect on their epic concert marking the 80th session of the UN Gene...
22/12/2025
SVG New Sponsor Spotlight: Presidio's Neerav Shah on the Role of Its Captiva...
22/12/2025
Hitting the bullseye: Sky Sports readies itself for the biggest PDC World Darts ...
22/12/2025
Unique skillset: Bringing new directors to the world of darts at The Worlds with...
22/12/2025
Gravity Media prepares for a flight of fancy with the PDC World Darts Championsh...
22/12/2025
One hundred and eighty: Gravity Media on hitting the production bullseye at the ...
22/12/2025
The Famous Group's Jon Slusser on Fascinating Fans Through Immersive Content...
22/12/2025
ESPN's Meg Aronowitz on Continuing High-Quality Broadcasts of Collegiate Spo...
22/12/2025
ESPN Takes Data-Driven Storytelling to New Heights with MNF Playbook with Next ...
22/12/2025
For a decade, popular German podcast Fest & Flauschig has hosted an annual Chris...
22/12/2025
Paramount Scores Largest Share Increase Among Distributors as Paramount and CBS...
22/12/2025
New multi-year deal integrates Roku's data to fuel Nielsen's measurement suite
Roku gains access to Nielsen's streaming ratings, showing The Roku C...
22/12/2025
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
22/12/2025
Berklee Wrapped 2025: Our Top News and Stories A look back at a year highlighted by faculty milestones, major film and television projects, Bob Dylan's ho...
22/12/2025
The works of Plato state that when humans have an experience, some level of change occurs in their brain, which is powered by memory - specifically long-term me...
22/12/2025
Partnership integrates complementary satellite data and AI analytics to enhance security, infrastructure, and environmental monitoring solutions for global cust...
22/12/2025
Workflows allow you to create a sequence of planned events which may be added to your template(s) or inserted directly into your sequential or background playli...
22/12/2025
Monday 22 December 2025
Sky extends PGA TOUR partnership until 2029, as Sky Spo...
22/12/2025
Back to All News
Global Anime Hits and New Releases Take Center Stage at Jump Festa 2026
Entertainment
22 December 2025
GlobalJapan
Link copied to clipboar...
22/12/2025
Siobh n McSweeney, Rory McIlroy, Elon Musk, Catherine Connolly, Jim Gavin, Ivan Yates and Traitor Paudie Moloney lead new characters for Callan Kicks the Year 2...
22/12/2025
Winner announced in the picturesque surroundings of Wicklow's Avondale Tower and Treetop Walk
Andrew Trimble wins the show in his first series as coach
Th...
22/12/2025
The 2025 winners have been announced today, Sunday 21 December, for Ireland's largest choral competition Choirs for Christmas hosted by RT lyric fm.
Ove...
21/12/2025
Back to All News
Legoshi and Haru's Story Reaches Its Finale: BEASTARS Fin...
21/12/2025
John Shortt named Young Sportsperson of the Year Kerry are the Team of the Year
...
20/12/2025
Atomos announced the immediate availability of a new firmware update for its Ninja TX GO and Ninja TX monitor-recorders, unlocking ProRes RAW recording from the...
20/12/2025
CJP Broadcast has completed the digitisation of the European Gymnastics tape archive, converting 328 tapes containing more than forty years of recorded material...
20/12/2025
Bitmovin, the leading provider of video streaming solutions, today announced the launch of the Stream Lab MCP Server, to give AI agents and large language model...
20/12/2025
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
20/12/2025
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
20/12/2025
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
20/12/2025
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
20/12/2025
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
20/12/2025
Share Share by:
Copy link
Facebook
X
Whatsapp
Pinterest
Flipboard...
20/12/2025
Barack Obama Includes Laufey on His 2025 Favorite Music List The former presidents roundup of books, music, and movies includes a song from the Berklee alums ...
20/12/2025
Study reveals a key hormonal circuit in the kidneys Scripps Research scientists identify the protein that helps kidney cells regulate renin, providing foundatio...
19/12/2025
With Playout Release 2025.4, ToolsOnAir continues to push professional playout w...
19/12/2025
SVG Sit-Down: Diversified's Jared Timmins on AI for Broadcast Sports and Cre...
19/12/2025
2025 SVG Summit Audio Recap: Say What?The Audio Production and Distribution Workshop at the SVG Summit 20 took on issues including speech intelligibility, Next-...
19/12/2025
Gamified fun: Channel 5 on its NFL Big Game Night ambitions with Hungry Bear Med...
19/12/2025
College Football Playoff Preview: For ESPN, Round 1 is a Fantastic Yet Familia...
19/12/2025
AWS's Jason Dvorkin on Developing Partnerships With the NBA and PGA Tour, Em...
19/12/2025
Netflix Kicks Off Packed Sports Week with Paul-Joshua Fight Before Shifting to N...
19/12/2025
SVG New Sponsor Spotlight: Presidio's Nareev Shah on the Role of Its Captiva...
19/12/2025
Mounted to the pylon of an AH-1Z Viper helicopter, a Red Wolf vehicle successful...
A new approach to autonomous driving is pursuing a solo career.
