Shifting Paradigms, Not Gears: How the Auto Industry Will Solve the Robotaxi Problem
18/12/2020
Automakers, suppliers and startups have been dedicated to developing fully autonomous vehicles for the past decade, though none has yet to deploy a self-driving fleet at scale.
The process is taking longer than anticipated because creating and deploying robotaxis aren't the same as pushing out next year's new car model. Instead, they're complex supercomputers on wheels with no human supervision, requiring a unique end-to-end process to develop, roll out and continually enhance.
The difference between these two types of vehicles is staggering. The amount of sensor data a robotaxi needs to process is 100 times greater than today's most advanced vehicles. The complexity in software also increases exponentially, with an array of redundant and diverse deep neural networks (DNNs) running simultaneously as part of an integrated software stack.
These autonomous vehicles also must be constantly upgradeable to take advantage of the latest advances in AI algorithms. Traditional cars are at their highest level of capability at the point of sale. With yearslong product development processes and a closed architecture, these vehicles can't take advantage of features that come about after they leave the factory.
Vehicles That Get Better and Better Over Time With an open, software-defined architecture, robotaxis will be at their most basic capability when they first hit the road. Powered by DNNs that are continuously improved and updated in the vehicle, self-driving cars will constantly be at the cutting edge.
These new capabilities all require high-performance, centralized compute. Achieving this paradigm shift in personal transportation requires reworking the entire development pipeline from end to end, with a unified architecture from training, to validation, to real-time processing.
NVIDIA is the only company that enables this end-to-end development, which is why virtually every robotaxi maker and supplier - from Zoox and Voyage in the U.S., to DiDi Chuxing in China, to Yandex in Russia - is using its GPU-powered offerings.
Installing New Infrastructure Current advanced driver assistance systems are built on features that have become more capable over time, but don't necessarily rely on AI. Autonomous vehicles, however, are born out of the data center. To operate in thousands of conditions around the world requires intensive DNN training using mountains of data. And that data grows exponentially as the number of AVs on the road increases.
To put that in perspective, a fleet of just 50 vehicles driving six hours a day generates about 1.6 petabytes of sensor data daily. If all that data were stored on standard 1GB flash drives, they'd cover more than 100 football fields. This data must then be curated and labeled to train the DNNs that will run in the car, performing a variety of dedicated functions, such as object detection and localization.
NVIDIA DRIVE infrastructure provides the unified architecture needed to train self-driving DNNs on massive amounts of data. This data center infrastructure isn't also used to test and validate DNNs before vehicles operate on public roads. The NVIDIA DRIVE Sim software and NVIDIA DRIVE Constellation autonomous vehicle simulator deliver a scalable, comprehensive and diverse testing environment. DRIVE Sim is an open platform with plug-ins for third-party models from ecosystem partners, allowing users to customize it for their unique use cases.
NVIDIA DRIVE Constellation and NVIDIA DRIVE Sim deliver a virtual proving ground for autonomous vehicles. This entire development infrastructure is critical to deploying robotaxis at scale and is only possible through the unified, open and high-performance compute delivered by GPU technology.
Re-Thinking the Wheel The same processing capabilities required to train, test and validate robotaxis are just as necessary in the vehicle itself.
A centralized AI compute architecture makes it possible to run the redundant and diverse DNNs needed to replace the human driver all at once. This architecture must also be open to take advantage of new features and DNNs.
The DRIVE family is built on a single scalable architecture ranging from one NVIDIA Orin variant that sips just five watts of energy and delivers 10 TOPS of performance all the way up to the new DRIVE AGX Pegasus, featuring the next-generation Orin SoC and NVIDIA Ampere architecture for thousands of operations per second.
With a single scalable architecture, robotaxi makers have the flexibility to develop new types of vehicles on NVIDIA DRIVE AGX. Such a high level of performance is necessary to replace and perform better than a human driver. Additionally, the open and modular nature of the platform enables robotaxi companies to create custom configurations to accommodate the new designs opened up by removing the human driver (along with steering wheel and pedals).
With the ability to use as many processors as needed to analyze data from the dozens of onboard sensors, developers can ensure safety through diversity and redundancy of systems and algorithms.
This level of performance has taken years of investment and expertise to achieve. And, by using a single scalable architecture, companies can easily transition to the latest platforms without sacrificing valuable software development time.
Continuous Improvement By combining data center and in-vehicle solutions, robotaxi companies can create a continuous, end-to-end development cycle for constant improvement.
As DNNs undergo improvement and learn new capabilities in the data center, the validated algorithms can be delivered to the car
LINK: | https://blogs.nvidia.com/blog/2020/12/18/auto-industry-solve-robotaxi-... |
See more stories from nvidia |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
29/04/2024
Filming begins and further cast confirmed in Mark Gatiss drama Bookish for Alibi
(L-R) Mark Gatiss and Polly Walker on set Monday 29 April 2024 Further casting is now confirmed for Bookish (6x70), a brand-new drama created by Emmy Award-wi...
29/04/2024
She Speaks Sudan': Thomson launches programme to empower women journalists and civil society actors in exile
A groundbreaking initiative offering training and mentoring to 30 women journali...
29/04/2024
Meet the 2024 Sundance Institute Directors, Screenwriters, and Native Lab Fellows
Even though we've been doing this for over 40 years, a spark of excitement r...
29/04/2024
The AN/PRC-158: A Resilient Communications Bridge Between Air and Ground
L3Harris is delivering manpack radios to U.S. Army CH-47 Chinooks as part of the Air-to-Ground Networking Radio program, providing seamless, resilient communica...
29/04/2024
CS President Sam Mehta: Resilient Communications are Critical to Realizing JADC2
He writes in Defense One: Despite the near-universal acknowledgement throughout the U.S. government and defense industrial base of the criticality of resilient ...
29/04/2024
Clear-Com Enhances The Kennedy Center with Seamless Communication Solutions
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......
29/04/2024
Optimising audio loudness & normalisation across the Media Supply Chain
Codemill aims to revolutionize media workflow efficiency at this years NAB Show by introducing Just-In-Time (JIT) playback technology in Accurate.Video Validate...
29/04/2024
TF1 Chooses Broadpeak to Power Targeted Advertising for New Video Streaming Service
April 29, 2024 -- TF1 Chooses Broadpeak to Power Targeted Advertising for New...
29/04/2024
LG Adds Allen Media Group's Local Now FAST Channel in 223 Markets
LOS ANGELES Allen Media Group (AMG) has partnered with LG Electronics to bring 223 Local Now FAST channels to LG's free streaming service, LG Channels, avai...
29/04/2024
Ross Video Unveils Raiden Weather Graphics System
OTTAWA Ross Video has announced the introduction of Raiden, a data-driven weather graphics software that combines data gathering, processing, and visualization ...
29/04/2024
Melanie Georgieva Joins Panalux as Long Form Sales Direct...
Panalux, a leading rental provider of lighting and power solutions for the motion-picture industry and part of Panavision's end-to-end service offerings for...
29/04/2024
Cobalt Iron Earns Patent on Analytics-Based Dynamic Autho...
Cobalt Iron Inc., a leading provider of SaaS-based enterprise data protection, today announced that it has received a patent on its technology for dynamic autho...
29/04/2024
SDVI Rally Access Workstation Earns Two Top Awards at 202...
SDVI, the leading platform provider for cloud-native media supply chains, today announced that Rally Access Workstation, a fully managed solution for editing in...
29/04/2024
Premier Sports selects QuickLink Remote Commentary soluti...
Premier Sports, a premium sports broadcaster, has selected QuickLink's Remote Commentary solution for introducing professional, high-quality remote commenta...
29/04/2024
Glookast picks Jigsaw24 Media as exclusive UK channel par...
Glookast has chosen Jigsaw24 Media as the only UK channel partner to represent their portfolio of ingest and workflow optimisation products. The agreement, sign...
29/04/2024
Clear-Coms Eclipse HX and Agent-IC Technology Illuminate...
Clear-Com played a pivotal role in the seamless coverage of the recent solar eclipse on April 8, 2024. Leveraging its cutting-edge Eclipse HX Digital Matrix i...
29/04/2024
PlayBox Neo to Promote Latest Smart Media Playout Innovat...
PlayBox Neo will promote its complete range of television channel management, graphic branding and playout solutions to EMEA region media content owners and bro...
29/04/2024
RuPaul Game Show Lingo' Returns to CBS May 24
Lingo, RuPaul's word-twisting game show, returns for season two on CBS Friday, May 24. Two episodes air that night, and stream on Paramount Plus, too....
29/04/2024
ESPN, Amazon Prime Video Reportedly Close To New Deals With the NBA
ESPN and Amazon Prime Video are reportedly close to scoring television rights to the National Basketball Association, according to published reports....
29/04/2024
Judge Judy,' Hot Bench' Renewed for 2 More Years
Judge Judy and Hot Bench, CBS Media Ventures' genre-leading court shows, have been renewed through the 2025-26 TV season in more than 95% of the country, Gr...
29/04/2024
Irish Sports Broadcaster Premier Sports Taps QuickLink for Remote Commentary
Premier Sports, an Irish-based premium sports broadcaster, has selected QuickLink's Remote Commentary solution for introducing professional, high-quality re...
29/04/2024
BAFTA Television Craft Awards winners announced
The awards celebrate the craft of behind-the-scenes TV talent and the best programmes of 2023 By Matthew Corrigan Published: April 29, 2024 The awards cel...
29/04/2024
Watch: How Milk VFX helped create 259 shots for Netflix's Scoop
The team at Milk had to create and deliver the VFX and environment work for the royal residences featured in the drama from scratch By Jenny Priestley Publis...
29/04/2024
What's going on at Paramount Global?
CEO Bob Bakish is expected to leave the company as early as today, with a new leadership committee likely to run the company on an interim basis By Jenny Pries...
29/04/2024
Meet the director of media and entertainment and strategic products
Albena Ivanova, director, media and entertainment and strategic products at CHAOS talks to TVBEurope about her route into the industry By TVBEurope Staff Pub...
29/04/2024
Anna Valley brand name acquired by AV company Grand Technix
The acquisition gives Grand Technix the opportunity to expand its footprint in the audio visual and broadcast technology sectors By Jenny Priestley Published...
29/04/2024
Screen Australia announces James J. Robinson's debut feature First Light
29 04 2024 - Media release Screen Australia announces James J. Robinson's debut feature First Light First Light Principal Photography is underway on Firs...
29/04/2024
Capitol Broadcasting Becomes First Company Inducted into NC Media and Journalism Hall of Fame
Capitol Broadcasting recently became the inaugural company honored with inductio...
29/04/2024
Uninterrupted and Tribeca Enterprises Partner for Second-Annual Uninterrupted Film Festival Powered by Tribeca Festival July 9-10 in Los Angeles
April 29th, 2024 UNINTERRUPTED AND TRIBECA ENTERPRISES PARTNER FOR SECOND-ANNUA...
29/04/2024
Rebrand and Refresh: SailGP Talks Bringing its Graphics Operations Inhouse for a Bright New Look to Keep Viewers Illuminated
Rebrand and refresh: SailGP talks bringing its graphics operations inhouse for a...
29/04/2024
Reflecting on a Storied Career: Sean McManus Looks Back While Keeping an Eye on the Future
Reflecting on a Storied Career: Sean McManus Looks Back While Keeping an Eye on ...
29/04/2024
Drones Take Flight Inside MSG: How Sky Candy Studios is Upping the Excitement for Knicks, Rangers Playoff Series
Drones Take Flight Inside MSG: How Sky Candy Studios is Upping the Excitement fo...
29/04/2024
Netflix Announces a Diverse Lineup of Polish Titles to Debut in 2024 With Established Creators Returning With New Series and Films
Back to All News Netflix Announces a Diverse Lineup of Polish Titles to Debut i...
29/04/2024
Tonight on Smoke and Mirrors: Fanyana feels embarrassed about his sexual mishap
Tonight on Smoke and Mirrors: Fanyana feels embarrassed about his sexual mishapDon't miss Monday, 29 April's riveting episode of South African soapie Sm...
29/04/2024
SEA.AI Navigates the Future With AI at the Helm
Talk about commitment. When startup SEA.AI, an NVIDIA Metropolis partner, set out to create a system that would use AI to scan the seas to enhance maritime safe...
28/04/2024
Mediahaus delivers the first SRT live-streaming sports production over 5G with URSA Broadcast G2
Mediahaus delivers the first SRT live-streaming sports production over 5G with U...
27/04/2024
L3Harris Chair and CEO Christopher E. Kubasik Discusses 1Q24 On CNBC's "Closing Bell: Overtime"
On April 26, L3Harris Chair and CEO Christopher E. Kubasik joined CNBC's Mor...
27/04/2024
Audinate Adds Major New Features to Dante Connect
PORTLAND, Oregon Audinate Group Limited, the developer of the Dante AV-over-IP solution, announced significant new additions to Dante Connect, its cloud-based D...
27/04/2024
Bell Media Launches New Portfolio of FAST Channels
TORONTO Bell Media has launched 10 English and French-language FAST channels featuring entertainment, factual, news, and sports programming. The new free stream...
27/04/2024
Study: Broadcast TV Evening News Avoids Serious Economic Issues
An extensive new analysis of the news segments in the broadcast evening news programs of ABC, CBS, NBC and PBS has found that broadcasters devoted most of their...
27/04/2024
Hughes Opens Manufacturing Facility and Private 5G Incubation Center in Maryland
GERMANTOWN, Md. EchoStar's Hughes Network Systems has opened a new manufacturing facility and private 5G incubation center in Germantown, Maryland....
27/04/2024
Broadcasting Legend Harry Pappas Dead At 78
Harry Pappas, one of three brothers who founded Pappas Telecasting Companies in 1971, died April 24. He was 78 years old....
27/04/2024
Televisa Selects Synamedia For Broadcast Distribution Overhaul
ATLANTA and LONDON Mexican telecommunications and broadcast company Televisa has selected Synamedia for an overhaul of its broadcast distribution....
27/04/2024
Participate in the Survey - The Impact of AI on Media and the Creative Industry
Participate in the Survey - The Impact of AI on Media and the Creative Industry Pascal Wagner April 26, 2024 0 Comments By participating in this surve...
27/04/2024
SDVI Rally Access Workstation Earns Two Top Awards at 2024 NAB Show
SDVI Rally Access Workstation Earns Two Top Awards at 2024 NAB Show Brie Clayton April 26, 2024 0 Comments SDVI, the leading platform provider for clo...
27/04/2024
Berklee's Music and Health Institute Launches Community Health Musician Certificate
Berklee's Music and Health Institute Launches Community Health Musician Cert...
27/04/2024
Charter Reports Higher Q1 Profits Despite Broadband, Video Losses
Charter Communications reported higher first-quarter profits despite continued cord-cutting and competition for broadband customers....