Sony Pixel Power calrec Sony

Shifting Paradigms, Not Gears: How the Auto Industry Will Solve the Robotaxi Problem

18/12/2020

A giant toaster with windows. That's the image for many when they hear the term robotaxi. But there's much more to these futuristic, driverless vehicles than meets the eye. They could be, in fact, the next generation of transportation.

Automakers, suppliers and startups have been dedicated to developing fully autonomous vehicles for the past decade, though none has yet to deploy a self-driving fleet at scale.

The process is taking longer than anticipated because creating and deploying robotaxis aren't the same as pushing out next year's new car model. Instead, they're complex supercomputers on wheels with no human supervision, requiring a unique end-to-end process to develop, roll out and continually enhance.

The difference between these two types of vehicles is staggering. The amount of sensor data a robotaxi needs to process is 100 times greater than today's most advanced vehicles. The complexity in software also increases exponentially, with an array of redundant and diverse deep neural networks (DNNs) running simultaneously as part of an integrated software stack.

These autonomous vehicles also must be constantly upgradeable to take advantage of the latest advances in AI algorithms. Traditional cars are at their highest level of capability at the point of sale. With yearslong product development processes and a closed architecture, these vehicles can't take advantage of features that come about after they leave the factory.

Vehicles That Get Better and Better Over Time With an open, software-defined architecture, robotaxis will be at their most basic capability when they first hit the road. Powered by DNNs that are continuously improved and updated in the vehicle, self-driving cars will constantly be at the cutting edge.

These new capabilities all require high-performance, centralized compute. Achieving this paradigm shift in personal transportation requires reworking the entire development pipeline from end to end, with a unified architecture from training, to validation, to real-time processing.

NVIDIA is the only company that enables this end-to-end development, which is why virtually every robotaxi maker and supplier - from Zoox and Voyage in the U.S., to DiDi Chuxing in China, to Yandex in Russia - is using its GPU-powered offerings.

Installing New Infrastructure Current advanced driver assistance systems are built on features that have become more capable over time, but don't necessarily rely on AI. Autonomous vehicles, however, are born out of the data center. To operate in thousands of conditions around the world requires intensive DNN training using mountains of data. And that data grows exponentially as the number of AVs on the road increases.

To put that in perspective, a fleet of just 50 vehicles driving six hours a day generates about 1.6 petabytes of sensor data daily. If all that data were stored on standard 1GB flash drives, they'd cover more than 100 football fields. This data must then be curated and labeled to train the DNNs that will run in the car, performing a variety of dedicated functions, such as object detection and localization.

NVIDIA DRIVE infrastructure provides the unified architecture needed to train self-driving DNNs on massive amounts of data. This data center infrastructure isn't also used to test and validate DNNs before vehicles operate on public roads. The NVIDIA DRIVE Sim software and NVIDIA DRIVE Constellation autonomous vehicle simulator deliver a scalable, comprehensive and diverse testing environment. DRIVE Sim is an open platform with plug-ins for third-party models from ecosystem partners, allowing users to customize it for their unique use cases.

NVIDIA DRIVE Constellation and NVIDIA DRIVE Sim deliver a virtual proving ground for autonomous vehicles. This entire development infrastructure is critical to deploying robotaxis at scale and is only possible through the unified, open and high-performance compute delivered by GPU technology.

Re-Thinking the Wheel The same processing capabilities required to train, test and validate robotaxis are just as necessary in the vehicle itself.

A centralized AI compute architecture makes it possible to run the redundant and diverse DNNs needed to replace the human driver all at once. This architecture must also be open to take advantage of new features and DNNs.

The DRIVE family is built on a single scalable architecture ranging from one NVIDIA Orin variant that sips just five watts of energy and delivers 10 TOPS of performance all the way up to the new DRIVE AGX Pegasus, featuring the next-generation Orin SoC and NVIDIA Ampere architecture for thousands of operations per second.

With a single scalable architecture, robotaxi makers have the flexibility to develop new types of vehicles on NVIDIA DRIVE AGX. Such a high level of performance is necessary to replace and perform better than a human driver. Additionally, the open and modular nature of the platform enables robotaxi companies to create custom configurations to accommodate the new designs opened up by removing the human driver (along with steering wheel and pedals).

With the ability to use as many processors as needed to analyze data from the dozens of onboard sensors, developers can ensure safety through diversity and redundancy of systems and algorithms.

This level of performance has taken years of investment and expertise to achieve. And, by using a single scalable architecture, companies can easily transition to the latest platforms without sacrificing valuable software development time.

Continuous Improvement By combining data center and in-vehicle solutions, robotaxi companies can create a continuous, end-to-end development cycle for constant improvement.

As DNNs undergo improvement and learn new capabilities in the data center, the validated algorithms can be delivered to the car
LINK: https://blogs.nvidia.com/blog/2020/12/18/auto-industry-solve-robotaxi-...
See more stories from nvidia

Most recent headlines

04/08/2024

Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation

Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....

03/06/2024

Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives

Dalet, a leading technology and service provider for media-rich organizations, a...

29/04/2024

Filming begins and further cast confirmed in Mark Gatiss drama Bookish for Alibi

(L-R) Mark Gatiss and Polly Walker on set Monday 29 April 2024 Further casting is now confirmed for Bookish (6x70), a brand-new drama created by Emmy Award-wi...

29/04/2024

She Speaks Sudan': Thomson launches programme to empower women journalists and civil society actors in exile

A groundbreaking initiative offering training and mentoring to 30 women journali...

29/04/2024

Meet the 2024 Sundance Institute Directors, Screenwriters, and Native Lab Fellows

Even though we've been doing this for over 40 years, a spark of excitement r...

29/04/2024

The AN/PRC-158: A Resilient Communications Bridge Between Air and Ground

L3Harris is delivering manpack radios to U.S. Army CH-47 Chinooks as part of the Air-to-Ground Networking Radio program, providing seamless, resilient communica...

29/04/2024

CS President Sam Mehta: Resilient Communications are Critical to Realizing JADC2

He writes in Defense One: Despite the near-universal acknowledgement throughout the U.S. government and defense industrial base of the criticality of resilient ...

29/04/2024

Clear-Com Enhances The Kennedy Center with Seamless Communication Solutions

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

29/04/2024

Optimising audio loudness & normalisation across the Media Supply Chain

Codemill aims to revolutionize media workflow efficiency at this years NAB Show by introducing Just-In-Time (JIT) playback technology in Accurate.Video Validate...

29/04/2024

TF1 Chooses Broadpeak to Power Targeted Advertising for New Video Streaming Service

April 29, 2024 -- TF1 Chooses Broadpeak to Power Targeted Advertising for New...

29/04/2024

LG Adds Allen Media Group's Local Now FAST Channel in 223 Markets

LOS ANGELES Allen Media Group (AMG) has partnered with LG Electronics to bring 223 Local Now FAST channels to LG's free streaming service, LG Channels, avai...

29/04/2024

Ross Video Unveils Raiden Weather Graphics System

OTTAWA Ross Video has announced the introduction of Raiden, a data-driven weather graphics software that combines data gathering, processing, and visualization ...

29/04/2024

Melanie Georgieva Joins Panalux as Long Form Sales Direct...

Panalux, a leading rental provider of lighting and power solutions for the motion-picture industry and part of Panavision's end-to-end service offerings for...

29/04/2024

Cobalt Iron Earns Patent on Analytics-Based Dynamic Autho...

Cobalt Iron Inc., a leading provider of SaaS-based enterprise data protection, today announced that it has received a patent on its technology for dynamic autho...

29/04/2024

SDVI Rally Access Workstation Earns Two Top Awards at 202...

SDVI, the leading platform provider for cloud-native media supply chains, today announced that Rally Access Workstation, a fully managed solution for editing in...

29/04/2024

Premier Sports selects QuickLink Remote Commentary soluti...

Premier Sports, a premium sports broadcaster, has selected QuickLink's Remote Commentary solution for introducing professional, high-quality remote commenta...

29/04/2024

Glookast picks Jigsaw24 Media as exclusive UK channel par...

Glookast has chosen Jigsaw24 Media as the only UK channel partner to represent their portfolio of ingest and workflow optimisation products. The agreement, sign...

29/04/2024

Clear-Coms Eclipse HX and Agent-IC Technology Illuminate...

Clear-Com played a pivotal role in the seamless coverage of the recent solar eclipse on April 8, 2024. Leveraging its cutting-edge Eclipse HX Digital Matrix i...

29/04/2024

PlayBox Neo to Promote Latest Smart Media Playout Innovat...

PlayBox Neo will promote its complete range of television channel management, graphic branding and playout solutions to EMEA region media content owners and bro...

29/04/2024

RuPaul Game Show Lingo' Returns to CBS May 24

Lingo, RuPaul's word-twisting game show, returns for season two on CBS Friday, May 24. Two episodes air that night, and stream on Paramount Plus, too....

29/04/2024

ESPN, Amazon Prime Video Reportedly Close To New Deals With the NBA

ESPN and Amazon Prime Video are reportedly close to scoring television rights to the National Basketball Association, according to published reports....

29/04/2024

Judge Judy,' Hot Bench' Renewed for 2 More Years

Judge Judy and Hot Bench, CBS Media Ventures' genre-leading court shows, have been renewed through the 2025-26 TV season in more than 95% of the country, Gr...

29/04/2024

Irish Sports Broadcaster Premier Sports Taps QuickLink for Remote Commentary

Premier Sports, an Irish-based premium sports broadcaster, has selected QuickLink's Remote Commentary solution for introducing professional, high-quality re...

29/04/2024

BAFTA Television Craft Awards winners announced

The awards celebrate the craft of behind-the-scenes TV talent and the best programmes of 2023 By Matthew Corrigan Published: April 29, 2024 The awards cel...

29/04/2024

Watch: How Milk VFX helped create 259 shots for Netflix's Scoop

The team at Milk had to create and deliver the VFX and environment work for the royal residences featured in the drama from scratch By Jenny Priestley Publis...

29/04/2024

What's going on at Paramount Global?

CEO Bob Bakish is expected to leave the company as early as today, with a new leadership committee likely to run the company on an interim basis By Jenny Pries...

29/04/2024

Meet the director of media and entertainment and strategic products

Albena Ivanova, director, media and entertainment and strategic products at CHAOS talks to TVBEurope about her route into the industry By TVBEurope Staff Pub...

29/04/2024

Anna Valley brand name acquired by AV company Grand Technix

The acquisition gives Grand Technix the opportunity to expand its footprint in the audio visual and broadcast technology sectors By Jenny Priestley Published...

29/04/2024

Screen Australia announces James J. Robinson's debut feature First Light

29 04 2024 - Media release Screen Australia announces James J. Robinson's debut feature First Light First Light Principal Photography is underway on Firs...

29/04/2024

Capitol Broadcasting Becomes First Company Inducted into NC Media and Journalism Hall of Fame

Capitol Broadcasting recently became the inaugural company honored with inductio...

29/04/2024

Rebrand and Refresh: SailGP Talks Bringing its Graphics Operations Inhouse for a Bright New Look to Keep Viewers Illuminated

Rebrand and refresh: SailGP talks bringing its graphics operations inhouse for a...

29/04/2024

Reflecting on a Storied Career: Sean McManus Looks Back While Keeping an Eye on the Future

Reflecting on a Storied Career: Sean McManus Looks Back While Keeping an Eye on ...

29/04/2024

Drones Take Flight Inside MSG: How Sky Candy Studios is Upping the Excitement for Knicks, Rangers Playoff Series

Drones Take Flight Inside MSG: How Sky Candy Studios is Upping the Excitement fo...

29/04/2024

Netflix Announces a Diverse Lineup of Polish Titles to Debut in 2024 With Established Creators Returning With New Series and Films

Back to All News Netflix Announces a Diverse Lineup of Polish Titles to Debut i...

29/04/2024

Tonight on Smoke and Mirrors: Fanyana feels embarrassed about his sexual mishap

Tonight on Smoke and Mirrors: Fanyana feels embarrassed about his sexual mishapDon't miss Monday, 29 April's riveting episode of South African soapie Sm...

29/04/2024

SEA.AI Navigates the Future With AI at the Helm

Talk about commitment. When startup SEA.AI, an NVIDIA Metropolis partner, set out to create a system that would use AI to scan the seas to enhance maritime safe...

28/04/2024

Mediahaus delivers the first SRT live-streaming sports production over 5G with URSA Broadcast G2

Mediahaus delivers the first SRT live-streaming sports production over 5G with U...

27/04/2024

L3Harris Chair and CEO Christopher E. Kubasik Discusses 1Q24 On CNBC's "Closing Bell: Overtime"

On April 26, L3Harris Chair and CEO Christopher E. Kubasik joined CNBC's Mor...

27/04/2024

Audinate Adds Major New Features to Dante Connect

PORTLAND, Oregon Audinate Group Limited, the developer of the Dante AV-over-IP solution, announced significant new additions to Dante Connect, its cloud-based D...

27/04/2024

Bell Media Launches New Portfolio of FAST Channels

TORONTO Bell Media has launched 10 English and French-language FAST channels featuring entertainment, factual, news, and sports programming. The new free stream...

27/04/2024

Study: Broadcast TV Evening News Avoids Serious Economic Issues

An extensive new analysis of the news segments in the broadcast evening news programs of ABC, CBS, NBC and PBS has found that broadcasters devoted most of their...

27/04/2024

Hughes Opens Manufacturing Facility and Private 5G Incubation Center in Maryland

GERMANTOWN, Md. EchoStar's Hughes Network Systems has opened a new manufacturing facility and private 5G incubation center in Germantown, Maryland....

27/04/2024

Broadcasting Legend Harry Pappas Dead At 78

Harry Pappas, one of three brothers who founded Pappas Telecasting Companies in 1971, died April 24. He was 78 years old....

27/04/2024

Televisa Selects Synamedia For Broadcast Distribution Overhaul

ATLANTA and LONDON Mexican telecommunications and broadcast company Televisa has selected Synamedia for an overhaul of its broadcast distribution....

27/04/2024

Participate in the Survey - The Impact of AI on Media and the Creative Industry

Participate in the Survey - The Impact of AI on Media and the Creative Industry Pascal Wagner April 26, 2024 0 Comments By participating in this surve...

27/04/2024

SDVI Rally Access Workstation Earns Two Top Awards at 2024 NAB Show

SDVI Rally Access Workstation Earns Two Top Awards at 2024 NAB Show Brie Clayton April 26, 2024 0 Comments SDVI, the leading platform provider for clo...

27/04/2024

Berklee's Music and Health Institute Launches Community Health Musician Certificate

Berklee's Music and Health Institute Launches Community Health Musician Cert...

27/04/2024

Charter Reports Higher Q1 Profits Despite Broadband, Video Losses

Charter Communications reported higher first-quarter profits despite continued cord-cutting and competition for broadband customers....