Sony Pixel Power calrec Sony

Inside AI: NVIDIA DRIVE Ecosystem Creates Pioneering In-Cabin Features With NVIDIA DRIVE IX

21/09/2022

As personal transportation becomes electrified and automated, time in the vehicle has begun to resemble that of a living space rather than a mind-numbing commute.

Companies are creating innovative ways for drivers and passengers to make the most of this experience, using the flexibility and modularity of NVIDIA DRIVE IX. In-vehicle technology companies Cerence, Smart Eye, Rightware and DSP Concepts are now using the platform to deliver intelligent features for every vehicle occupant.

These partners are joining a diverse ecosystem of companies developing on DRIVE IX, including Soundhound, Jungo and VisionLabs, providing cutting-edge solutions for any in-vehicle need.

DRIVE IX provides an open software stack for cockpit solution providers to build and deploy features that will turn personal vehicles into interactive environments, enabling intelligent assistants, graphic user interfaces and immersive media and entertainment.

Intelligent Assistants AI isn't just transforming the way people drive, but also how they interact with cars.

Using speech, gestures and advanced graphical user interfaces, passengers can communicate with the vehicle through an AI assistant as naturally as they would with a human.

An intelligent assistant will help to operate vehicle functions more intuitively, warn passengers in critical situations and provide services such as giving local updates like the weather forecast, making reservations and phone calls, and managing calendars.

Conversational AI Interaction Software partner Cerence is enabling AI-powered, voice-based interaction with the Cerence Assistant, its intelligent in-car assistant platform.

Cerence Assistant uses sensor data to serve drivers throughout their daily journeys, notifying them, for example, when fuel or battery levels are low and navigating to the nearest gas or charging station.

It features robust speech recognition, natural language understanding and text-to-speech capabilities, enhancing the driver experience.

Courtesy of Cerence Using DRIVE IX, it can empower both embedded and cloud-based natural language processing on the same architecture, ensuring drivers have access to important capabilities regardless of connectivity.

Cerence Assistant also supports major global markets and related languages, and is customizable for brand-specific speech recognition and personalization.

Gesture Recognition In addition to speech, passengers can interact with AI assistants via gesture, which relies on interior sensing technologies.

Smart Eye is a global leader in AI-based driver monitoring and interior sensing solutions. Its production driver-monitoring system is already in 1 million vehicles on the roads around the world, and will be incorporated in the upcoming Polestar 3, set to be revealed in October.

Working with DRIVE IX, Smart Eye's technology makes it possible to detect eye movements, facial expressions, body posture and gestures, bringing insight into people's behavior, activities and mood.

Courtesy of Smart Eye Using NVIDIA GPU technology, Smart Eye has been able to speed up its cabin-monitoring system - which consists of 10 deep neural networks running in parallel - by more than 10x.

This interior sensing is critical for safety - ensuring driver attention is on the road when it should be and detecting left-behind children or pets - and it customizes and enhances the entire mobility experience for comfort, wellness and entertainment.

Graphical User Interface AI assistants can communicate relevant information easily and clearly with high-resolution graphical interfaces. Using DRIVE IX, Rightware is creating a seamless visual experience across all cockpit and infotainment domains.

Caption: Courtesy of Rightware Rightware's automotive human-machine interface tool Kanzi One helps designers bring amazing real-time 3D graphical user interfaces into the car and hides the underlying operating system and framework complexity. Automakers can completely customize the vehicle's user interface with Kanzi One, providing a brand-specific signature UI.

Enhancing visual user interfaces by audio features is equally important for interacting with the vehicle. The Audio Weaver development platform from DSP Concepts can be integrated into the DRIVE IX advanced sound engine. It provides a sound design toolchain and audio framework to graphically design features.

Courtesy of DSP Concepts. Creators and sound artists can design a car- and brand-specific sound experience without the hassle of writing complex code for low-level audio features from scratch.

Designing in Simulation With NVIDIA DRIVE Sim on Omniverse, developers can integrate, refine and test all these new features in the virtual world before implementing them in vehicles.

Interior sensing companies can build driver- or occupant-monitoring models in the cockpit using the DRIVE Replicator synthetic-data generation tool on DRIVE Sim. Partners providing content for vehicle displays can first develop on a rich, simulated screen configuration.

Access to this virtual vehicle platform can significantly accelerate end-to-end development of intelligent in-vehicle technology.

By combining the flexibility of DRIVE IX with leading in-cabin solutions providers, spending time in the car can become a luxury rather than a chore.
LINK: https://blogs.nvidia.com/blog/2022/09/21/drive-ix-ecosystem/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

CBS Sports UEFA Champions League Today Studio Show Heads to Budapest for Final as Transcontinental Popularity Grows

In its sixth year, the broadcaster's coverage has become a global brand and ...

01/06/2026

AudioShake Launches End-to-End Copyright Compliance System for Mixed-Media Audio

Designed to solve a common problem in broadcasting, the automated workflow detects, identifies, removes, and documents copyrighted music AudioShake has introdu...

01/06/2026

SVG Sit-Down: Stats Perform's Charles Kaplan on 30 Years of Opta, a Busy Summer of Soccer, What's Next

The sports-analytics company combines its data with proprietary AI to help leagu...

01/06/2026

Production Music Awards 2026

Category line-up & sponsors announced Photo: Paul Clarke The Production Music Awards (PMA) have announced that submissions are now officially open ahead of...

01/06/2026

Evolve Nest Acoustics from Excite Audio

New hybrid sample/synthesis instrument revealed Excite Audio have just released the latest instalment in their Evolve series, which has been developed in co...

01/06/2026

IK Multimedia release Royal 45 Legends Signature Collection

Latest TONEX expansion captures three rare vintage amps The newest addition to IK Multimedia's ever-growing TONEX line-up introduces a set of three incr...

01/06/2026

Scaler Music Carbon Electra 2

Musically intelligent soft synth gets upgraded Scaler Music will be probably be best known to many for their music theory tools, but their product range al...

01/06/2026

SBS confirms its broadcast sponsors for FIFA World Cup 2026

SBS confirms its broadcast sponsors for FIFA World Cup 2026 1 June, 2026 Media releases SBS has secured Hyundai, Hisense, Macca's, Rexona, bet365, Com...

01/06/2026

Rohde & Schwarz Satellite Industry Days 2026 guided by the motto From Earth to Orbit

Rohde & Schwarz Satellite Industry Days 2026 guided by the motto From Earth to ...

01/06/2026

ASG Advances Joe Marchitto to Western Regional CTO

Share Copy link Facebook X Linkedin Bluesky Email...

01/06/2026

Scripps Stations Go Dark on DirecTV

Share Copy link Facebook X Linkedin Bluesky Email...

01/06/2026

MARSHALL ELECTRONICS POWERS SEAMLESS AV EXPERIENCES WITH...

Marshall Electronics is showcasing a comprehensive lineup of next-generation POV cameras, purpose-built to power today's connected AV environments, at InfoC...

01/06/2026

Adobe Announces Concept to Vector

Adobe Announces Concept to Vector Deepa Subramaniam June 1, 2026 0 Comments One of the biggest frustrations we hear from designers is how difficult it...

01/06/2026

Vampire Feature Night Patrol Graded with DaVinci Resolve Studio

Vampire Feature Night Patrol Graded with DaVinci Resolve Studio Brie Clayton June 1, 2026 0 Comments Colorist shapes dark, gritty tone for horror thri...

01/06/2026

U.S. Broadcasters Ready for Most Complex FIFA World Cup Ever

Share Copy link Facebook X Linkedin Bluesky Email...

01/06/2026

Broadcasters Prepare for Nation's 250th Birthday Bash

Share Copy link Facebook X Linkedin Bluesky Email...

01/06/2026

Broadcasters Reveal What Makes C-Band Alternatives Right for Them

Share Copy link Facebook X Linkedin Bluesky Email...

01/06/2026

IAMT to Offer New Educational Sessions at InfoComm 2026

Share Copy link Facebook X Linkedin Bluesky Email...

01/06/2026

NewsNation Launches New Podcasting Studio and Podcasts

Share Copy link Facebook X Linkedin Bluesky Email...

01/06/2026

Simplifiez vos workflows avec FLAPI. Paris. 2 juin 2026

Mardi 2 juin 14h00 FilmLight (ARRI), 10 rue Ren Boulanger, 75010 Paris Rejoignez-nous pour d couvrir comment FLAPI (l'API FilmLight) peut transformer e...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

31/05/2026

Olivia Prez-Collellmir to Premiere Original Work at Gaud Centennial in Barcelona

Olivia P rez-Collellmir to Premiere Original Work at Gaud Centennial in Barcelona The Berklee graduate and faculty member will debut her choral symphony with...

31/05/2026

Netflix Wins 15 Awards at the Canadian Screen Awards - See Photos From Inside Our Photo Suite

Back to All News Netflix Wins 15 Awards at the Canadian Screen Awards - See Pho...

31/05/2026

Taiwan's Industry Titans Turbocharge World's AI Infrastructure Buildout With NVIDIA

Taiwan is home to more than 500 NVIDIA ecosystem partners. More than 1 million N...

31/05/2026

NVIDIA Factory Operations Blueprint Gives Factories a New AI Brain

As factories move from isolated automation to plant-wide intelligence, manufacturers need AI systems that can connect live machine signals, quality systems, wor...

31/05/2026

NVIDIA AI Cloud Ecosystem Expands Worldwide to Meet Global AI Compute Demand

The NVIDIA AI Cloud ecosystem is accelerating the global buildout of AI factory infrastructure. Partners are expanding capacity to meet growing demand from ente...

30/05/2026

NAB Asks FCC to Shift Regulatory Fee Burden to Big Tech, Broadband

Share Copy link Facebook X Linkedin Bluesky Email...

30/05/2026

NAB Announces 2026 Board Election Results

Share Copy link Facebook X Linkedin Bluesky Email...

30/05/2026

IAB Tech Lab Releases Guidance for Managing AI Crawlers and Bots

Share Copy link Facebook X Linkedin Bluesky Email...

30/05/2026

Zero in on one that says yes (and no)

Zero in on one that says yes (and no) Andy Marken May 29, 2026 0 Comments Hero image courtesy of Deposit Photos For content creators the most difficu...

29/05/2026

InfoComm 2026: NDI Demos NDI 6.3, Hands-On Presentation About Educational Integrations

With InfoComm 2026 just weeks away, NDI is giving attendees plenty of reasons to...

29/05/2026

Bell Media Inks New Long-Term Media Rights Deal for Broadcast, Streaming of the Canadian Football League

Reaffirming a partnership that has defined Canadian sports broadcasting since 19...

29/05/2026

Spring 2026 TV Survey: Vertical Live Matters. The Bigger Story Is Context

Mobile/tablet is No. 2 device for watching TV, suggesting that the sports-production industry needs to take another look at the format Ring Digital's Sprin...

29/05/2026

Germanys Berliner Ensemble Bolsters Backstage Infrastructure With Riedel Stage Systems

Berliner Ensemble, one of Berlin's five major theater companies, has expande...

29/05/2026

InfoComm 2026: Solid State Logic Spotlights TCA Tour, Live V6.2 Software, New SSL Live Trade-in Program

Solid State Logic will showcase its new compact, fly-away TCA Tour audio product...

29/05/2026

Gerald Jerry Pierce, Architect of Modern Digital Cinema, Passes Away at Age 73

Gerald (Jerry) Pierce, a pioneering technologist who helped shape the digital transformation of the motion picture industry, passed away last month on April 12 ...

29/05/2026

CBS Sports Becomes New Home of Barclays Women's Super League Thorough 2029-2030

Paramount+ will be the English-language U.S. home for Barclays Women's Super...

29/05/2026

Calrec Scales ImPulseV to Empower Broadcasters With Greater Choice in Virtualized Workflows

Further strengthening its virtualisation strategy to fully support broadcasters ...

29/05/2026

Switzerlands Canal Alpha Streamlines Playout to Delivery With Harmonic

Swiss broadcaster Canal Alpha has deployed Harmonic's award-winning, software-based XOS Advanced Media Processor to modernize playout operations across cant...

29/05/2026

InfoComm 2026: PTZOptics Showcases Intelligent Video Ecosystem

PTZOptics will showcase a new generation of intelligent video workflows at InfoComm 2026, June 17-19, Las Vegas. Visitors to booth N8227 will see how PTZOptics ...

29/05/2026

Arizona's Family Sports Debuts Direct-to-Consumer Streaming App

Arizona's Family has launched the Arizona's Family Sports (AZFS) streaming app, a new direct-to-consumer destination for live, local sports. The app is ...

29/05/2026

DAZN Brings The Canadian Football Leagues Saturday Night Football to the Masses in New Media Rights Deal

Starting in 2027, DAZN will be the exclusive home of The Canadian Football Leagu...

29/05/2026

Comcast Business Supports Advanced Technology Infrastructure at Levi's Stadium for Fan Experience, Venue Operations

Comcast Business has detailed the advanced network infrastructure it has deploye...

29/05/2026

College Sports-Production Community Gathers in Atlanta for 2026 SVG College Summit

In two-day event, leaders from academia and industry explored solutions to chall...

29/05/2026

TBT Reaches Two-Year Extension With FOX Sports for New-Look $2 Million Tournament

The Basketball Tournament (TBT), now entering their 13th year of competition, ha...

29/05/2026

Roku Expands Premium Subscriptions Experience with FOX One

Roku has launched FOX One as a Premium Subscription on The Roku Channel in the U.S. Roku customers can now subscribe to FOX One using their Roku account for liv...