Sony Pixel Power calrec Sony

Inside AI: NVIDIA DRIVE Ecosystem Creates Pioneering In-Cabin Features With NVIDIA DRIVE IX

21/09/2022

As personal transportation becomes electrified and automated, time in the vehicle has begun to resemble that of a living space rather than a mind-numbing commute.

Companies are creating innovative ways for drivers and passengers to make the most of this experience, using the flexibility and modularity of NVIDIA DRIVE IX. In-vehicle technology companies Cerence, Smart Eye, Rightware and DSP Concepts are now using the platform to deliver intelligent features for every vehicle occupant.

These partners are joining a diverse ecosystem of companies developing on DRIVE IX, including Soundhound, Jungo and VisionLabs, providing cutting-edge solutions for any in-vehicle need.

DRIVE IX provides an open software stack for cockpit solution providers to build and deploy features that will turn personal vehicles into interactive environments, enabling intelligent assistants, graphic user interfaces and immersive media and entertainment.

Intelligent Assistants AI isn't just transforming the way people drive, but also how they interact with cars.

Using speech, gestures and advanced graphical user interfaces, passengers can communicate with the vehicle through an AI assistant as naturally as they would with a human.

An intelligent assistant will help to operate vehicle functions more intuitively, warn passengers in critical situations and provide services such as giving local updates like the weather forecast, making reservations and phone calls, and managing calendars.

Conversational AI Interaction Software partner Cerence is enabling AI-powered, voice-based interaction with the Cerence Assistant, its intelligent in-car assistant platform.

Cerence Assistant uses sensor data to serve drivers throughout their daily journeys, notifying them, for example, when fuel or battery levels are low and navigating to the nearest gas or charging station.

It features robust speech recognition, natural language understanding and text-to-speech capabilities, enhancing the driver experience.

Courtesy of Cerence Using DRIVE IX, it can empower both embedded and cloud-based natural language processing on the same architecture, ensuring drivers have access to important capabilities regardless of connectivity.

Cerence Assistant also supports major global markets and related languages, and is customizable for brand-specific speech recognition and personalization.

Gesture Recognition In addition to speech, passengers can interact with AI assistants via gesture, which relies on interior sensing technologies.

Smart Eye is a global leader in AI-based driver monitoring and interior sensing solutions. Its production driver-monitoring system is already in 1 million vehicles on the roads around the world, and will be incorporated in the upcoming Polestar 3, set to be revealed in October.

Working with DRIVE IX, Smart Eye's technology makes it possible to detect eye movements, facial expressions, body posture and gestures, bringing insight into people's behavior, activities and mood.

Courtesy of Smart Eye Using NVIDIA GPU technology, Smart Eye has been able to speed up its cabin-monitoring system - which consists of 10 deep neural networks running in parallel - by more than 10x.

This interior sensing is critical for safety - ensuring driver attention is on the road when it should be and detecting left-behind children or pets - and it customizes and enhances the entire mobility experience for comfort, wellness and entertainment.

Graphical User Interface AI assistants can communicate relevant information easily and clearly with high-resolution graphical interfaces. Using DRIVE IX, Rightware is creating a seamless visual experience across all cockpit and infotainment domains.

Caption: Courtesy of Rightware Rightware's automotive human-machine interface tool Kanzi One helps designers bring amazing real-time 3D graphical user interfaces into the car and hides the underlying operating system and framework complexity. Automakers can completely customize the vehicle's user interface with Kanzi One, providing a brand-specific signature UI.

Enhancing visual user interfaces by audio features is equally important for interacting with the vehicle. The Audio Weaver development platform from DSP Concepts can be integrated into the DRIVE IX advanced sound engine. It provides a sound design toolchain and audio framework to graphically design features.

Courtesy of DSP Concepts. Creators and sound artists can design a car- and brand-specific sound experience without the hassle of writing complex code for low-level audio features from scratch.

Designing in Simulation With NVIDIA DRIVE Sim on Omniverse, developers can integrate, refine and test all these new features in the virtual world before implementing them in vehicles.

Interior sensing companies can build driver- or occupant-monitoring models in the cockpit using the DRIVE Replicator synthetic-data generation tool on DRIVE Sim. Partners providing content for vehicle displays can first develop on a rich, simulated screen configuration.

Access to this virtual vehicle platform can significantly accelerate end-to-end development of intelligent in-vehicle technology.

By combining the flexibility of DRIVE IX with leading in-cabin solutions providers, spending time in the car can become a luxury rather than a chore.
LINK: https://blogs.nvidia.com/blog/2022/09/21/drive-ix-ecosystem/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

09/04/2026

Hearst Taps Merzigo to Expand Presence on YouTube, Facebook

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

Fox Jumps Into Prediction Markets with Kalshi Integration

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

NAB Show: Kokusai Denki To Feature New, Affordable 4K Broadcast Camera

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

Corus Taps Appear for IP-First Operations

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

2026 NAB Show Exhibitor Insights: Big Blue Marble

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

FCC Extends Audible Crawl Rule Waiver for 18 Months

Share Copy link Facebook X Linkedin Bluesky Email...

09/04/2026

Pliant Technologies Showcases Expanded Accessories at NAB...

New Charging, Connectivity, and Mounting Solutions Now Available LAS VEGAS, APRIL 8, 2026 Pliant Technologies will highlight a range of new accessories at th...

09/04/2026

Media Links Brings Ultra Resilient IP Transport Proven at...

As live production continues its shift to IP, the challenge is no longer adoption it's reliability. At NAB Show 2026 (Booth W2033), Media Links will demon...

09/04/2026

QuickLink Launches StudioPro Town Hall at 2026 NAB Show

QuickLink, a leading provider of award-winning video production and remote guest contribution solutions, launches its new AI-powered add-on for its StudioPro p...

09/04/2026

The Hive Group Releases White Paper on the FCC Upper C-Ba...

The Hive Group has published a new white paper, No Safe Harbor: Why the FCC's Upper C-Band Auction Demands Early Action from Broadcasters ahead of NAB Sho...

09/04/2026

Saranyu Technologies Renews VisualOn Optimizer VoD Subscr...

Saranyu Technologies today announced the renewal of its Optimizer VoD subscription with VisualOn. The announcement coincides with NAB Show 2026, taking place Ap...

09/04/2026

April 08, 2026

New technique for synthesizing branched molecules could accelerate the development of future medicines Scripps Research chemists solve a longstanding problem in...

08/04/2026

SVG College Sports Media Awards 2026: Entry Deadline is Monday, April 13

The deadline to enter the 18th Annual SVG College Sports Media Awards in association with NACDA is rapidly approaching! Submit your entries to this year's c...

08/04/2026

SVG Campus Shot Callers: Trever Sheets, Senior Director, ACC Network, Virginia Tech

The Pittsburgh product helps lead more than 100 annual ESPN broadcasts as part o...

08/04/2026

SVG Sit-Down: Harmonic's Jean Macher on Turning Live Sports Content Into a Smarter Monetization Engine

Dynamic ad insertion, AI-based technologies, programmatic advertising are some o...

08/04/2026

Announcing the 2026 Fellows for the Sundance Institute Cultural Impact Residency on Sundance Collab

Seven Fellows Selected for Second Year of Residency in Honor of Social Justice L...

08/04/2026

From Tokyo to the World: Watch Bad Bunny's Billions Club Live Concert on Spotify

On March 7, Bad Bunny made history with his first-ever performance in Asia, taki...

08/04/2026

De Tokio para el mundo: Mira el concierto Billions Club Live de Bad Bunny en Spotify

El 7 de marzo, Bad Bunny hizo historia con su primera presentaci n en Asia, subi...

08/04/2026

Tube Lab from Fuse Audio Labs

New channel strip plug-in revealed The latest plug-in to be added to the Fuse Audio Labs line-up emulates a selection of vintage hardware units, combining c...

08/04/2026

Blue Cat Audio release Axiom 2.3

Guitar & bass multi-effects software overhauled Blue Cat Audio's flagship guitar and bass multi-effects software has recently received a significant upd...

08/04/2026

Merging Technologies launch Pyramix 16

PanNoir mixer integration, Dolby Atmos Renderer & more Merging Technologies have just launched Pyramix 16, the latest major update to their renowned DAW sof...

08/04/2026

Updating QUARTZ Router Module Firmware Over-The-Air

Applicable Products Part number Description QUARTZ-22-LTE (EU) Dual Port Dual SIM LTE Router (EU) QUARTZ-COMPACT-11-LTE (EU) Single Port Compact LTE ...

08/04/2026

YEP September 2025 Newsletter (2)

The September 19, 2025 YEP Newsletter highlights a group visit to the Academy Museum of Motion Pictures, where participants explored exhibits showcasing the art...

08/04/2026

Proven On Orbit: L3Harris Congratulates Missile Defense Agency for Receiving Top Defense Honor for HBTSS

The L3Harris HBTSS satellite is proven on orbit, successfully demonstrating trac...

08/04/2026

From Earth to Mars: Resilient Communications Powering the Space Economy

Image Credit: NASA. Artist rendering of a space communications satellite in orbit, representative of the resilient, multiband infrastructure supporting mission ...

08/04/2026

Precision in Practice: Flight Test Confirms Key Air-to-Air Capabilities

Latest evaluation validates image quality, Inertial Navigation System performance and long-range tracking in operational flight conditions....

08/04/2026

Gen Alpha Leads Shift to AI-Powered Entertainment Search, Discovery and Recommendations

New Gracenote study finds behavioral change well underway, but trust in AI-gener...

08/04/2026

Media Links to Focus on IP Transport Solutions at 2026 NAB Show

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Telestream and Mimir Integration Facilitates Real-Time Pr...

Integration eliminates ingest bottlenecks by ensuring content is immediately usable across cloud and hybrid editorial workflows. See it at NAB 2026. Nevada Cit...

08/04/2026

Dalet Announces Commercial Availability of Dalia Bringing...

Dalet, a leading technology and service provider for media-rich organizations, today announced the commercial availability of Dalia, its media-aware, agentic AI...

08/04/2026

Synamedia unveils Senza Ignite to transform deployed devi...

Leading video software provider Synamedia today announced Senza Ignite, a cloud-based platform that transforms existing connected devices through a single firmw...

08/04/2026

Appear works with Corus to transform national news contri...

Modernised architecture increases operational control and agility, while reducing cost and simplifying nationwide media transport across affiliates and news bur...

08/04/2026

LynTec to Showcase High Density Power Control Solutions f...

Company to Feature DMX Dual Relay, High-Density 48-Channel Relay Panels, and New Private Label Power Program LynTec, a leading manufacturer of innovative ele...

08/04/2026

BCE integrates BCNEXXT Vipe to power cloud playout in Med...

Broadcasting Center Europe (BCE), a European media technology and services partner, today announces a technology partnership with BCNEXXT, a Netherlands-based c...

08/04/2026

Encompass Strengthens Global Media Operations with Expans...

Encompass Digital Media today announced the expansion of its Master Control Room (MCR) facility in Riga, Latvia, establishing it as one of the most advanced and...

08/04/2026

Synamedia lights up Las Vegas with innovations that will...

Leading video solutions provider Synamedia is back at The 2026 NAB Show with innovations that connect tomorrows audiences today. On display will be a range of t...

08/04/2026

COW Jobs: Director Needed for WWII Indie Docudrama

COW Jobs: Director Needed for WWII Indie Docudrama Brie Clayton April 8, 2026 0 Comments Director Needed for WWII Indie Docudrama March 17, 2026COW ...

08/04/2026

ESPN Expands Global Reach on Disney+

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Broadcast Industry Initiatives Promise To Speed Adoption of ST 2110

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Remembering Television's Role in the U.S. Bicentennial

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Synamedia Unveils AI by Quortex

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Carrie Healey Joins NAB as Vice President of Communications

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Amagi Launches Newspulse

Share Copy link Facebook X Linkedin Bluesky Email...

08/04/2026

Marshall Electronics Unveils CV376 NDI HX3 HDMI POV Camer...

Marshall Electronics introduces its latest POV camera with the new CV376 Compact NDI |HX3 HDMI POV Camera at NAB 2026 (Booth C8339). Designed for versatile 4K c...