Sony Pixel Power calrec Sony

Inside AI: NVIDIA DRIVE Ecosystem Creates Pioneering In-Cabin Features With NVIDIA DRIVE IX

21/09/2022

As personal transportation becomes electrified and automated, time in the vehicle has begun to resemble that of a living space rather than a mind-numbing commute.

Companies are creating innovative ways for drivers and passengers to make the most of this experience, using the flexibility and modularity of NVIDIA DRIVE IX. In-vehicle technology companies Cerence, Smart Eye, Rightware and DSP Concepts are now using the platform to deliver intelligent features for every vehicle occupant.

These partners are joining a diverse ecosystem of companies developing on DRIVE IX, including Soundhound, Jungo and VisionLabs, providing cutting-edge solutions for any in-vehicle need.

DRIVE IX provides an open software stack for cockpit solution providers to build and deploy features that will turn personal vehicles into interactive environments, enabling intelligent assistants, graphic user interfaces and immersive media and entertainment.

Intelligent Assistants AI isn't just transforming the way people drive, but also how they interact with cars.

Using speech, gestures and advanced graphical user interfaces, passengers can communicate with the vehicle through an AI assistant as naturally as they would with a human.

An intelligent assistant will help to operate vehicle functions more intuitively, warn passengers in critical situations and provide services such as giving local updates like the weather forecast, making reservations and phone calls, and managing calendars.

Conversational AI Interaction Software partner Cerence is enabling AI-powered, voice-based interaction with the Cerence Assistant, its intelligent in-car assistant platform.

Cerence Assistant uses sensor data to serve drivers throughout their daily journeys, notifying them, for example, when fuel or battery levels are low and navigating to the nearest gas or charging station.

It features robust speech recognition, natural language understanding and text-to-speech capabilities, enhancing the driver experience.

Courtesy of Cerence Using DRIVE IX, it can empower both embedded and cloud-based natural language processing on the same architecture, ensuring drivers have access to important capabilities regardless of connectivity.

Cerence Assistant also supports major global markets and related languages, and is customizable for brand-specific speech recognition and personalization.

Gesture Recognition In addition to speech, passengers can interact with AI assistants via gesture, which relies on interior sensing technologies.

Smart Eye is a global leader in AI-based driver monitoring and interior sensing solutions. Its production driver-monitoring system is already in 1 million vehicles on the roads around the world, and will be incorporated in the upcoming Polestar 3, set to be revealed in October.

Working with DRIVE IX, Smart Eye's technology makes it possible to detect eye movements, facial expressions, body posture and gestures, bringing insight into people's behavior, activities and mood.

Courtesy of Smart Eye Using NVIDIA GPU technology, Smart Eye has been able to speed up its cabin-monitoring system - which consists of 10 deep neural networks running in parallel - by more than 10x.

This interior sensing is critical for safety - ensuring driver attention is on the road when it should be and detecting left-behind children or pets - and it customizes and enhances the entire mobility experience for comfort, wellness and entertainment.

Graphical User Interface AI assistants can communicate relevant information easily and clearly with high-resolution graphical interfaces. Using DRIVE IX, Rightware is creating a seamless visual experience across all cockpit and infotainment domains.

Caption: Courtesy of Rightware Rightware's automotive human-machine interface tool Kanzi One helps designers bring amazing real-time 3D graphical user interfaces into the car and hides the underlying operating system and framework complexity. Automakers can completely customize the vehicle's user interface with Kanzi One, providing a brand-specific signature UI.

Enhancing visual user interfaces by audio features is equally important for interacting with the vehicle. The Audio Weaver development platform from DSP Concepts can be integrated into the DRIVE IX advanced sound engine. It provides a sound design toolchain and audio framework to graphically design features.

Courtesy of DSP Concepts. Creators and sound artists can design a car- and brand-specific sound experience without the hassle of writing complex code for low-level audio features from scratch.

Designing in Simulation With NVIDIA DRIVE Sim on Omniverse, developers can integrate, refine and test all these new features in the virtual world before implementing them in vehicles.

Interior sensing companies can build driver- or occupant-monitoring models in the cockpit using the DRIVE Replicator synthetic-data generation tool on DRIVE Sim. Partners providing content for vehicle displays can first develop on a rich, simulated screen configuration.

Access to this virtual vehicle platform can significantly accelerate end-to-end development of intelligent in-vehicle technology.

By combining the flexibility of DRIVE IX with leading in-cabin solutions providers, spending time in the car can become a luxury rather than a chore.
LINK: https://blogs.nvidia.com/blog/2022/09/21/drive-ix-ecosystem/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

27/08/2026

Boland Debuts ST 2110 Option for its 4K HDR Monitors

Share Copy link Facebook X Linkedin Bluesky Email...

27/08/2026

Adele Hixon-Day Joins C-SPAN as Chief Development Officer

Share Copy link Facebook X Linkedin Bluesky Email...

27/08/2026

Profuz Digital presents intelligent AI workflow orchestra...

Profuz Digital makes a mark by launching a powerful upgrade to its Profuz LAPIS digital media management platform this IBC in Amsterdam at Stand 8.A88. The late...

27/08/2026

DHD to Introduce its Third-Generation Audio Mixing Consol...

DHD.audio has chosen IBC 2026 as the launch venue for what it defines as one of the most radical advances in the companys 30 year history. Every broadcast trad...

27/08/2026

FOR-A integrates with CuePilot for dynamic automated prod...

Direct connectivity between planning, production and graphics for creativity and streamlined workflows...

27/08/2026

New Photoshop innovations bring you more choice and control at every stage of your creative process

New Photoshop innovations bring you more choice and control at every stage of yo...

27/08/2026

First Two Seasons of Vertical Series Vultures Shot on Blackmagic Design Cameras

First Two Seasons of Vertical Series Vultures Shot on Blackmagic Design Cameras Brie Clayton August 27, 2026 0 Comments Director and DoP of Vultures ...

27/08/2026

3Play Media data shows audiences are embracing AI dubbing

For years, the media and entertainment industry has hesitated to use AI-voiced dubbing due to concern for audience experience. New data from 3Play Media, a glob...

27/08/2026

Starfish adds voice synthesis support to Advantage AD in...

Starfish Technologies has announced the forthcoming V9 release of its Advantage AD workstation, adding support for voice synthesis services and giving Audio Des...

27/08/2026

Lightware UBEX Helps Rental Teams Deploy Faster And Saf...

Lightware's UBEX is a powerful AV-over-IP product well suited for rental and staging workflows where systems must be fast to deploy, easy to repurpose, and ...

27/08/2026

Lightware extends TPN platform to 100 endpoints with TPN-...

Lightware has expanded the scalability of its 10G TPN AV-over-IP platform with the introduction of the new TPN-MMU-X100 Matrix Management Unit, enabling systems...

27/08/2026

Federal Appeals Court Blocks Some FCC Political Ad Discount Rules

Share Copy link Facebook X Linkedin Bluesky Email...

27/08/2026

Zixi To Demo Hybrid Workflows At IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

27/08/2026

Study: Americans Spend More Time Watching YouTube Than Live TV

Share Copy link Facebook X Linkedin Bluesky Email...

27/08/2026

Magewell To Highlight Newly Released Director Plus At IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

27/08/2026

PlayBox Neo continues to shape the media landscape by ini...

PlayBox Neo Stand 7.C29 IBC2026 - 11 14 September Well-established global specialists in media playout, automation, and streaming solutions, PlayBox Neo ...

27/08/2026

Rise Academy Invites the Industry to Join Race 4 The Futu...

Rise Academy, the broadcast and media skills charity dedicated to delivering practical media technology learning experiences, careers resources and work experie...

27/08/2026

Mediagenix Takes Title Management Beyond the Catalog at I...

Mediagenix, a global leader in smart content solutions to profitably connect the right content to the right audience, will showcase the latest evolution of its ...

27/08/2026

Screen Australia opens applications for Global Fellowships Program

Screen Australia opens applications for Global Fellowships Program 27 August 2026 Applications are now open for the Screen Australia Global Fellowships progra...

27/08/2026

New RT KIDS short film explores friendship, courage and community

Commissioned for RT KIDS as part of the EBU Kids' Drama Exchange The Note will premiere Sunday August 30, 5:10pm RT One and RT Player The Note tells a...

27/08/2026

Dolby Laboratories Announces Leadership Transition

August 27 2026, 06:00 (PDT) Dolby Laboratories Announces Leadership Transition Kevin Yeaman to Retire from Dolby Marc Whitten Named President, Chief Exe...

27/08/2026

GeForce NOW Gives Gamers More Ways to Play at Gamescom 2026

NVIDIA's Gamescom announcements are revealing what's next for GeForce NOW, with new ways to play, more supported devices and platforms, and even more bi...

26/08/2026

New Validation Booster FAQ: What applicants need to know

Applicants interested in the Media Innovation Europe 3.0 Validation Booster call can now consult a new FAQ document addressing practical questions raised during...

26/08/2026

NWSL Moves Sunday Night Package to Roku, Expands Slate to 25 Matches in 2027

Roku Sports Channel will stream eight matches free beginning Aug. 30 as league shifts Sunday-night games away from Victory+...

26/08/2026

Inside Mountain Media Center's Hybrid-Cloud Architecture for Live Event Production

Evertz and Mobile TV Group detail how on-premises infrastructure and cloud resou...

26/08/2026

IBC 2026: Sennheiser Group to Showcase Broadcast Audio Portfolio

The Sennheiser Group will demonstrate its broadcast audio portfolio at IBC2026 (Hall 8, Booth D50), covering wireless microphone workflows, studio monitoring, a...

26/08/2026

Appear and TVTEL Deploy X20 Platform for Centralized VAR Signal Transport in Chile

Appear and Transmisiones Televisivas TVTEL Limitada have announced the deploymen...

26/08/2026

Minitech Adds Leader LPX500 and LT4670 to Rental Inventory

Leader Electronics has announced that Danish broadcast rental company Minitech has purchased a Leader LPX500 hybrid IP/SDI waveform monitor and LT4670 sync puls...

26/08/2026

IBC 2026: Encompass to Showcase Cloud Media Services

Encompass will demonstrate its Altitude media services at IBC2026 (IAMT Hub, Diamond Lounge, Hall 3, RAI Amsterdam, September 11-14). Key products on show incl...

26/08/2026

Massillon Washington High School First to Implement Daktronics Camino Platform

Daktronics has partnered with Massillon Washington High School in Ohio to install a new LED video display and implement the Daktronics Camino show control platf...

26/08/2026

Clear-Com Appoints Venuetech as Middle East Partner

Clear-Com has appointed Dubai-based Venuetech LLC as its main partner for the Middle East. Venuetech distributes professional audiovisual solutions across the r...

26/08/2026

NBC Sports NOW Debuts Two New Shows Beginning August 31

NBC Sports NOW, NBC Sports' free 24/7 streaming channel, will launch a new weekday lineup beginning Monday, August 31, including two new shows. Not So Fast...

26/08/2026

IBC 2026: Calrec to Preview ImPulseV and Argo Updates

Calrec will demonstrate updates to its ImPulseV DSP software and Argo ecosystem at IBC2026 (Stand 8.C47), including previews aligned with the EBU's Dynamic ...

26/08/2026

IBC 2026: Imagine Communications to Showcase AI Capabilities

Imagine Communications will demonstrate AI applications across its ad tech and video infrastructure portfolios at IBC2026 (Stand 1.B73, RAI Amsterdam, September...

26/08/2026

IBC 2026: Dalet to Showcase AI and Workflow Automation

Dalet will demonstrate updates to Dalet Flex, Dalet Pyramid, and Dalia, its agentic AI platform, at IBC2026 (Hall 7, Stand 7.A43). The company will also partici...

26/08/2026

Nashville Predators Tap ViewLift for New DTC Service, Pairing Streaming With Scripps Sports Broadcast Deal

Team-owned platform will stream every locally carried Predators game beginning t...

26/08/2026

Little League Baseball World Series 2026: ESPN Restores RailCam Coverage at Lamade Stadium, Upscales Cameras at Volunteer Stadium

The 12-day tournament receives the broadcaster's full onsite-studio presence...

26/08/2026

SOMA Laboratory launch the Enigma

A synth with no controls? If you're into weird and wonderful instruments, then you may already be familiar with Warsaw-based SOMA Laboratory - if you...

26/08/2026

Dreamtonics unveil Instrument X

Physical modelling orchestral instrument announced Following their recent cryptic hints, Dreamtonics have officially revealed the latest addition to their s...

26/08/2026

Bertram Brossardt visits SGL Carbon in Meitingen

Discussions at the Meitingen site on competitiveness, energy supply, and fuel cell technology Bertram Brossardt, CEO of the Bavarian metal and electrical emplo...

26/08/2026

Rohde & Schwarz USA celebrates grand opening of new manufacturing center in Frederick, Maryland

Rohde & Schwarz USA celebrates grand opening of new manufacturing center in Fred...

26/08/2026

Designing Agentic Media Workflows Humans Can Trust

For large media companies, the content archive is a gold mine. There are thousands of hours of existing, high-value assets just waiting to be tapped for highlig...

26/08/2026

Major Live Sports Events Bolster Broadcast in Nielsen's Q2 2026 Ad Supported Gauge

Ad Supported Viewing Represents 71.5% of TV in Q2 Streaming Captures Over 48% o...

26/08/2026

DAZN Accelerates U.S. Expansion with Acquisition of EverPass Media

Share Copy link Facebook X Linkedin Bluesky Email...

26/08/2026

Truthset Brings Data Rated Audiences to FreeWheel

Share Copy link Facebook X Linkedin Bluesky Email...

26/08/2026

Broadpeak Targets CTV Shopping with Click2Cart Launch

Share Copy link Facebook X Linkedin Bluesky Email...