Sony Pixel Power calrec Sony

Inside AI: NVIDIA DRIVE Ecosystem Creates Pioneering In-Cabin Features With NVIDIA DRIVE IX

21/09/2022

As personal transportation becomes electrified and automated, time in the vehicle has begun to resemble that of a living space rather than a mind-numbing commute.

Companies are creating innovative ways for drivers and passengers to make the most of this experience, using the flexibility and modularity of NVIDIA DRIVE IX. In-vehicle technology companies Cerence, Smart Eye, Rightware and DSP Concepts are now using the platform to deliver intelligent features for every vehicle occupant.

These partners are joining a diverse ecosystem of companies developing on DRIVE IX, including Soundhound, Jungo and VisionLabs, providing cutting-edge solutions for any in-vehicle need.

DRIVE IX provides an open software stack for cockpit solution providers to build and deploy features that will turn personal vehicles into interactive environments, enabling intelligent assistants, graphic user interfaces and immersive media and entertainment.

Intelligent Assistants AI isn't just transforming the way people drive, but also how they interact with cars.

Using speech, gestures and advanced graphical user interfaces, passengers can communicate with the vehicle through an AI assistant as naturally as they would with a human.

An intelligent assistant will help to operate vehicle functions more intuitively, warn passengers in critical situations and provide services such as giving local updates like the weather forecast, making reservations and phone calls, and managing calendars.

Conversational AI Interaction Software partner Cerence is enabling AI-powered, voice-based interaction with the Cerence Assistant, its intelligent in-car assistant platform.

Cerence Assistant uses sensor data to serve drivers throughout their daily journeys, notifying them, for example, when fuel or battery levels are low and navigating to the nearest gas or charging station.

It features robust speech recognition, natural language understanding and text-to-speech capabilities, enhancing the driver experience.

Courtesy of Cerence Using DRIVE IX, it can empower both embedded and cloud-based natural language processing on the same architecture, ensuring drivers have access to important capabilities regardless of connectivity.

Cerence Assistant also supports major global markets and related languages, and is customizable for brand-specific speech recognition and personalization.

Gesture Recognition In addition to speech, passengers can interact with AI assistants via gesture, which relies on interior sensing technologies.

Smart Eye is a global leader in AI-based driver monitoring and interior sensing solutions. Its production driver-monitoring system is already in 1 million vehicles on the roads around the world, and will be incorporated in the upcoming Polestar 3, set to be revealed in October.

Working with DRIVE IX, Smart Eye's technology makes it possible to detect eye movements, facial expressions, body posture and gestures, bringing insight into people's behavior, activities and mood.

Courtesy of Smart Eye Using NVIDIA GPU technology, Smart Eye has been able to speed up its cabin-monitoring system - which consists of 10 deep neural networks running in parallel - by more than 10x.

This interior sensing is critical for safety - ensuring driver attention is on the road when it should be and detecting left-behind children or pets - and it customizes and enhances the entire mobility experience for comfort, wellness and entertainment.

Graphical User Interface AI assistants can communicate relevant information easily and clearly with high-resolution graphical interfaces. Using DRIVE IX, Rightware is creating a seamless visual experience across all cockpit and infotainment domains.

Caption: Courtesy of Rightware Rightware's automotive human-machine interface tool Kanzi One helps designers bring amazing real-time 3D graphical user interfaces into the car and hides the underlying operating system and framework complexity. Automakers can completely customize the vehicle's user interface with Kanzi One, providing a brand-specific signature UI.

Enhancing visual user interfaces by audio features is equally important for interacting with the vehicle. The Audio Weaver development platform from DSP Concepts can be integrated into the DRIVE IX advanced sound engine. It provides a sound design toolchain and audio framework to graphically design features.

Courtesy of DSP Concepts. Creators and sound artists can design a car- and brand-specific sound experience without the hassle of writing complex code for low-level audio features from scratch.

Designing in Simulation With NVIDIA DRIVE Sim on Omniverse, developers can integrate, refine and test all these new features in the virtual world before implementing them in vehicles.

Interior sensing companies can build driver- or occupant-monitoring models in the cockpit using the DRIVE Replicator synthetic-data generation tool on DRIVE Sim. Partners providing content for vehicle displays can first develop on a rich, simulated screen configuration.

Access to this virtual vehicle platform can significantly accelerate end-to-end development of intelligent in-vehicle technology.

By combining the flexibility of DRIVE IX with leading in-cabin solutions providers, spending time in the car can become a luxury rather than a chore.
LINK: https://blogs.nvidia.com/blog/2022/09/21/drive-ix-ecosystem/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

01/09/2026

Broadcasters Gain Flexibility in Pursuit of 5G Multicasting

Share Copy link Facebook X Linkedin Bluesky Email...

01/09/2026

Winning the Fight Against Churn

Share Copy link Facebook X Linkedin Bluesky Email...

01/09/2026

How Multiviewers Are Evolving Into Information Hubs'

Share Copy link Facebook X Linkedin Bluesky Email...

01/09/2026

IBC2026: New Audio Tools on Tap from Telos Alliance

Share Copy link Facebook X Linkedin Bluesky Email...

01/09/2026

SMPTE Roadshow to Examine Media Infrastructure at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

01/09/2026

Roku Debuts Its First 4K OLED TVs

Share Copy link Facebook X Linkedin Bluesky Email...

01/09/2026

Mark Vinten Joins ASG's Audio and Postproduction Team

Share Copy link Facebook X Linkedin Bluesky Email...

01/09/2026

Pronology Introduces New StreamFile Core Capabilities at...

Pronology, a developer of cutting-edge broadcast workflow solutions, showcases the newest capabilities for its StreamFile Core platform at the 2026 IBC Show (S...

01/09/2026

PROTON Unveils Next-Generation FLEXY Camera at IBC 2026

PROTON Unveils Next-Generation FLEXY Camera at IBC 2026 Brie Clayton September 1, 2026 0 Comments 10-metre serialised coax unlocks new perspectives an...

01/09/2026

Hulu Drama The Season Graded with DaVinci Resolve Studio

Hulu Drama The Season Graded with DaVinci Resolve Studio Brie Clayton September 1, 2026 0 Comments Senior Colorist Mark Kueper of Picture Shop crafts ...

01/09/2026

Pluxbox Launches CoreOC to Transform Mission-Critical Media Operations

Pluxbox Launches CoreOC to Transform Mission-Critical Media Operations Brie Clayton September 1, 2026 0 Comments A vendor-agnostic operational control l...

01/09/2026

Layercake Appoints Former FOX SPORTS and Network Ten COO...

Layercake, the company behind the intelligent media workflow platform Streamcake, today announced the appointment of Jon Marquard as Director and Chairperson. T...

01/09/2026

Actus Digital Unveils the Future of Broadcast Monitoring...

Actus Digital, a LiveU company, will unveil the next generation of its Actus X platform at IBC2026 on LiveUs Stand 7.C24, demonstrating how broadcasters can sim...

01/09/2026

Studio Automated and Egripment Power the Tactical Feed fo...

Broadcast Solutions, a leading systems integrator and provider of innovative solutions for the broadcast media industry, delivered transformational technology a...

01/09/2026

OTV turns to Quortex to replace legacy video hardware

Quortex, the intelligent video technology company carved out from Synamedia by Lumine Group, today announced that Odisha Television Network (OTV), the leading r...

01/09/2026

Zixi and Ateme Deepen Strategic Alliance to Accelerate Hy...

Zixi and Ateme today announced an expanded strategic partnership to help broadcasters and content owners accelerate the transition from satellite to resilient I...

01/09/2026

CBS Boston Debuts New AR/VR Technology-Driven Studio

Share Copy link Facebook X Linkedin Bluesky Email...

01/09/2026

FCC Raises Regulatory Fees for TV Stations

Share Copy link Facebook X Linkedin Bluesky Email...

01/09/2026

For-A Introduces Go Vertical! AiDi and AiDi Sports Hub

Share Copy link Facebook X Linkedin Bluesky Email...

01/09/2026

T-Mobile Continues to Dominate Ooklas Fixed Wireless Speed Tests

Share Copy link Facebook X Linkedin Bluesky Email...

01/09/2026

Carr Announces New FCC Enforcement Bureau Chief

Share Copy link Facebook X Linkedin Bluesky Email...

01/09/2026

Experience La Dolce Vita with Donal's Italian Kitchen

Join Donal Skehan in discovering the best of everyday Italian cooking in brand new series, airing Wednesday 2 September In this brand-new series, Donal's I...

01/09/2026

RT Supporting the Arts is supporting 28 cultural events nationwide this September

RT Supporting the Arts is delighted to spotlight a diverse range of arts, cultu...

31/08/2026

Pixotope Consolidates Virtual Production Tools into Unified Platform

Pixotope Technologies has announced a unified platform offering all Pixotope capabilities across three editions, available with the Pixotope 26.3 release in Q3 ...

31/08/2026

Elektron update Tonverk OS

Sampler gains Overbridge multitrack streaming Elektron's polyphonic sampler, the Tonverk, has just received an OS update that introduces multitrack stre...

31/08/2026

Thorus XT from UVI

Popular chorus plug-in gains second engine UVI's latest plug-in offers a fresh new take on their best-selling chorus effect, combining a pair of engines...

31/08/2026

Optus commits 3% of consumer brand spend to First Nations media in new landmark partnership with NITV

Optus commits 3% of consumer brand spend to First Nations media in new landmark ...

31/08/2026

FingerWorks Telestrators Expands European Presence Throug...

FingerWorks Telestrators, the industry leader in software-based telestration and live sports analysis solutions, announces its new partnership with Broadcast R...

31/08/2026

ARISDA Bridge Launches: DaVinci Resolve Timecode, Studio Clock, and Work-Time Tracking in One Windows App

ARISDA Bridge Launches: DaVinci Resolve Timecode, Studio Clock, and Work-Time Tr...

31/08/2026

Short Film All That's Left Shot with URSA Cine 12K LF

Short Film All That's Left Shot with URSA Cine 12K LF Brie Clayton August 31, 2026 0 Comments Intimate drama edited and graded in DaVinci Resolve ...

31/08/2026

Bridge Technologies Announces Support for Blackmagic IP10 Codec

Bridge Technologies Announces Support for Blackmagic IP10 Codec Brie Clayton August 31, 2026 0 Comments Both booths will showcase each other's tec...

31/08/2026

Creative COW Roundtable, August 23, 2026- AEAI

Creative COW Roundtable, August 23, 2026- AEAI Brie Clayton August 31, 2026 0 Comments COWs from around the world assemble to discuss Using AI to Beat...

31/08/2026

Homecoming Artist Spotlight: Susan Tedeschi

Homecoming Artist Spotlight: Susan Tedeschi The Grammy-winning singer and guitarist talks about finding her voice at Berklee ahead of her Homecoming performan...

31/08/2026

HC2 Meets with FCC Legal Advisor in Push for 5G Broadcasting

Share Copy link Facebook X Linkedin Bluesky Email...

31/08/2026

Tribeca Studios Releases First-Look Trailer For Tribeca 25, The New Documentary From Matt Tyrnauer

August 31st, 2026 Press Materials Here TRIBECA STUDIOS RELEASES FIRST-LOOK TRA...

31/08/2026

Digicel Pacific Selects Techtel for PNG Digital TV Head-End Transformation

Digicel Pacific Selects Techtel for PNG Digital TV Head-End Transformation 31 Aug Written By Mal Chandler Sydney, 31 August 2026 - Techtel has been appointe...

30/08/2026

Reason Studios launch Reason Free

Free collection includes 15 instruments Reason Studios have announced that they are making their popular Reason Rack plug-in free, and bundling it with a se...

29/08/2026

SSL to introduce O-Series V2.0

Odyssey & Oracle console software update incoming With a second console now joining their O-Series, SSL have announced the upcoming launch of O-Series V2.0,...

29/08/2026

Scripps Hires NBCU Sales Veteran Jen Carfley

Share Copy link Facebook X Linkedin Bluesky Email...

29/08/2026

Comcast's Universal Ads Taps Tracer to Upgrade Operations

Share Copy link Facebook X Linkedin Bluesky Email...

29/08/2026

PlayBox Technology to Showcase the Future of Media Orches...

PlayBox Technology is heading to IBC2026 with a clear message: the future of broadcast and streaming is not about replacing everything it is about making what...

29/08/2026

Berklee Announces Fall 2026 Signature Series

Berklee Announces Fall 2026 Signature Series This years concerts feature MonoNeon, Brandon Woody, Marcus Gilmore, and Caroline Davis, alongside Berklee Asia R...

28/08/2026

CBS L.A. Runs Two Hot Control Rooms, Dual Broadcasts for Rams-Chargers Preseason Game

KCBS takes the Chargers side, KCAL takes the Rams - with feeds out to 18 partner...

28/08/2026

Buddy Turns Childhood Comfort into Midnight Terror

(L-R) Topher Grace, Cristin Milioti, Delaney Quinn, Casper Kelly, and Keegan-Michael Key pose with the character Buddy at the Buddy Premiere during the 2026 S...

28/08/2026

IK Multimedia announce Sinphonica Maestosa Strings

The Italian orchestra, reimagined IK Multimedia have announced the upcoming launch of Sinphonica, a new family of Italian orchestral instruments designed f...

28/08/2026

Voxis from CEDAR Audio

Voice-isolation plug-in boasts sub-10ms latency Launched in 2025, CEDAR Audio's Icons range was created with the aim of bringing the company's renow...

28/08/2026

Charter Takes Scripps to Court Over Carriage of Las Vegas' KMCC

Share Copy link Facebook X Linkedin Bluesky Email...