Sony Pixel Power calrec Sony

Inside AI: NVIDIA DRIVE Ecosystem Creates Pioneering In-Cabin Features With NVIDIA DRIVE IX

21/09/2022

As personal transportation becomes electrified and automated, time in the vehicle has begun to resemble that of a living space rather than a mind-numbing commute.

Companies are creating innovative ways for drivers and passengers to make the most of this experience, using the flexibility and modularity of NVIDIA DRIVE IX. In-vehicle technology companies Cerence, Smart Eye, Rightware and DSP Concepts are now using the platform to deliver intelligent features for every vehicle occupant.

These partners are joining a diverse ecosystem of companies developing on DRIVE IX, including Soundhound, Jungo and VisionLabs, providing cutting-edge solutions for any in-vehicle need.

DRIVE IX provides an open software stack for cockpit solution providers to build and deploy features that will turn personal vehicles into interactive environments, enabling intelligent assistants, graphic user interfaces and immersive media and entertainment.

Intelligent Assistants AI isn't just transforming the way people drive, but also how they interact with cars.

Using speech, gestures and advanced graphical user interfaces, passengers can communicate with the vehicle through an AI assistant as naturally as they would with a human.

An intelligent assistant will help to operate vehicle functions more intuitively, warn passengers in critical situations and provide services such as giving local updates like the weather forecast, making reservations and phone calls, and managing calendars.

Conversational AI Interaction Software partner Cerence is enabling AI-powered, voice-based interaction with the Cerence Assistant, its intelligent in-car assistant platform.

Cerence Assistant uses sensor data to serve drivers throughout their daily journeys, notifying them, for example, when fuel or battery levels are low and navigating to the nearest gas or charging station.

It features robust speech recognition, natural language understanding and text-to-speech capabilities, enhancing the driver experience.

Courtesy of Cerence Using DRIVE IX, it can empower both embedded and cloud-based natural language processing on the same architecture, ensuring drivers have access to important capabilities regardless of connectivity.

Cerence Assistant also supports major global markets and related languages, and is customizable for brand-specific speech recognition and personalization.

Gesture Recognition In addition to speech, passengers can interact with AI assistants via gesture, which relies on interior sensing technologies.

Smart Eye is a global leader in AI-based driver monitoring and interior sensing solutions. Its production driver-monitoring system is already in 1 million vehicles on the roads around the world, and will be incorporated in the upcoming Polestar 3, set to be revealed in October.

Working with DRIVE IX, Smart Eye's technology makes it possible to detect eye movements, facial expressions, body posture and gestures, bringing insight into people's behavior, activities and mood.

Courtesy of Smart Eye Using NVIDIA GPU technology, Smart Eye has been able to speed up its cabin-monitoring system - which consists of 10 deep neural networks running in parallel - by more than 10x.

This interior sensing is critical for safety - ensuring driver attention is on the road when it should be and detecting left-behind children or pets - and it customizes and enhances the entire mobility experience for comfort, wellness and entertainment.

Graphical User Interface AI assistants can communicate relevant information easily and clearly with high-resolution graphical interfaces. Using DRIVE IX, Rightware is creating a seamless visual experience across all cockpit and infotainment domains.

Caption: Courtesy of Rightware Rightware's automotive human-machine interface tool Kanzi One helps designers bring amazing real-time 3D graphical user interfaces into the car and hides the underlying operating system and framework complexity. Automakers can completely customize the vehicle's user interface with Kanzi One, providing a brand-specific signature UI.

Enhancing visual user interfaces by audio features is equally important for interacting with the vehicle. The Audio Weaver development platform from DSP Concepts can be integrated into the DRIVE IX advanced sound engine. It provides a sound design toolchain and audio framework to graphically design features.

Courtesy of DSP Concepts. Creators and sound artists can design a car- and brand-specific sound experience without the hassle of writing complex code for low-level audio features from scratch.

Designing in Simulation With NVIDIA DRIVE Sim on Omniverse, developers can integrate, refine and test all these new features in the virtual world before implementing them in vehicles.

Interior sensing companies can build driver- or occupant-monitoring models in the cockpit using the DRIVE Replicator synthetic-data generation tool on DRIVE Sim. Partners providing content for vehicle displays can first develop on a rich, simulated screen configuration.

Access to this virtual vehicle platform can significantly accelerate end-to-end development of intelligent in-vehicle technology.

By combining the flexibility of DRIVE IX with leading in-cabin solutions providers, spending time in the car can become a luxury rather than a chore.
LINK: https://blogs.nvidia.com/blog/2022/09/21/drive-ix-ecosystem/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

02/05/2026

Dalet Flex LTS Delivers Smarter Search, Faster Editing, and an AI-Ready Foundation for Modern Media

Dalet, a leading technology and service provider for media-rich organizations, t...

01/05/2026

NBCUniversal's Peacock to Be First Streamer to Integrate Dolby's Full Suite of Premium Picture and Sound Innovations

January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...

01/04/2026

DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION

January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION Douyin Users Can Now Create And Share Videos With Stun...

05/03/2026

The Next Frontier of Quality Control - Verifying Content...

Quality control (QC) has long been a gatekeeper of technical fidelity. Editors and technicians have adhered to a simple, disciplined checklist: bitrate, resolut...

05/03/2026

Synamedia and Asport deliver global-scale streaming for G...

Leading video software provider Synamedia today announced it has partnered with Swiss sports technology specialist, Asport to deliver global live streaming for ...

05/03/2026

Advanced Systems Group Promotes Gretchen Taipale to Vice...

Advanced Systems Group, LLC (ASG), a technology and services provider for media creatives and content owners, announced the promotion of Gretchen Taipale to Vic...

05/03/2026

Clear-Com Supplies Cloud-Based Communications System for...

Clear-Com has provided Gen-IC virtual intercom, its cloud-based voice communications system for SaxaVord Spaceport, the first fully licensed vertical launch s...

05/03/2026

Hollywood Professional Association Concludes the 2026 HPA...

The Hollywood Professional Association (HPA) concluded the 2026 HPA Tech Retreat, convening more than 800 industry leaders, technologists, creatives and executi...

05/03/2026

LynTec 20 AMP Dual Output DMX Relay Now Shipping

LynTec, a leading manufacturer of electrical power control solutions for professional audio, video, and lighting systems, today announced that its new Dual DMX ...

05/03/2026

Snicket Labs Partners with ES Broadcast to Expand Access...

Snicket Labs is pleased to announce a new distribution partnership with ES Broadcast for its award winning solutions, Match and Enrich. Under the agreement, ES...

05/03/2026

LiveU Marks First Large Scale Global Deployment of AI Dri...

LiveU today announced the first large-scale deployment of its AI-driven LiveU IQ (LIQ ) technology at a global, multi-venue sporting event, setting a new benchm...

05/03/2026

Comscore and Yahoo DSP Partner to Advance CTV Political Advertising with Proximic Political Audiences

Comscore and Yahoo DSP Partner to Advance CTV Political Advertising with Proximi...

05/03/2026

March Into the Cloud With 15 New Games Coming to GeForce NOW

March is in full bloom, and that means a fresh wave of games heading to the cloud. 15 new titles are joining the GeForce NOW library this month. Leading the Ma...

04/03/2026

Lega Basket Serie A Modernizes Media Operations Across Italian Basketball with ScorePlay

Lega Basket Serie A (LBA), the governing body for Italy's premier basketball...

04/03/2026

To Mark Five Years at Wrexham AFC, Co-Chairmen Rob Mac and Ryan Reynolds Will Host Broadcast During Wrexham-Swansea City on March 13

Wrexham AFC co-chairmen Rob Mac and Ryan Reynolds will host a first-of-its-kind ...

04/03/2026

FOX Sports Marks 100 Days to FIFA World Cup 2026 with Company-Wide Celebration

The countdown is underway and with just 100 days to go until the world's greatest sporting event begins on Thurs., June 11, FOX Sports, America's Englis...

04/03/2026

Exchange, NBCUniversal Team Up to Provide Service Members with Free Streaming of Paralympic Winter Games

No matter where they are in the world, service members and veterans can stream N...

04/03/2026

Telemundo Releases Somos Ms, the Official Anthem of its FIFA World Cup 2026 Coverage

Telemundo officially releases Somos M s, the anthem for the network's cove...

04/03/2026

Hollywood Professional Association Concludes 2026 HPA Tech Retreat

The Hollywood Professional Association (HPA) concluded the 2026 HPA Tech Retreat, convening more than 800 industry leaders, technologists, creatives, and execut...

04/03/2026

Case Study: How SEG+ Unified Utah's Biggest Sports Teams into a 40%+ Subscriber Growth Streaming Platform

Smith Entertainment Group transformed how local sports are consumed by creating ...

04/03/2026

SVG in Indy: Pacers Sports & Entertainment Remotely Produces Broadcasts of G League's Noblesville Boom

The production method, which spans a distance of 36.2 miles, was designed and im...

04/03/2026

Haivision Releases Seventh Annual Broadcast Transformation Report, Highlights Key Trends Shaping Live Production in 2026

Haivision, a global provider of mission-critical, real-time video networking and...

04/03/2026

SVG Sit-Down: Quantum CEO Hugues Meyrath on Reshaping the Company, the Impact of AI, Evolving Media Storage

When Hugues Meyrath came out of retirement to take the helm as CEO of Quantum, i...

04/03/2026

As Banana Ball Expands Exponentially, So Too Do Its Production Capabilities

Last week's launch of Banana Ball Championship League has spurred a significant upgrade of production facilities The Savannah Bananas, arguably the hottest...

04/03/2026

Press Release TEST

sldkfjsdlfkjsldkfjsldkjfslkdjfslkdjfsl Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus...

04/03/2026

Spotify A/Presenta Brings Fans Closer to Artists' Creative Process in Latin America, Starting With ROSALA

For many fans, a song's backstory can be just as compelling as the final pro...

04/03/2026

Spotify Kicks Off Our 20th Anniversary at SXSW With a Celebration of Artists, Creators, and Fans

In 2006, Spotify was founded on the belief that technology could bring artists a...

04/03/2026

Spotify and Coca-Cola Saddle Up for a Rhinestone Cowboy Experience at the Houston Rodeo

Spotify is back on the ground for the Houston Livestock Show and Rodeo, and we&#...

04/03/2026

Spotify Doubles Down on Investments in Australian Fan Discovery of Homegrown Aussie Talent

Spotify had an energizing week in Sydney, Australia, filled with powerful conver...

04/03/2026

FKA twigs and Jordan Hemingway Explore the Making of HARD' in Episode Two of Directed By'

Earlier this year, we launched Directed By, a documentary-style series that pull...

04/03/2026

100 Days to Go: SBS Unveils World Class Team for The Greatest Show on Earth -The FIFA World Cup 2026

100 Days to Go: SBS Unveils World Class Team for The Greatest Show on Earth -The...

04/03/2026

KT and Rohde & Schwarz to showcase AI-enhanced radio transmission performance

KT and Rohde & Schwarz to showcase AI-enhanced radio transmission performance In a joint 6G AI proof-of-concept demonstration, the CMX500 one-box tester from ...

04/03/2026

APTS Announces Public Broadcast Leadership, Advocacy Awards

Share Copy link Facebook X Linkedin Bluesky Email...

04/03/2026

SES publishes 2025 Annual Report

Luxembourg, 3 March 2026 - SES S.A. has today published its 2025 Annual Report, following the announcement of the company's full year financial results for ...

04/03/2026

NBC Sports, USA Sports Extend Rights Deal with PGA

Share Copy link Facebook X Linkedin Bluesky Email...

04/03/2026

Broadcasters Gather in DC for NAB State Leadership Conference

Share Copy link Facebook X Linkedin Bluesky Email...

04/03/2026

Transforming Africa's Future Farmers: Satellite-Enabled IoT Powers Data-Driven Agribusinesses

Luxembourg, March 3, 2026 - SES, a leading space solutions company, along with I...

04/03/2026

VEON Partners with GSMA Innovation Fund to Accelerate Digital Innovation in Pakistan and Bangladesh

04 Mar 2026 VEON Partners with GSMA Innovation Fund to Accelerate Digital Innov...

04/03/2026

VEON's Beeline Uzbekistan and Rakuten Symphony Partner for Open RAN, AI Collaboration

04 Mar 2026 VEON's Beeline Uzbekistan and Rakuten Symphony Partner for Open...

04/03/2026

Sky Sports unveils plans for 2026 Formula 1 coverage

Wednesday 4 March 2026 Sky Sports unveils plans for 2026 Formula 1 coverage Sky Sports is preparing for one of the most highly anticipated F1 seasons in recen...

04/03/2026

Bloodhounds' Season 2 Gears Up for April 3 Premiere with Hard-Hitting New Teaser and Poster

Back to All News Bloodhounds' Season 2 Gears Up for April 3 Premiere with ...

04/03/2026

Netflix Ads Suite Expands Capabilities

Back to All News Netflix Ads Suite Expands Capabilities Business 04 March 2026 GlobalUnited States Link copied to clipboard After launching the Netflix Ad...

04/03/2026

March 02, 2026

Scripps Research welcomes healthcare innovator Joe Kiani to the Board of Directors Kiani brings decades of experience in patient safety and public service. Mar...

04/03/2026

March 03, 2026

Nanoparticle vaccine approach takes on a new target: Hepatitis C virus Scripps Research scientists reengineer critical proteins on the surface of HCV, paving th...

03/03/2026

LIV Golf, Beyond Sports Elevate Online Gaming Ecosystem with Launch of LIV Golf Fantasy and LIV X

Beyond Sports, a Sony group company, and LIV Golf, the world's golf league, ...

03/03/2026

Ilitch Sports + Entertainment Announces Launch of Detroit SportsNet

Ilitch Sports + Entertainment announces the launch of Detroit SportsNet (DSN), a year-round broadcast home for two of Detroit's franchises. With flexible op...

03/03/2026

Advanced Systems Group Promotes Gretchen Taipale to Vice President, Managed Services

Advanced Systems Group, LLC (ASG), a technology and services provider for media ...