Sony Pixel Power calrec Sony

Inside AI: NVIDIA DRIVE Ecosystem Creates Pioneering In-Cabin Features With NVIDIA DRIVE IX

21/09/2022

As personal transportation becomes electrified and automated, time in the vehicle has begun to resemble that of a living space rather than a mind-numbing commute.

Companies are creating innovative ways for drivers and passengers to make the most of this experience, using the flexibility and modularity of NVIDIA DRIVE IX. In-vehicle technology companies Cerence, Smart Eye, Rightware and DSP Concepts are now using the platform to deliver intelligent features for every vehicle occupant.

These partners are joining a diverse ecosystem of companies developing on DRIVE IX, including Soundhound, Jungo and VisionLabs, providing cutting-edge solutions for any in-vehicle need.

DRIVE IX provides an open software stack for cockpit solution providers to build and deploy features that will turn personal vehicles into interactive environments, enabling intelligent assistants, graphic user interfaces and immersive media and entertainment.

Intelligent Assistants AI isn't just transforming the way people drive, but also how they interact with cars.

Using speech, gestures and advanced graphical user interfaces, passengers can communicate with the vehicle through an AI assistant as naturally as they would with a human.

An intelligent assistant will help to operate vehicle functions more intuitively, warn passengers in critical situations and provide services such as giving local updates like the weather forecast, making reservations and phone calls, and managing calendars.

Conversational AI Interaction Software partner Cerence is enabling AI-powered, voice-based interaction with the Cerence Assistant, its intelligent in-car assistant platform.

Cerence Assistant uses sensor data to serve drivers throughout their daily journeys, notifying them, for example, when fuel or battery levels are low and navigating to the nearest gas or charging station.

It features robust speech recognition, natural language understanding and text-to-speech capabilities, enhancing the driver experience.

Courtesy of Cerence Using DRIVE IX, it can empower both embedded and cloud-based natural language processing on the same architecture, ensuring drivers have access to important capabilities regardless of connectivity.

Cerence Assistant also supports major global markets and related languages, and is customizable for brand-specific speech recognition and personalization.

Gesture Recognition In addition to speech, passengers can interact with AI assistants via gesture, which relies on interior sensing technologies.

Smart Eye is a global leader in AI-based driver monitoring and interior sensing solutions. Its production driver-monitoring system is already in 1 million vehicles on the roads around the world, and will be incorporated in the upcoming Polestar 3, set to be revealed in October.

Working with DRIVE IX, Smart Eye's technology makes it possible to detect eye movements, facial expressions, body posture and gestures, bringing insight into people's behavior, activities and mood.

Courtesy of Smart Eye Using NVIDIA GPU technology, Smart Eye has been able to speed up its cabin-monitoring system - which consists of 10 deep neural networks running in parallel - by more than 10x.

This interior sensing is critical for safety - ensuring driver attention is on the road when it should be and detecting left-behind children or pets - and it customizes and enhances the entire mobility experience for comfort, wellness and entertainment.

Graphical User Interface AI assistants can communicate relevant information easily and clearly with high-resolution graphical interfaces. Using DRIVE IX, Rightware is creating a seamless visual experience across all cockpit and infotainment domains.

Caption: Courtesy of Rightware Rightware's automotive human-machine interface tool Kanzi One helps designers bring amazing real-time 3D graphical user interfaces into the car and hides the underlying operating system and framework complexity. Automakers can completely customize the vehicle's user interface with Kanzi One, providing a brand-specific signature UI.

Enhancing visual user interfaces by audio features is equally important for interacting with the vehicle. The Audio Weaver development platform from DSP Concepts can be integrated into the DRIVE IX advanced sound engine. It provides a sound design toolchain and audio framework to graphically design features.

Courtesy of DSP Concepts. Creators and sound artists can design a car- and brand-specific sound experience without the hassle of writing complex code for low-level audio features from scratch.

Designing in Simulation With NVIDIA DRIVE Sim on Omniverse, developers can integrate, refine and test all these new features in the virtual world before implementing them in vehicles.

Interior sensing companies can build driver- or occupant-monitoring models in the cockpit using the DRIVE Replicator synthetic-data generation tool on DRIVE Sim. Partners providing content for vehicle displays can first develop on a rich, simulated screen configuration.

Access to this virtual vehicle platform can significantly accelerate end-to-end development of intelligent in-vehicle technology.

By combining the flexibility of DRIVE IX with leading in-cabin solutions providers, spending time in the car can become a luxury rather than a chore.
LINK: https://blogs.nvidia.com/blog/2022/09/21/drive-ix-ecosystem/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

15/09/2026

IBC 2026: Pixitmedia by DataCore to Showcase Cloud and Connected Production Workflows

At IBC2026, Pixitmedia by DataCore will showcase its latest capabilities designe...

15/09/2026

IBC 2026: Quantum Introduces Autonomous Data Management, Dramatically Reducing Storage Costs While Increasing Efficiency and Availability

Quantum Corp. today announced the release of Quantum Autonomous Data Management ...

15/09/2026

PGA Tour Taps Mike Mahar as Chief Technology Officer to Drive Digital, Data, AI Strategy

Former Wyndham Hotels & Resorts technology executive will focus on fan engagemen...

15/09/2026

Creator Sports Network and FAN.live Launch 3D NFL Watch Party for Creators

Creator Sports Network (CSN) and FAN.live have announced a partnership giving CSN's network of more than 2,000 vetted creators access to live 3D NFL broadca...

15/09/2026

IBC 2026 In Review: Our Complete Collection of Video Interviews with Industry Thought Leaders

SVG and SVG Europewere all over the IBC 2026 show floor out in Amsterdam, bringi...

15/09/2026

Rise Announces 2026 Awards Shortlist

Rise WIB has announced the shortlist for the Rise Awards 2026, returning to Troxy in London on Tuesday, November 17. The awards recognize outstanding women, adv...

15/09/2026

Major League Table Tennis Announces 2026-27 Media Distribution Lineup

Major League Table Tennis (MLTT) has announced its media distribution lineup for the 2026-27 season, beginning September 11. Every match will stream live on the...

15/09/2026

Willow Sports to Air 700 Hours of Free Asian Games Coverage for U.S. and Canadian Viewers

Willow Sports has announced it will serve as the exclusive U.S. and Canadian hom...

15/09/2026

Gravity Media to Broadcast MXGP of Australia Championship Finale

Gravity Media has announced it will provide outside broadcast production and technical services for the MXGP of Australia, the finale of the 2026 FIM World Moto...

15/09/2026

Scott Coker and Peter Y. Levin Launch Ki MMA Global MMA Promotion

Co-founders Scott Coker and Peter Y. Levin have unveiled Ki MMA, a new global mixed martial arts promotion launching in the first quarter of 2027. The announcem...

15/09/2026

Sony Announces FE 400mm F4.5 GM OSS and FE 600mm F6.3 GM OSS Super-Telephoto Lenses

Sony Electronics has announced two new G Master super-telephoto prime lenses for...

15/09/2026

Former NEP Group Exec Saeed Izadi Opens The Matrix, Next-Gen Remote Production Center in Singapore

GlobeCast provides facility for AI-power automated production core...

15/09/2026

Gravity Media Set to Deliver 2026 FIM World Motorcross Championship

Gravity Media, a leading global provider of production and content, and media services and facilities, is empowering Tourism and Events Northern Territory (NT) ...

15/09/2026

Audient unveil flagship Horizon interfaces

New Thunderbolt audio interfaces aimed at pro studios Audient's latest announcement sees the company introduce three new high-end audio interfaces desig...

15/09/2026

Sennheiser launch the Spectera SKM handheld

Completes core wireless system line-up The latest addition to Sennheiser's Spectera range is now shipping, completing the core elements of the company&#...

15/09/2026

Schwabe Digital reveal HiFAL 2

High-frequency dynamics plug-in upgraded Schwabe Digital have just released a major free update for their acclaimed high-frequency dynamics processing plug-...

15/09/2026

LUNA 3.0 & UAD Spark Studio from Universal Audio

DAW update launched alongside all-in-one subscription bundle The latest version of Universal Audio's DAW software has just arrived, and has been release...

15/09/2026

Rupert Neve Designs introduce three plug-ins

Three popular hardware units go virtual Rupert Neve Designs are entering the software market in style, with not one, but three of their sought-after hardwar...

15/09/2026

Argo M Powers Cloudbass' Next Generation OB Fleet

When longstanding OB specialist Cloudbass made the decision to expand its fleet to accommodate remote production facilities for a leading UK sports broadcaster&...

15/09/2026

Study: 3 in 4 U.S. TV Viewers Use Smartphones While Watching TV

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Agent TiVo Will Help Track Down Your Show

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Nielsen Marketing Cloud Launches Data Enrichment Capabilities

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Six Berklee Alumni Win at 2026 Emmy Awards

Six Berklee Alumni Win at 2026 Emmy Awards The recipients were recognized for their contributions to Widow's Bay, Beef, South Park, and Bad Bunny's Su...

15/09/2026

OWC Announces Acquisition of OpenDrives, Expanding Software-Defined Video and Rich Media Storage Management Capabilities

OWC Announces Acquisition of OpenDrives, Expanding Software-Defined Video and Ri...

15/09/2026

Podcast The Vertical Buzz Shot with Blackmagic Pocket Cinema Camera 6K Pro

Podcast The Vertical Buzz Shot with Blackmagic Pocket Cinema Camera 6K Pro Brie Clayton September 14, 2026 0 Comments Production team builds premium p...

15/09/2026

Grass Valley Launches AVORA at IBC2026

Grass Valley Launches AVORA at IBC2026 Brie Clayton September 14, 2026 0 Comments New standalone solution gives production teams everything they need ...

15/09/2026

Brandon Woody Joins Berklee Student Ensemble for Signature Series Concert

Brandon Woody Joins Berklee Student Ensemble for Signature Series Concert The acclaimed trumpeter, composer, and bandleader will lead a Berklee student ensemb...

15/09/2026

IBC2026 Announces IBC Innovation Award Winners

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

IEEE BTS to Host Broadcast Technology Forum at NAB Headquarters

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Huw Mills Joins Technetix as SVP, Global Operations

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

TiVo Introduces Agent TiVo

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Study: Younger Fans Are Watching More Sports Than Ever

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

NFL Melbourne Game Scores 18.5 Million U.S. Viewers on Netflix

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Applications open for Future Leaders Delegation to BitSummit 2027

Applications open for Future Leaders Delegation to BitSummit 2027 15 September 2026 Applications are open for Screen Australia's annual Future Leaders Dele...

15/09/2026

Red Seat Ventures' Supercast Launches Live Streaming, Bringing Real-Time Video and Community to Subscribers

Red Seat Ventures' Supercast Launches Live Streaming, Bringing Real-Time Vid...

15/09/2026

Arqiva recognised with Armed Forces Covenant Silver Award

Arqiva recognised with Armed Forces Covenant Silver AwardPresented to organisations that demonstrate outstanding support for the Armed Forces community -- Sh...

14/09/2026

ESPNs MNF Gets in Tune With Apple Music, Adds Ludacris to In the Air Tonight Open

Lil Baby's Dead Fresh kicks off ESPN's Week 1 Monday Night Football, ...

14/09/2026

ESPN's Monday Night Football Begins Its Super Bowl Run With Year 2 of Flagship, New Tech, and 4K HDR Distribution

With Super Bowl LXI waiting in Los Angeles, ESPN will use the regular season to ...

14/09/2026

Give Me the Backstory: Get to Know Padraic McKinley, the Director of The Weight

By Bailey Pennick One of the most exciting things about the Sundance Film Festival is having a front-row seat for the bright future of independent filmmaking. ...

14/09/2026

Sony expand WH headphone line-up

Three new models introduced Sony have just announced the launch of three new pairs of headphones that span their premium, mid-range and entry-level line-ups...

14/09/2026

Audient unveil Horizon interfaces

New flagship Thunderbolt units aimed at pro studios Audient's latest announcement sees the company introduce three new high-end audio interfaces designe...

14/09/2026

Cobalt Digital to Bring New and Enhanced Practical Solutions to Evolving Broadcast Workflows at IBC2026

Cobalt Digital IBC Stand 8.F90 // Journalists: Click to visit Cobalt Highlights...

14/09/2026

TV Tech Unveils Best of Show Winners at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

14/09/2026

TV Skyline Becomes 'World's First Ultrix FR30 Customer

Share Copy link Facebook X Linkedin Bluesky Email...

14/09/2026

Bitmovin AI Scene Analysis Selected by Nine to Enhance it...

Bitmovin, a leading provider of video streaming solutions, has announced that Australia's largest media company, Nine Entertainment (Nine), has deployed Bit...

14/09/2026

Creativepool Annual 2026 Winners Announced

Creativepool Annual 2026 Winners Announced Brie Clayton September 13, 2026 0 Comments The creative industry's Most' awards celebrates another...

14/09/2026

Inside DPA's N-Series at IBC2026: Wireless audio without compromise

At IBC2026, Ren M rch explains how the N-Series combines DPA's renowned microphone technology with a high-performance wireless platform, offering a wide tu...