Sony Pixel Power calrec Sony

Inside AI: NVIDIA DRIVE Ecosystem Creates Pioneering In-Cabin Features With NVIDIA DRIVE IX

21/09/2022

As personal transportation becomes electrified and automated, time in the vehicle has begun to resemble that of a living space rather than a mind-numbing commute.

Companies are creating innovative ways for drivers and passengers to make the most of this experience, using the flexibility and modularity of NVIDIA DRIVE IX. In-vehicle technology companies Cerence, Smart Eye, Rightware and DSP Concepts are now using the platform to deliver intelligent features for every vehicle occupant.

These partners are joining a diverse ecosystem of companies developing on DRIVE IX, including Soundhound, Jungo and VisionLabs, providing cutting-edge solutions for any in-vehicle need.

DRIVE IX provides an open software stack for cockpit solution providers to build and deploy features that will turn personal vehicles into interactive environments, enabling intelligent assistants, graphic user interfaces and immersive media and entertainment.

Intelligent Assistants AI isn't just transforming the way people drive, but also how they interact with cars.

Using speech, gestures and advanced graphical user interfaces, passengers can communicate with the vehicle through an AI assistant as naturally as they would with a human.

An intelligent assistant will help to operate vehicle functions more intuitively, warn passengers in critical situations and provide services such as giving local updates like the weather forecast, making reservations and phone calls, and managing calendars.

Conversational AI Interaction Software partner Cerence is enabling AI-powered, voice-based interaction with the Cerence Assistant, its intelligent in-car assistant platform.

Cerence Assistant uses sensor data to serve drivers throughout their daily journeys, notifying them, for example, when fuel or battery levels are low and navigating to the nearest gas or charging station.

It features robust speech recognition, natural language understanding and text-to-speech capabilities, enhancing the driver experience.

Courtesy of Cerence Using DRIVE IX, it can empower both embedded and cloud-based natural language processing on the same architecture, ensuring drivers have access to important capabilities regardless of connectivity.

Cerence Assistant also supports major global markets and related languages, and is customizable for brand-specific speech recognition and personalization.

Gesture Recognition In addition to speech, passengers can interact with AI assistants via gesture, which relies on interior sensing technologies.

Smart Eye is a global leader in AI-based driver monitoring and interior sensing solutions. Its production driver-monitoring system is already in 1 million vehicles on the roads around the world, and will be incorporated in the upcoming Polestar 3, set to be revealed in October.

Working with DRIVE IX, Smart Eye's technology makes it possible to detect eye movements, facial expressions, body posture and gestures, bringing insight into people's behavior, activities and mood.

Courtesy of Smart Eye Using NVIDIA GPU technology, Smart Eye has been able to speed up its cabin-monitoring system - which consists of 10 deep neural networks running in parallel - by more than 10x.

This interior sensing is critical for safety - ensuring driver attention is on the road when it should be and detecting left-behind children or pets - and it customizes and enhances the entire mobility experience for comfort, wellness and entertainment.

Graphical User Interface AI assistants can communicate relevant information easily and clearly with high-resolution graphical interfaces. Using DRIVE IX, Rightware is creating a seamless visual experience across all cockpit and infotainment domains.

Caption: Courtesy of Rightware Rightware's automotive human-machine interface tool Kanzi One helps designers bring amazing real-time 3D graphical user interfaces into the car and hides the underlying operating system and framework complexity. Automakers can completely customize the vehicle's user interface with Kanzi One, providing a brand-specific signature UI.

Enhancing visual user interfaces by audio features is equally important for interacting with the vehicle. The Audio Weaver development platform from DSP Concepts can be integrated into the DRIVE IX advanced sound engine. It provides a sound design toolchain and audio framework to graphically design features.

Courtesy of DSP Concepts. Creators and sound artists can design a car- and brand-specific sound experience without the hassle of writing complex code for low-level audio features from scratch.

Designing in Simulation With NVIDIA DRIVE Sim on Omniverse, developers can integrate, refine and test all these new features in the virtual world before implementing them in vehicles.

Interior sensing companies can build driver- or occupant-monitoring models in the cockpit using the DRIVE Replicator synthetic-data generation tool on DRIVE Sim. Partners providing content for vehicle displays can first develop on a rich, simulated screen configuration.

Access to this virtual vehicle platform can significantly accelerate end-to-end development of intelligent in-vehicle technology.

By combining the flexibility of DRIVE IX with leading in-cabin solutions providers, spending time in the car can become a luxury rather than a chore.
LINK: https://blogs.nvidia.com/blog/2022/09/21/drive-ix-ecosystem/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

12/09/2026

Matrox, NVIDIA Integrate ORIGIN, Holoscan For Media

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

Ross Video Debuts New Live Production Technology at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

FCC Nominee Thumann Severs to Testify in Senate Sept. 17

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

TV Skyline Becomes The World's First Ultrix FR30 Customer

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

Ikegami Introduces VN Versions of Four UNICAM XE Cameras At IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

Riedel Technology Powers Record Breaking Esports World Cu...

WUPPERTAL, Germany Sept. 11, 2026 From July 6 to Aug. 23, 2026, Paris hosted the Esports World Cup (EWC), a seven-week live production spanning eight stages...

12/09/2026

Mediacom Deploys Riedel Easy5G for Wireless Camera Covera...

Riedel Communications today announced that Mediacom has purchased and deployed Easy5G , Riedel's Private 5G solution, for live broadcast coverage of La Vuel...

12/09/2026

A Decade of Innovation AMP VISUAL TV Builds on Ten Years...

AMP VISUAL TV is continuing the evolution of its production infrastructure with further investments in Riedel technology across its OB fleet and fixed productio...

12/09/2026

Touring Video Expands Flexible Production Workflows With...

Riedel Communications today announced that Touring Video, a premier entertainment mobile production service company, continues to expand its production workflow...

12/09/2026

Atomos Expands Accessory Ecosystem with New SHAPE and Sma...

Atomos (7.B19) today announced new third-party accessories for Sumo PRO-19 and Shinobi 7 II, developed by SHAPE and SmallRig to give production teams more ways ...

12/09/2026

Deity Microphones Brings PR 2ii, TC-2, and D4RX to IBC2026

Deity Microphones Brings PR 2ii, TC-2, and D4RX to IBC2026 Brie Clayton September 11, 2026 0 Comments The Deity PR-2ii arrives with production firmwar...

12/09/2026

Blackmagic Design Announces Special Pricing for Ultra HD Products

Blackmagic Design Announces Special Pricing for Ultra HD Products Brie Clayton September 11, 2026 0 Comments Now customers can afford to upgrade to Ul...

12/09/2026

Grass Valley EDIUS Future Assurance Program launched at IBC2026

Grass Valley EDIUS Future Assurance Program launched at IBC2026 Brie Clayton September 11, 2026 0 Comments New program gives EDIUS customers access to...

12/09/2026

Berklee Students Develop New Ideas for Live Entertainment and Travel in London

Berklee Students Develop New Ideas for Live Entertainment and Travel in London This summer, a group of music business students collaborated with Heathrow, Bri...

11/09/2026

IBC 2026: Calrec Launches Type RT Console and Apex M6 Modular I/O Platform

Calrec will introduce two new products at IBC2026 (Stand 8.C47, RAI Amsterdam, September 11-14): the Type RT broadcast production console and the Apex M6 Modula...

11/09/2026

IBC 2026: Grass Valley Launches AVORA All-in-One Live Production Platform

Grass Valley has announced AVORA, a standalone all-in-one live production solution launching at IBC2026 (Booth 9.A01 and IBC Future Tech Zone, Stand 14.C49, Sep...

11/09/2026

IBC 2026: CAMB.AI Launches Streaming SDK and Dashboard for Multilingual Live Broadcasting

CAMB.AI is introducing its Streaming SDK and Streaming Dashboard at IBC2026, wit...

11/09/2026

IBC 2026: EVS Launches XT-S Software-Defined Multi-Application Server

EVS has announced XT-S, a software-defined server platform that runs multiple live production applications on a common hardware foundation. The platform debuts ...

11/09/2026

IBC 2026: EKT Showcases Linux-Based ATSC 3.0 Converter Box

EKT is demonstrating a new Linux-based ATSC 3.0 set-top box at IBC2026. The second-generation product moves away from Android to reduce memory costs, with Linux...

11/09/2026

IBC 2026: Sennheiser Group to Showcase Wireless, Monitoring, and Broadcast Workflow

The Sennheiser Group will exhibit at IBC2026 (Hall 8, Booth D50, September 11-14...

11/09/2026

Ludacris Joins Chris Stapleton and Cindy Blackman Santana for Monday Night Footballs In the Air Tonight Open

ESPN's Monday Night Football will open its 2026-27 season with a new renditi...

11/09/2026

Dalet Integrates NVIDIA Synthetic Content Detection into Dalet Flex

Dalet has announced an integration of NVIDIA's Synthetic Video Detector AI model into Dalet Flex, enabling media organizations to identify potentially AI-ge...

11/09/2026

IBC 2026: MC-IF Demonstrates VVC Capabilities

The Media Coding Industry Forum (MC-IF) will demonstrate Versatile Video Coding (VVC) capabilities at IBC2026 (Hall 2, Stand 2.B13), as the codec moves toward c...

11/09/2026

IBC 2026: Sony to Demonstrate Live, News, Cinema, and Immersive Production

Sony will exhibit at IBC2026 (Hall 13, September 11-14), demonstrating products across live production, news, cinema, and immersive and spatial content workflow...

11/09/2026

Wave Central Named Recipient of 2026 Technology and Engineering Emmy for FPV Drone Systems

Wave Central, a Domo Broadcast Company, has been named a recipient of a 2026 Tec...

11/09/2026

IBC 2026: SNS Validates EVO Compatibility With Avid Media Composer 2026.8, Adds Browser-Based Upload to Outpost

Studio Network Solutions (SNS) is bringing a pair of workflow updates to IBC2026...

11/09/2026

IBC 2026: iodyne to Demo Pro Mini Smart Drive Across Four Partner Booths

iodyne will co-exhibit with Hedge at IBC2026 (Booth 7.A36, September 11-14) and appear across three additional partner booths, marking the first public demonstr...

11/09/2026

SVG GameDay, Ep. 30: Freelance Graphics Operator Corinne Yamada - Philly-Based Graphics Creation

In-venue and creative video staffers at the professional and collegiate level ha...

11/09/2026

CBS Sports Goes HDR Across Its Entire NFL Package, Heads to Rio in Week 3

The network will phase in HDR crew by crew while expanding Next Gen Stats integration, SkyDry availability, and onsite studio shows...

11/09/2026

IBC 2026: CAMB.AI Unveils the World's First Multilingual Broadcasting Agent Powered by NVIDIA

CAMB.AI is introducing its new Streaming SDK and Streaming Dashboard at IBC2026,...

11/09/2026

Netflix Goes Down Under With NBC Sports, NEP for NFL From Melbourne

Massive host operation at Melbourne Cricket Ground featured 54 cameras, 25,000 ST 2110 flows, REMI studio production in Stamford, and global distribution to mor...

11/09/2026

FOX Sports Homogenizes Coverage With Upscaled Game Tech, Seamless Integration With Studio Shows in L.A.

Production Anywhere Remote Kit (PARK) & AR-fueled Stage B are two key pieces to ...

11/09/2026

Get to Know This Fall and Winter's Filmmakers Through These 36 Sundance Institute-Supported Films

By Ramona Flume and Lucy Spicer There's a particular kind of magic that hap...

11/09/2026

Film Festival Watch: 8 Sundance Institute-Supported Films to See at the 2026 Toronto International Film Festival

By Jessica Herndon The fall film season is kicking off, and Sundance Institute-...

11/09/2026

Positive Grid announce the Spark Pedal

Spark series gains compact modelling stompbox Positive Grid's Spark amps have become a popular part of the company's line-up, offering a convenient ...

11/09/2026

Rapid Flow release omniGRID

New flagship sequencing plug-in revealed Rapid Flow have just launched a new 16-track sequencer plug-in which they say has been designed for total rhythmic...

11/09/2026

Rohde & Schwarz unveils the air-cooled R&STM1 medium-power UHF transmitter at IBC 2026

Rohde & Schwarz unveils the air-cooled R&S TM1 medium-power UHF transmitter at I...

11/09/2026

TV Usage Kicks Usual Summer Slowdown, Fueled by World Cup and Streaming in Nielsen's July Gauge Reports

FIFA World Cup 2026 and Peacock's Love Island USA' Power NBCU-Versant ...

11/09/2026

Atomos Debuts New HDR Monitors at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Calrec to Unveil Type RT Compact Console at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Lightware Launches LARA 2 with New Architecture for More...

Lightware has announced the launch of LARA (Lightware Advanced Room Automation) 2.0, a major upgrade to its built-in room automation platform, introducing impro...

11/09/2026

MusiMap launches latest technology unlocking new commerci...

10 September 2026 - MusiMap, the B2B music intelligence company that is transforming how companies can harness the emotional power of music to reach consumers a...

11/09/2026

Matrox Video Integrates Matrox ORIGIN with NVIDIA Holosca...

Matrox Video today announced an integration between Matrox ORIGIN and NVIDIA Holoscan for Media, enabling Matrox ORIGIN media services to be provisioned, config...

11/09/2026

Net Insight brings cloud-native live media orchestration...

Net Insight today announced that its cloud-native live media orchestration is now available through Oracle Cloud Marketplace, providing broadcasters, production...

11/09/2026

Calrec to Unveil Type RT Compact Console at IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

11/09/2026

Biggest functionality boost yet makes Buttons the perfect...

Version 1.8 will bring advanced routing control, new workflow tools, boosted control panel flexibility and ease of integration into IP networks...

11/09/2026

Ikegami Announces Four New UNICAM XE Series Cameras

Ikegami announces four additions its UNICAM XE range of 4K-UHD cameras with the introduction of the UHK-X700VN, UHK-X750VN, UHK-X600VN and UHK-X650VN. Developed...