Sony Pixel Power calrec Sony

Inside AI: NVIDIA DRIVE Ecosystem Creates Pioneering In-Cabin Features With NVIDIA DRIVE IX

21/09/2022

As personal transportation becomes electrified and automated, time in the vehicle has begun to resemble that of a living space rather than a mind-numbing commute.

Companies are creating innovative ways for drivers and passengers to make the most of this experience, using the flexibility and modularity of NVIDIA DRIVE IX. In-vehicle technology companies Cerence, Smart Eye, Rightware and DSP Concepts are now using the platform to deliver intelligent features for every vehicle occupant.

These partners are joining a diverse ecosystem of companies developing on DRIVE IX, including Soundhound, Jungo and VisionLabs, providing cutting-edge solutions for any in-vehicle need.

DRIVE IX provides an open software stack for cockpit solution providers to build and deploy features that will turn personal vehicles into interactive environments, enabling intelligent assistants, graphic user interfaces and immersive media and entertainment.

Intelligent Assistants AI isn't just transforming the way people drive, but also how they interact with cars.

Using speech, gestures and advanced graphical user interfaces, passengers can communicate with the vehicle through an AI assistant as naturally as they would with a human.

An intelligent assistant will help to operate vehicle functions more intuitively, warn passengers in critical situations and provide services such as giving local updates like the weather forecast, making reservations and phone calls, and managing calendars.

Conversational AI Interaction Software partner Cerence is enabling AI-powered, voice-based interaction with the Cerence Assistant, its intelligent in-car assistant platform.

Cerence Assistant uses sensor data to serve drivers throughout their daily journeys, notifying them, for example, when fuel or battery levels are low and navigating to the nearest gas or charging station.

It features robust speech recognition, natural language understanding and text-to-speech capabilities, enhancing the driver experience.

Courtesy of Cerence Using DRIVE IX, it can empower both embedded and cloud-based natural language processing on the same architecture, ensuring drivers have access to important capabilities regardless of connectivity.

Cerence Assistant also supports major global markets and related languages, and is customizable for brand-specific speech recognition and personalization.

Gesture Recognition In addition to speech, passengers can interact with AI assistants via gesture, which relies on interior sensing technologies.

Smart Eye is a global leader in AI-based driver monitoring and interior sensing solutions. Its production driver-monitoring system is already in 1 million vehicles on the roads around the world, and will be incorporated in the upcoming Polestar 3, set to be revealed in October.

Working with DRIVE IX, Smart Eye's technology makes it possible to detect eye movements, facial expressions, body posture and gestures, bringing insight into people's behavior, activities and mood.

Courtesy of Smart Eye Using NVIDIA GPU technology, Smart Eye has been able to speed up its cabin-monitoring system - which consists of 10 deep neural networks running in parallel - by more than 10x.

This interior sensing is critical for safety - ensuring driver attention is on the road when it should be and detecting left-behind children or pets - and it customizes and enhances the entire mobility experience for comfort, wellness and entertainment.

Graphical User Interface AI assistants can communicate relevant information easily and clearly with high-resolution graphical interfaces. Using DRIVE IX, Rightware is creating a seamless visual experience across all cockpit and infotainment domains.

Caption: Courtesy of Rightware Rightware's automotive human-machine interface tool Kanzi One helps designers bring amazing real-time 3D graphical user interfaces into the car and hides the underlying operating system and framework complexity. Automakers can completely customize the vehicle's user interface with Kanzi One, providing a brand-specific signature UI.

Enhancing visual user interfaces by audio features is equally important for interacting with the vehicle. The Audio Weaver development platform from DSP Concepts can be integrated into the DRIVE IX advanced sound engine. It provides a sound design toolchain and audio framework to graphically design features.

Courtesy of DSP Concepts. Creators and sound artists can design a car- and brand-specific sound experience without the hassle of writing complex code for low-level audio features from scratch.

Designing in Simulation With NVIDIA DRIVE Sim on Omniverse, developers can integrate, refine and test all these new features in the virtual world before implementing them in vehicles.

Interior sensing companies can build driver- or occupant-monitoring models in the cockpit using the DRIVE Replicator synthetic-data generation tool on DRIVE Sim. Partners providing content for vehicle displays can first develop on a rich, simulated screen configuration.

Access to this virtual vehicle platform can significantly accelerate end-to-end development of intelligent in-vehicle technology.

By combining the flexibility of DRIVE IX with leading in-cabin solutions providers, spending time in the car can become a luxury rather than a chore.
LINK: https://blogs.nvidia.com/blog/2022/09/21/drive-ix-ecosystem/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

10/09/2026

Study: NFL Ad Revenue to Hit a Record $6.3 Billion

Share Copy link Facebook X Linkedin Bluesky Email...

10/09/2026

Teradek Unveils Bolt 7 With 900MHz RF Pipeline

Share Copy link Facebook X Linkedin Bluesky Email...

10/09/2026

Survey: Roku Remains Most Popular Streamer

Share Copy link Facebook X Linkedin Bluesky Email...

10/09/2026

Sony Unveils Fourth Generation Of DWX Wireless Mics

Share Copy link Facebook X Linkedin Bluesky Email...

10/09/2026

Scripps Revamps Local Media Regional Leadership Structure

Share Copy link Facebook X Linkedin Bluesky Email...

09/09/2026

IBC 2026: Sony Introduces SEL814G Fisheye Zoom G Lens

Sony Electronics has announced the SEL814G, the company's first fisheye zoom G Lens for full-frame Alpha E-mount cameras. The lens will be available in Octo...

09/09/2026

IBC 2026: Telestream Expands Practical AI Capabilities Across Vantage and UP Platform

Telestream has announced an expansion of its Practical AI capabilities across th...

09/09/2026

IBC 2026: Chyron and Haivision Announce Camera-to-Cloud Live Production Integration

Haivision and Chyron have announced a technology partnership integrating Haivisi...

09/09/2026

ManningCast Reveals 2026-27 Season Schedule with Heist Mini Movie

Omaha Productions has released ManningCast: Heist, a short film featuring Peyton and Eli Manning attempting to break into NFL Commissioner Roger Goodell's o...

09/09/2026

IBC 2026: Imagine Communications to Showcase XVR Updates

Imagine Communications will demonstrate the next evolution of XVR at IBC2026 (Stand 1.B73, RAI Amsterdam, September 11-14). XVR is Imagine's channel-in-a-b...

09/09/2026

IBC 2026: swXtch.io Launches AI Broadcast Orchestration Tool abbe

swXtch.io has announced abbe, an AI-based orchestration layer for live media workflows, making its world premiere at IBC2026 (Meeting Room 5.MR13, Hall 5, Septe...

09/09/2026

Inside the NFL Returns to X for Second Season, Marking 50th Anniversary

NFL Films has announced the second season of Inside the NFL on X as an X Original, premiering Wednesday, September 9. The series marks Inside the NFL's 50th...

09/09/2026

LiveU Expands AP Partnership with LU900Q Fleet and MAM Integration

LiveU has announced an expanded partnership with The Associated Press, deploying the largest fleet of LU900Q intelligent production units in the industry as par...

09/09/2026

Diversified to Consolidate New Jersey Operations into New Newark Facility

Diversified has announced plans to consolidate its four existing New Jersey locations into a new facility in Newark, expected to be fully operational by the end...

09/09/2026

IBC 2026: Wisycom Showcases MATF Antenna Matrix, PFL RFoF Box, and MPR60 Updates

Wisycom will exhibit new RF products at IBC2026 (Stand 8.D60, September 11-14), including the MATF Wideband Antenna Matrix, PFL Portable RF over Fiber Box, and ...

09/09/2026

IBC 2026: G&D and VuWall to Introduce vsNEO KVM-over-IP Platform

Guntermann & Drunck (G&D) and VuWall, both Panoptec companies, will introduce vsNEO at IBC2026 (Stand 8.B63, September 11, RAI Amsterdam). Pre-orders open in ea...

09/09/2026

Mo-Sys Completes Restructuring, Promotes Selin Kemal to Managing Director

Mo-Sys has completed a business restructuring and relocated to a new facility in Canada Water, London. As part of the reorganization, Selin Kemal has been promo...

09/09/2026

Aicox and TAG Video Systems Power Monitoring for Telefnicas TSAmediaHUB

Aicox has integrated TAG Video Systems' Core monitoring platform into Telef nica's TSAmediaHUB audiovisual contribution and distribution infrastructure....

09/09/2026

IBC 2026: Blackmagic Design Releases DaVinci Resolve 21.1

Blackmagic Design has released DaVinci Resolve 21.1, a free update available now through the Blackmagic Design website. The release adds new AI tools, workflow ...

09/09/2026

ESPN and Apple Music Collaborate on Monday Night Football Music Curation for 2026-27 Season

ESPN and Apple Music have announced a collaboration on music curation for Monday...

09/09/2026

Sacramento Production Services Deploys Wisycom RF System at Sutter Health Park

Sacramento Production Services has completed a wireless audio overhaul at Sutter Health Park, home of the Athletics during their three-year residency in Sacrame...

09/09/2026

NDI and NVIDIA Collaborate on AI-Powered Multilingual Content Workflows

NDI and NVIDIA have announced a collaboration to develop AI-powered workflows enabling broadcasters to create and distribute multilingual content from a single ...

09/09/2026

Sports Broadcasting Hall of Fame Announces the Class of 2026

Christopher Chip Adams, Troy Aikman, Jim Dove, Jim Eady, Bucky Gunts, Robert A. Iger, Charlie Jablonski, Robert Kraft, Tom Rinaldi, and Dick Stockton to be ho...

09/09/2026

NBC Sports Opens 21st SNF Season With Expanded Schedule, Traveling Studio Show, and Bulked Up Toolkit

ND2 returns as the primary unit, While FNIA gets SSQC and new flexible Rover...

09/09/2026

Celemony Tonalic gains additional Paul Kleber upright bass

New parts aimed at hip-hop and pop productions The latest update to Celemony's innovative virtual session musician expands the collection of built-in in...

09/09/2026

Sonarworks Autumn Sale

Save up to 40% until 21 September 2026 Sonarworks are currently running their Autumn Sale, with discounts of up to 40% currently available across their rang...

09/09/2026

Bjooks Beat Gems to begin shipping

Upcoming title officially launches in September 2026 Bjooks' celebrations for this year's 909 Day will be welcome news amongst drum machine lovers, ...

09/09/2026

NITV to bring First Nations netball to audiences nationwide

NITV to bring First Nations netball to audiences nationwide 9 September, 2026 Media releases Every match of the 2026 First Nations Tournament will be live ...

09/09/2026

NFVF CALL FOR PROPOSALS: YOUTH FILMMAKER PROJECT FACILITATING COMPANY 2026

The National Film and Video Foundation (NFVF) invites eligible Tier 1 and 2 South African production companies to submit proposals to serve as the Facilitating ...

09/09/2026

Nielsen launches CTV Ad spend data into its Italian Ad Intel product

Italy launch follows UK and Germany as Nielsen expands product across EMEA Milan, Italy, September 9, 2026 - Nielsen, a global leader in audience measurement, ...

09/09/2026

Gracenote Expands AI Product Roadmap with Sports MCP Server, Entertainment SLM and Agents

Planned solutions tackle accuracy, cost and latency barriers to deploying AI at ...

09/09/2026

Dalet Promotes Brian Doheny to CEO

Share Copy link Facebook X Linkedin Bluesky Email...

09/09/2026

Studio Technologies Expands StudioComm Monitoring With In...

Studio Technologies, a leading manufacturer of high-quality audio, video, and fiber-optic solutions, introduces its new Model 791 Control Console at IBC 2026 (N...

09/09/2026

Maxon Brings Exclusive Preview of Fall Innovations to IBC...

Maxon, maker of powerful, approachable software solutions for creators working in 2D and 3D design, motion graphics, visual effects and visualization, is headin...

09/09/2026

NUGEN Audio Leads the Dialog Intelligibility Conversation...

NUGEN Audio unveils DialogCheck v1.2, the latest evolution of its intelligent dialog intelligibility and compliance tool, at IBC 2026 (Pod P27). With a sharpene...

09/09/2026

Trusted Partner Network Launches Fix It or Risk It to Hel...

Trusted Partner Network Launches Fix It or Risk It to Help the Entertainment Industry Tackle Everyday Security Risks Industry-Wide Campaign Launches at IBC2...

09/09/2026

FCC to Vote on Opening Up Spectrum for Satellite, IoT

Share Copy link Facebook X Linkedin Bluesky Email...

09/09/2026

NDI, NVIDIA Collaborate On Real-Time AI Multilingual Content

Share Copy link Facebook X Linkedin Bluesky Email...

09/09/2026

83 percent of UK advertisers are using AI but speed and n...

AI has moved firmly beyond experimentation in UK advertising, with more than eight in ten marketers (83%) now actively using or piloting AI in production, accor...

09/09/2026

Pixitmedia by DataCore to showcase cloud and connected pr...

IBC2026 - Stand 7.D22 At IBC2026, Pixitmedia by DataCore will showcase its latest capabilities designed to simplify distributed production, accelerate workflow...

09/09/2026

Net Insight Showcases Open Live Media for Controlled Live...

Stockholm, Sweden September 9th, 2026 At IBC2026, on booth 1.B47, Net Insight will showcase Open Live Media, its architecture for delivering resilient live ...

09/09/2026

Net Insight and DMC expand repeatable remote production m...

Net Insight today announced that DMC Production Norway is continuing the use of its Open Live Media technology for premium European football, deploying Nimbra 5...

09/09/2026

Amagi to Showcase Four AI-Native Innovations Built to Pow...

Amagi, the media industry cloud platform for unified broadcast, streaming, and monetization, will showcase four new AI-native capabilities at IBC2026, Hall 5, S...

09/09/2026

Limecraft Brings Connected Automated and Intelligent Medi...

Limecraft today announces version 2026.6 of its AI-powered production platform, extending capabilities for connected media operations. An AI-assisted approach t...

09/09/2026

Telestream Advances Practical AI from Content Understandi...

Telestream, a global leader in media workflow technologies, today announced the next evolution of its Practical AI strategy, evolving its comprehensive portfoli...

09/09/2026

Dalet Appoints Brian Doheny as Chief Executive Officer

Dalet, a leading technology and service provider for media-rich organizations, today announced the appointment of Brian Doheny as Chief Executive Officer (CEO)....

09/09/2026

LiveU Offers Starlink for News and Sports Broadcast as Cl...

LiveU is now a Clarus Integrated Reseller, bringing Starlink's fast, reliable broadband directly into LiveU's cellular bonding EcoSystem through a singl...

09/09/2026

Study: New Streaming TV Series Orders Plumet

Share Copy link Facebook X Linkedin Bluesky Email...