Sony Pixel Power calrec Sony

Inside AI: NVIDIA DRIVE Ecosystem Creates Pioneering In-Cabin Features With NVIDIA DRIVE IX

21/09/2022

As personal transportation becomes electrified and automated, time in the vehicle has begun to resemble that of a living space rather than a mind-numbing commute.

Companies are creating innovative ways for drivers and passengers to make the most of this experience, using the flexibility and modularity of NVIDIA DRIVE IX. In-vehicle technology companies Cerence, Smart Eye, Rightware and DSP Concepts are now using the platform to deliver intelligent features for every vehicle occupant.

These partners are joining a diverse ecosystem of companies developing on DRIVE IX, including Soundhound, Jungo and VisionLabs, providing cutting-edge solutions for any in-vehicle need.

DRIVE IX provides an open software stack for cockpit solution providers to build and deploy features that will turn personal vehicles into interactive environments, enabling intelligent assistants, graphic user interfaces and immersive media and entertainment.

Intelligent Assistants AI isn't just transforming the way people drive, but also how they interact with cars.

Using speech, gestures and advanced graphical user interfaces, passengers can communicate with the vehicle through an AI assistant as naturally as they would with a human.

An intelligent assistant will help to operate vehicle functions more intuitively, warn passengers in critical situations and provide services such as giving local updates like the weather forecast, making reservations and phone calls, and managing calendars.

Conversational AI Interaction Software partner Cerence is enabling AI-powered, voice-based interaction with the Cerence Assistant, its intelligent in-car assistant platform.

Cerence Assistant uses sensor data to serve drivers throughout their daily journeys, notifying them, for example, when fuel or battery levels are low and navigating to the nearest gas or charging station.

It features robust speech recognition, natural language understanding and text-to-speech capabilities, enhancing the driver experience.

Courtesy of Cerence Using DRIVE IX, it can empower both embedded and cloud-based natural language processing on the same architecture, ensuring drivers have access to important capabilities regardless of connectivity.

Cerence Assistant also supports major global markets and related languages, and is customizable for brand-specific speech recognition and personalization.

Gesture Recognition In addition to speech, passengers can interact with AI assistants via gesture, which relies on interior sensing technologies.

Smart Eye is a global leader in AI-based driver monitoring and interior sensing solutions. Its production driver-monitoring system is already in 1 million vehicles on the roads around the world, and will be incorporated in the upcoming Polestar 3, set to be revealed in October.

Working with DRIVE IX, Smart Eye's technology makes it possible to detect eye movements, facial expressions, body posture and gestures, bringing insight into people's behavior, activities and mood.

Courtesy of Smart Eye Using NVIDIA GPU technology, Smart Eye has been able to speed up its cabin-monitoring system - which consists of 10 deep neural networks running in parallel - by more than 10x.

This interior sensing is critical for safety - ensuring driver attention is on the road when it should be and detecting left-behind children or pets - and it customizes and enhances the entire mobility experience for comfort, wellness and entertainment.

Graphical User Interface AI assistants can communicate relevant information easily and clearly with high-resolution graphical interfaces. Using DRIVE IX, Rightware is creating a seamless visual experience across all cockpit and infotainment domains.

Caption: Courtesy of Rightware Rightware's automotive human-machine interface tool Kanzi One helps designers bring amazing real-time 3D graphical user interfaces into the car and hides the underlying operating system and framework complexity. Automakers can completely customize the vehicle's user interface with Kanzi One, providing a brand-specific signature UI.

Enhancing visual user interfaces by audio features is equally important for interacting with the vehicle. The Audio Weaver development platform from DSP Concepts can be integrated into the DRIVE IX advanced sound engine. It provides a sound design toolchain and audio framework to graphically design features.

Courtesy of DSP Concepts. Creators and sound artists can design a car- and brand-specific sound experience without the hassle of writing complex code for low-level audio features from scratch.

Designing in Simulation With NVIDIA DRIVE Sim on Omniverse, developers can integrate, refine and test all these new features in the virtual world before implementing them in vehicles.

Interior sensing companies can build driver- or occupant-monitoring models in the cockpit using the DRIVE Replicator synthetic-data generation tool on DRIVE Sim. Partners providing content for vehicle displays can first develop on a rich, simulated screen configuration.

Access to this virtual vehicle platform can significantly accelerate end-to-end development of intelligent in-vehicle technology.

By combining the flexibility of DRIVE IX with leading in-cabin solutions providers, spending time in the car can become a luxury rather than a chore.
LINK: https://blogs.nvidia.com/blog/2022/09/21/drive-ix-ecosystem/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

25/09/2026

SVG GameDay, Ep. 32: National Hockey Leagues John Bochiaro - Leading the Leagues In-Venue Efforts

In-venue and creative video staffers at the professional and collegiate level ha...

25/09/2026

HBS Taps Ronald den Hollander as CEO

Infront has named Ronald den Hollander as CEO of its Host Broadcast Services (HBS) subsidiary, effective 1 October 2026. The appointment follows the previously ...

25/09/2026

NABA to Host Cyber University 2.0 Cybersecurity Summit in New York

The North American Broadcasters Association (NABA) will hold Cyber University 2.0, a full-day cybersecurity summit for the broadcast and media industries, on Tu...

25/09/2026

Alpha Networks and Ateme Deliver Low-Latency Video Platform for International Sporting Event

Alpha Networks and Ateme have delivered a joint video platform for the digital d...

25/09/2026

Viaplay Migrates Free-to-Air Channels to Encompass Altitude Scheduling

Encompass Digital Media has announced the migration of multiple Viaplay free-to-air channels - TV3, TV6, TV8, and TV10 - to its Altitude Scheduling platform. Al...

25/09/2026

NAB Show New York 2026 Set for October 21-22 at Javits Center

NAB Show New York 2026 will take place October 21-22 at the Jacob K. Javits Convention Center in New York City. Registration is open at nabshow.com/newyork. Th...

25/09/2026

NHL Network to Air NHL Tonight, NHL Now, NHL Tonight: First Shift, and On The Fly During 2026-27 Season

NHL Network has announced its studio programming lineup for the 2026-27 regular ...

25/09/2026

First Baptist Nashville Installs Clear-Com Arcadia Central Station

Clear-Com has announced that First Baptist Nashville has upgraded its production communications with a Clear-Com intercom system as part of a sanctuary technolo...

25/09/2026

Broadcast Management Group Upgrades to EVS XT-VIA Platform at Cloud Control Center

Broadcast Management Group (BMG) has deployed EVS XT-VIA live video production s...

25/09/2026

BBright Adds dotCentral as U.S. Sales and Support Partner

BBright, a Hexaglobe Group company, has announced that dotCentral has joined as a sales and support partner in the United States. BBright's portfolio cover...

25/09/2026

MeyerPro Deploys ROE Visual Graphite GP 2.6 for Acumatica Summit 2026

MeyerPro delivered audio, video, broadcast, and LED production for the Acumatica Summit 2026 at the Seattle Convention Center's Summit Building, January 25-...

25/09/2026

PWHL to Hold Inaugural All-Star Weekend in Toronto on March 7

The Professional Women's Hockey League has announced its inaugural All-Star Weekend, to be held Saturday, March 7, 2026, at Scotiabank Arena in Toronto. The...

25/09/2026

Presidents Cup Makes Leap to 1080p HDR as NBC Sports, PGA TOUR Step Up Coverage

The 2026 Presidents Cup is underway at Medinah Country Club outside of Chicago with Team USA and an International Team of men's golfers facing off for four ...

25/09/2026

SVG Remote Production Forum Goes Inside WBDs Techwood Facility, Maps the Next Phase of REMI Production

Warner Bros. Discovery's Atlanta hub hosted a day of discussion on REMI prod...

25/09/2026

Antares release AutoTune Advanced

Algorithm update & new DVA vibrato-detection engine A new flagship version of Antares' iconic pitch-correction software has arrived, and along with a co...

25/09/2026

Two notes to launch the Captor X Pro

New flagship unit to arrive in early 2027 Two notes Audio Engineering have revealed that a new and improved version of their hugely popular reactive load bo...

25/09/2026

Finalist 2 from Tim Exile

AI-free mixing tool gets an upgrade Launched in October 2025, Tim Exiles Finalist is an algorithmic mixing tool that's been designed for those who don&#...

25/09/2026

Rohde & Schwarz Mobile Test Summit 2026 puts the spotlight on 6G - registrations open

Rohde & Schwarz Mobile Test Summit 2026 puts the spotlight on 6G - registrations...

25/09/2026

IBC 2026: When Intelligence Became the Industry's New Competitive Advantage

In our latest blog, Tim Pearson reflects on IBC 2026 and considers the main learnings against an industry that saw AI finally coming out of the labs and into pr...

25/09/2026

Digital Anarchy Releases Newest Version of its Real-Time Skin Retouching Tool for Video

Digital Anarchy Releases Newest Version of its Real-Time Skin Retouching Tool fo...

25/09/2026

Blackmagic Design Used on More Than 50 Summer Films in 2026

Blackmagic Design Used on More Than 50 Summer Films in 2026 Brie Clayton September 25, 2026 0 Comments Hero image: Disclosure Day Blackmagic Design p...

25/09/2026

How I Automated Social Media Resizing in After Effects - Free Script

How I Automated Social Media Resizing in After Effects - Free Script Graham Quince September 25, 2026 0 Comments If your text keeps getting cut off on...

25/09/2026

IBC2026 celebrates collaborative breakthroughs as it anno...

IBC has unveiled the winners of the prestigious IBC2026 Innovation Awards at an event held at the RAI Amsterdam on Sunday 13 September, honouring collaborative ...

25/09/2026

IBC2026 brings global media industry together to turn inn...

IBC2026 brought the global media, entertainment and technology community together for four days of business, innovation and collaboration at the RAI Amsterdam. ...

25/09/2026

Lightware Helps Integrators Overcome MacBook Neo USB Topo...

Lightware testing has revealed that each USB-C port on Apple's new MacBook Neo consumes three of the seven USB tiers available under the USB specification, ...

25/09/2026

Lightware Expands Education Support With New Products and...

Lightware is supporting educational institutions in building modern learning environments by combining professional training with education-focused AV technolog...

25/09/2026

Study: Only 10% of Young Adults Watched Local TV News Last Week

Share Copy link Facebook X Linkedin Bluesky Email...

25/09/2026

Optimum, A+E Global Media Sign New Distribution Agreement

Share Copy link Facebook X Linkedin Bluesky Email...

25/09/2026

MPA, Unions Back 'Motion Picture, Television, and Entertainment Revitalization Act

Share Copy link Facebook X Linkedin Bluesky Email...

25/09/2026

NAB Show New York Announces More Speakers and Programming Highlights

Share Copy link Facebook X Linkedin Bluesky Email...

25/09/2026

Comcast NBCU, NBCUniversal Local Award $2.5 Million to Nonprofits

Share Copy link Facebook X Linkedin Bluesky Email...

25/09/2026

Orange Belgium Strengthens Its Consumer and B2B TV Servic...

Long-Standing Customer Renews Multiyear Contract for VO's Secure Video Player, Content Security, and Device Monitoring Solutions Viaccess-Orca (VO), a glob...

25/09/2026

Automate Video Progress Bars in After Effects - No Keyframes!

Automate Video Progress Bars in After Effects - No Keyframes! Graham Quince September 24, 2026 0 Comments Learn how to create an automated video playb...

25/09/2026

How to watch an unmissable weekend of womens football on Sky Sports and NOW

Friday 25 September 2026 How to watch an unmissable weekend of women's football on Sky Sports and NOW Sky Sports and NOW will broadcast seven live games f...

25/09/2026

YAGA trailer released, coming exclusively to Sky and NOW on 31 October in the UK and Ireland

Friday 25 September 2026 YAGA trailer released, coming exclusively to Sky and N...

25/09/2026

'Watch this space: a new strategic direction for UK media'.

Watch this space: a new strategic direction for UK media. Arqiva has submitted its response to the Governments Green Paper on the future of television distribut...

25/09/2026

Last chance to apply to be part of this year's Late Late Toy Show

Want to be part of this year's Late Late Toy Show? Final call for applications in search for this year's stars The most wonderful night of the year is...

24/09/2026

Broadcast Management Group Assists Virginia Public Media With Move to New HQ in Richmond

Broadcast Management Group (BMG) is supporting Virginia Public Media (VPM), the ...

24/09/2026

Two Red Digital Cinema Cameras Receive GhostFrame Pro Certification

RED Digital Cinema's RED V-RAPTOR [X] and RED V-RAPTOR XL [X] cameras with the Phantom Track feature are the first cameras to receive GhostFrame Pro Certifi...

24/09/2026

FOX Sports Adds 4K Live Stream on Tubi to List of Available Options for Cowboys-Eagles on Thanksgiving Day

Bringing together the full family of networks, FOX Sports is also adding Tubi, F...

24/09/2026

Virginia Techs Lane Stadium Invests in Gameday Experience with New Daktronics LED Display, Audio Solutions

Virginia Polytechnic Institute and State University (Virginia Tech) has unveiled...

24/09/2026

SVG AI Innovation Lab Blog Tracks How AI Is Reshaping Live Sports Production

The blog collects SVG's reporting on AI across U.S. and European sports broadcasting Since SVG launched the AI Innovation Lab in April to advance the devel...

24/09/2026

SVG TranSPORT Keynote Conversation: How FOX Built a Transcontinental Transmission Backbone for the FIFA World Cup

SVG's annual TranSPORT conference, which will be held on Tuesday, Oct. 20 in...

24/09/2026

FloSports is Using AI To Build a New Generation of Live Production Tools to Bolster the Streamer's Internal Operations

The self-built Master Control Room has cut streaming operations incident-respo...

24/09/2026

Ortana Links AudioShake, ScorePlay for Live and Archive Audio Cleanup

Ortana Media Group, the software systems integrator behind the Cubix workflow platform, has connected AudioShake's audio separation models to ScorePlay thro...

24/09/2026

AudioShake Debuts Multi-Speaker 2.0 for Separating Overlapping Voices

AudioShake has released Multi-Speaker 2.0, the company's newest Multi-Speaker model, which removes 75% more noise and offers 32% better separation of overla...

24/09/2026

Op-Ed: Planning Media Day When the Calendar Isn't Certain - How MLB Clubs Can Prepare for 2027 Now

By Jon Morgan, Founder and Executive Producer, Ryval Studios For Major League B...