
Editor's note: This is the latest post in our NVIDIA DRIVE Labs series, which takes an engineering-focused look at individual autonomous vehicle challenges and how NVIDIA DRIVE addresses them. Catch up on all of our automotive posts, here.
Even with advanced driver assistance systems automating more driving functions, human drivers must maintain their attention at the wheel and build trust in the AI system.
Traditional driver monitoring systems typically don't understand subtle cues such as a driver's cognitive state, behavior or other activity that indicates whether they're ready to take over the driving controls.
NVIDIA DRIVE IX is an open, scalable cockpit software platform that provides AI functions to enable a full range of in-cabin experiences, including intelligent visualization with augmented reality and virtual reality, conversational AI and interior sensing.
Driver perception is a key aspect of the platform that enables the AV system to ensure a driver is alert and paying attention to the road. It also enables the AI system to perform cockpit functions that are more intuitive and intelligent.
In this DRIVE Labs episode, NVIDIA experts demonstrate how DRIVE IX perceives driver attention, activity, emotion, behaviour, posture, speech, gesture and mood with a variety of detection capabilities.
A Multi-DNN Approach Facial expressions are complex signals to interpret. A simple wrinkle of the brow or shift of the gaze can have a variety of meanings.
DRIVE IX uses multiple DNNs to recognize faces and decipher the expressions of vehicle occupants. The first DNN detects the face itself, while a second identifies fiducial points, or reference markings - such as eye location, nose, etc.
On top of these base networks, a variety of DNNs operate to determine whether a driver is paying attention or requires other actions from the AI system.
The GazeNet DNN tracks gazes by detecting the vector of the driver's eyes and mapping it to the road to check if they're able to see obstacles ahead. SleepNet monitors drowsiness, classifying whether eyes are open or closed, running through a state machine to determine levels of exhaustion. Finally, ActivityNet tracks driver activity such as phone usage, hands on/off the wheel and driver attention to road events. DRIVE IX can also detect whether the driver is properly sitting in their seat to focus on road events.
In addition to driver focus, a separate DNN can determine a driver's emotions - a key indicator of their ability to safely operate the vehicle. Taking in data from the base face-detect and fiducial-point networks, DRIVE IX can classify a driver's state as happy, surprised, neutral, disgusted or angry.
It can also tell if the driver is squinting or screaming, indicating their level of visibility or alertness and state of mind.
A Customizable Solution Vehicle manufacturers can leverage the driver monitoring capabilities in DRIVE IX to develop advanced AI-based driver understanding capabilities for personalizing the car cockpit.
The car can be programmed to alert a driver if their attention drifts from the road, or the cabin can adjust settings to soothe occupants if tensions are high.
And these capabilities extend well beyond driver monitoring. The aforementioned DNNs, together with gesture DNN and speech capabilities, enable multi-modal conversational AI offerings such as automatic speech recognition, natural language processing and speech synthesis.
These networks can be used for in-cabin personalization and virtual assistant applications. Additionally, the base facial recognition and facial key point models can be used for AI-based video conferencing platforms.
The driver monitoring capabilities of DRIVE IX help build trust between occupants and the AI system as automated driving technology develops, creating a safer, more enjoyable intelligent vehicle experience.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
09/10/2026
September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026
New Sports Intelligence helps providers better unders...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
25/09/2026
Digital Anarchy Releases Newest Version of its Real-Time Skin Retouching Tool fo...
25/09/2026
Blackmagic Design Used on More Than 50 Summer Films in 2026
Brie Clayton September 25, 2026
0 Comments
Hero image: Disclosure Day
Blackmagic Design p...
25/09/2026
How I Automated Social Media Resizing in After Effects - Free Script
Graham Quince September 25, 2026
0 Comments
If your text keeps getting cut off on...
25/09/2026
IBC has unveiled the winners of the prestigious IBC2026 Innovation Awards at an event held at the RAI Amsterdam on Sunday 13 September, honouring collaborative ...
25/09/2026
IBC2026 brought the global media, entertainment and technology community together for four days of business, innovation and collaboration at the RAI Amsterdam. ...
25/09/2026
Lightware testing has revealed that each USB-C port on Apple's new MacBook Neo consumes three of the seven USB tiers available under the USB specification, ...
25/09/2026
Lightware is supporting educational institutions in building modern learning environments by combining professional training with education-focused AV technolog...
25/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
25/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
25/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
25/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
25/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
25/09/2026
Long-Standing Customer Renews Multiyear Contract for VO's Secure Video Player, Content Security, and Device Monitoring Solutions
Viaccess-Orca (VO), a glob...
25/09/2026
Automate Video Progress Bars in After Effects - No Keyframes!
Graham Quince September 24, 2026
0 Comments
Learn how to create an automated video playb...
25/09/2026
Want to be part of this year's Late Late Toy Show?
Final call for applications in search for this year's stars
The most wonderful night of the year is...
24/09/2026
Broadcast Management Group (BMG) is supporting Virginia Public Media (VPM), the ...
24/09/2026
RED Digital Cinema's RED V-RAPTOR [X] and RED V-RAPTOR XL [X] cameras with the Phantom Track feature are the first cameras to receive GhostFrame Pro Certifi...
24/09/2026
Bringing together the full family of networks, FOX Sports is also adding Tubi, F...
24/09/2026
Virginia Polytechnic Institute and State University (Virginia Tech) has unveiled...
24/09/2026
The blog collects SVG's reporting on AI across U.S. and European sports broadcasting
Since SVG launched the AI Innovation Lab in April to advance the devel...
24/09/2026
SVG's annual TranSPORT conference, which will be held on Tuesday, Oct. 20 in...
24/09/2026
The self-built Master Control Room has cut streaming operations incident-respo...
24/09/2026
Ortana Media Group, the software systems integrator behind the Cubix workflow platform, has connected AudioShake's audio separation models to ScorePlay thro...
24/09/2026
AudioShake has released Multi-Speaker 2.0, the company's newest Multi-Speaker model, which removes 75% more noise and offers 32% better separation of overla...
24/09/2026
By Jon Morgan, Founder and Executive Producer, Ryval Studios
For Major League B...
24/09/2026
Spectrum SportsNet has revealed its comprehensive programming and live game broa...
24/09/2026
The Charlotte Hornets has unveiled new broadcast partnerships with Gray Media an...
24/09/2026
DAZN will be the exclusive direct-to-consumer streaming partner for the Detroit Pistons beginning with the 2026-27 season. Subscriptions are available at DAZN.c...
24/09/2026
The National Hockey League (NHL) has made an agreement with Spectrum that will allow Spectrum TV customers in the Minnesota Wild local broadcast territory to wa...
24/09/2026
The Carolina Hurricanes has reached a multi-year distribution agreement to provi...
24/09/2026
The St. Louis Blues has introduced Blue Note as the name of the new, exclusive ...
24/09/2026
Blue Jackets Hockey Network, the television home for Blue Jackets hockey, is coming to Spectrum TV under a new carriage agreement between the National Hockey Le...
24/09/2026
The next generation of multitrack recording for live sound
The latest version of Waves' dedicated live multitrack recording software delivers an array ...
24/09/2026
An idea machine for musicians
Described as an idea machine for musicians , the latest addition to Polyend's growing collection of guitar pedals combin...
24/09/2026
Alignment tool gains multitrack layout
Synchro Arts have just launched the latest version of their renowned time-alignment plug-in, and it's said to be ...
24/09/2026
Synth gains DAW Control & Ctrl-e integration
Expressive E have just released a major firmware update that brings some interesting new features to the Osmose...
24/09/2026
Rohde & Schwarz expands its system amplifier portfolio with the R&S SAM200 for a...
24/09/2026
September 24, 2026
The Hitachi Startup Challenge FY26 invites innovative startu...
24/09/2026
Download Now!
To receive a short case study showcasing NHK Technologies, Inc. (NT) s audio setup, please enter the following details:
--
First Name* Fir...
24/09/2026
Manifold Technologies Appoints Ryhaan Williams as CCO for North America
Brie Clayton September 24, 2026
0 Comments
Brings three decades of broadcast e...
24/09/2026
UNIFACHA Expands Educational Program with DaVinci Resolve Studio
Brie Clayton September 24, 2026
0 Comments
Brazilian university empowers next generat...
24/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
24/09/2026
Viewers watching videos from the Austrian Parliament online will soon find it easier to verify the authenticity of the content. Big Blue Marble, an internationa...
24/09/2026
nsign, the digital signage SaaS platform built around its Simplify Complexity principle, is now officially certified for BRAVIA Professional Displays from Son...
24/09/2026
Encompass Digital Media today announced the successful migration of multiple Viaplay free-to-air channels, including TV3, TV6, TV8 and TV10, to its Altitude Sch...
24/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
24/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...