
Editor's note: This is the latest post in our NVIDIA DRIVE Labs series, which takes an engineering-focused look at individual autonomous vehicle challenges and how NVIDIA DRIVE addresses them. Catch up on all of our automotive posts, here.
Even with advanced driver assistance systems automating more driving functions, human drivers must maintain their attention at the wheel and build trust in the AI system.
Traditional driver monitoring systems typically don't understand subtle cues such as a driver's cognitive state, behavior or other activity that indicates whether they're ready to take over the driving controls.
NVIDIA DRIVE IX is an open, scalable cockpit software platform that provides AI functions to enable a full range of in-cabin experiences, including intelligent visualization with augmented reality and virtual reality, conversational AI and interior sensing.
Driver perception is a key aspect of the platform that enables the AV system to ensure a driver is alert and paying attention to the road. It also enables the AI system to perform cockpit functions that are more intuitive and intelligent.
In this DRIVE Labs episode, NVIDIA experts demonstrate how DRIVE IX perceives driver attention, activity, emotion, behaviour, posture, speech, gesture and mood with a variety of detection capabilities.
A Multi-DNN Approach Facial expressions are complex signals to interpret. A simple wrinkle of the brow or shift of the gaze can have a variety of meanings.
DRIVE IX uses multiple DNNs to recognize faces and decipher the expressions of vehicle occupants. The first DNN detects the face itself, while a second identifies fiducial points, or reference markings - such as eye location, nose, etc.
On top of these base networks, a variety of DNNs operate to determine whether a driver is paying attention or requires other actions from the AI system.
The GazeNet DNN tracks gazes by detecting the vector of the driver's eyes and mapping it to the road to check if they're able to see obstacles ahead. SleepNet monitors drowsiness, classifying whether eyes are open or closed, running through a state machine to determine levels of exhaustion. Finally, ActivityNet tracks driver activity such as phone usage, hands on/off the wheel and driver attention to road events. DRIVE IX can also detect whether the driver is properly sitting in their seat to focus on road events.
In addition to driver focus, a separate DNN can determine a driver's emotions - a key indicator of their ability to safely operate the vehicle. Taking in data from the base face-detect and fiducial-point networks, DRIVE IX can classify a driver's state as happy, surprised, neutral, disgusted or angry.
It can also tell if the driver is squinting or screaming, indicating their level of visibility or alertness and state of mind.
A Customizable Solution Vehicle manufacturers can leverage the driver monitoring capabilities in DRIVE IX to develop advanced AI-based driver understanding capabilities for personalizing the car cockpit.
The car can be programmed to alert a driver if their attention drifts from the road, or the cabin can adjust settings to soothe occupants if tensions are high.
And these capabilities extend well beyond driver monitoring. The aforementioned DNNs, together with gesture DNN and speech capabilities, enable multi-modal conversational AI offerings such as automatic speech recognition, natural language processing and speech synthesis.
These networks can be used for in-cabin personalization and virtual assistant applications. Additionally, the base facial recognition and facial key point models can be used for AI-based video conferencing platforms.
The driver monitoring capabilities of DRIVE IX help build trust between occupants and the AI system as automated driving technology develops, creating a safer, more enjoyable intelligent vehicle experience.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
06/09/2026
June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...
06/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
06/08/2026
At this year's SET EXPO, PlayBox Neo will present recent innovations across its PlayBox Neo Suite and integrated range of broadcast media solutions. By show...
06/08/2026
Live demo at IBC2026 VisualOn Booth, Hall 5, Stand A55
Amsterdam, Netherlands Modern Streaming Solutions Private Limited, a rising force in India's dig...
06/08/2026
Screen Australia and YouTube Australia fund five new teams through eleventh Skip...
06/08/2026
How Karukera Studio Built a Media Production Hub with SNS EVO
Melanie Ciotti August 5, 2026
0 Comments
Hero images displays Karukera Studio in Sainte-...
06/08/2026
NHK drama series Rosanjin no Kamado shot on PYXIS 6K
Brie Clayton August 5, 2026
0 Comments
Blackmagic PYXIS 6K and DaVinci Resolve Studio capture the...
06/08/2026
Camera Match: AutoSetup 3d Plugin / script for Photomontages- Cinema 4D
Jamie Cardoso August 5, 2026
0 Comments
If you do any kind of Architectural Vi...
05/08/2026
Thomson's Climate Crisis Toolkit for Media in Tanzania is being included in a new virtual library designed to ensure accurate and engaging storytelling arou...
05/08/2026
RSNs, teams, leagues, and streamers explore the present and future of local spor...
05/08/2026
As sports-production workflows generate larger volumes of unstructured data and ...
05/08/2026
Three aspiring broadcasters will contribute on-camera and inside the production ...
05/08/2026
Adam Meeks attends the premiere of his film Union County, an official selection of the 2026 Sundance Film Festival. (Photo by Jemal Countess/Sundance Institut...
05/08/2026
Major discounts, updates & remakes of early VST plug-ins
Steinberg are currently celebrating two significant anniversaries, with this week marking the 30th ...
05/08/2026
Flagship monitor range gains wireless remote control
KRK's flagship studio monitor range has just been upgraded, with three new fifth-generation models ...
05/08/2026
Rohde & Schwarz launches next phase of Airways New Zealand Air Traffic Control s...
05/08/2026
Rohde & Schwarz presents the R&S MP007, a man-portable tactical direction findin...
05/08/2026
Advertisers invested $53.6 million in the retirement sector in the last 12 month...
05/08/2026
Nielsen CMI and Ad Intel data reveals who's visiting IKEA, where else they s...
05/08/2026
Media buyers and sellers can now compare deduplicated campaign reach across computer, mobile, connected TV and linear TV across all measurable CTV publishers in...
05/08/2026
Stranger Things' Leads All Streaming Titles with 23.3 Billion Minutes in Fir...
05/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
05/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
05/08/2026
QuickLink, the leading provider of award-winning video production and remote guest integration solutions, announces the appointment of Kane Peterson to its Nort...
05/08/2026
XR research reveals marketers believe they have control over production costs, yet budget overruns, campaign delays and creative cutbacks remain commonplace
Se...
05/08/2026
Game On Live Studio Uses Blackmagic Design to Stream Tropical 7s
Brie Clayton August 4, 2026
0 Comments
Every match of world's largest youth rugby...
05/08/2026
Chris Fitzgerald to Head TDC's Experiential Growth
Brie Clayton August 4, 2026
0 Comments
Technical Direction Company promotes Chris Fitzgerald to...
05/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
05/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
05/08/2026
Profuz Digital is set to launch a powerful upgrade to its Profuz LAPIS digital media management platform at IBC this year at Stand 8.A88. France Galop, Canal+ F...
05/08/2026
KRK, a Gibson brand and leader in professional studio monitoring for nearly four decades, launches its new V Series Five Studio Monitors, the latest evolution o...
05/08/2026
Network expansion, continued customer growth and stable financial performance characterized Magyar Telekoms business results for the first half and second quart...
05/08/2026
Wednesday 5 August 2026
The Sky Foundation launches new bursary programme to su...
05/08/2026
Charlie Sheen Launches Mostly Sheenius in Partnership with Red Seat Ventures After Decades as One of the World's Most Recognizable and Interviewed Celebr...
04/08/2026
Live production in the cloud is a growing trend across the industry, and Major L...
04/08/2026
LAFC co-managing owner will succeed Don Garber on Jan. 1, 2027, as league prepar...
04/08/2026
In 2022, when the PGA TOUR was breaking ground on its new, state-of-the-art broa...
04/08/2026
Provided by POVORA, the new camera angle offers a dealer's-eye view of the c...
04/08/2026
Spiideo will provide the camera setup, with NEP handling broadcast integration and off-site video operations...
04/08/2026
Production team streamed more than 750 youth rugby matches using ATEM switchers,...
04/08/2026
Agreement gives KTC early access to NDI's Advanced SDK for integration across commercial displays, digital signage, and interactive panels...
04/08/2026
Twelve projects across four categories recognize collaborative work in productio...
04/08/2026
Multi-year agreement will introduce SkeleTRACK, semi-automated offside, automate...