
Editor's note: This is the latest post in our NVIDIA DRIVE Labs series, which takes an engineering-focused look at individual autonomous vehicle challenges and how NVIDIA DRIVE addresses them. Catch up on all of our automotive posts, here.
Even with advanced driver assistance systems automating more driving functions, human drivers must maintain their attention at the wheel and build trust in the AI system.
Traditional driver monitoring systems typically don't understand subtle cues such as a driver's cognitive state, behavior or other activity that indicates whether they're ready to take over the driving controls.
NVIDIA DRIVE IX is an open, scalable cockpit software platform that provides AI functions to enable a full range of in-cabin experiences, including intelligent visualization with augmented reality and virtual reality, conversational AI and interior sensing.
Driver perception is a key aspect of the platform that enables the AV system to ensure a driver is alert and paying attention to the road. It also enables the AI system to perform cockpit functions that are more intuitive and intelligent.
In this DRIVE Labs episode, NVIDIA experts demonstrate how DRIVE IX perceives driver attention, activity, emotion, behaviour, posture, speech, gesture and mood with a variety of detection capabilities.
A Multi-DNN Approach Facial expressions are complex signals to interpret. A simple wrinkle of the brow or shift of the gaze can have a variety of meanings.
DRIVE IX uses multiple DNNs to recognize faces and decipher the expressions of vehicle occupants. The first DNN detects the face itself, while a second identifies fiducial points, or reference markings - such as eye location, nose, etc.
On top of these base networks, a variety of DNNs operate to determine whether a driver is paying attention or requires other actions from the AI system.
The GazeNet DNN tracks gazes by detecting the vector of the driver's eyes and mapping it to the road to check if they're able to see obstacles ahead. SleepNet monitors drowsiness, classifying whether eyes are open or closed, running through a state machine to determine levels of exhaustion. Finally, ActivityNet tracks driver activity such as phone usage, hands on/off the wheel and driver attention to road events. DRIVE IX can also detect whether the driver is properly sitting in their seat to focus on road events.
In addition to driver focus, a separate DNN can determine a driver's emotions - a key indicator of their ability to safely operate the vehicle. Taking in data from the base face-detect and fiducial-point networks, DRIVE IX can classify a driver's state as happy, surprised, neutral, disgusted or angry.
It can also tell if the driver is squinting or screaming, indicating their level of visibility or alertness and state of mind.
A Customizable Solution Vehicle manufacturers can leverage the driver monitoring capabilities in DRIVE IX to develop advanced AI-based driver understanding capabilities for personalizing the car cockpit.
The car can be programmed to alert a driver if their attention drifts from the road, or the cabin can adjust settings to soothe occupants if tensions are high.
And these capabilities extend well beyond driver monitoring. The aforementioned DNNs, together with gesture DNN and speech capabilities, enable multi-modal conversational AI offerings such as automatic speech recognition, natural language processing and speech synthesis.
These networks can be used for in-cabin personalization and virtual assistant applications. Additionally, the base facial recognition and facial key point models can be used for AI-based video conferencing platforms.
The driver monitoring capabilities of DRIVE IX help build trust between occupants and the AI system as automated driving technology develops, creating a safer, more enjoyable intelligent vehicle experience.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
06/09/2026
June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
30/06/2026
Other World Computing Launches New Atlas Core Line with 256GB CFExpress 4.0 Type...
30/06/2026
DaVinci Resolve Studio Used for Taketoshi Sado's Perfume Cold Sleep -25 year...
29/06/2026
By Andy Rayner, CTO, Appear
The 2026 FIFA World Cup is the largest football tou...
29/06/2026
A new multi-country study from ESL FACEIT Group, Hero Esports, and Niko Partners estimates that 400 million Gen Z consumers regularly engage with esports, under...
29/06/2026
ESPN will mark America's 250th anniversary with a series of content initiatives across its linear, digital, and streaming platforms, including a special edi...
29/06/2026
The Esports Foundation has named OBSBOT the Official Camera and Webcam Partner for the Esports World Cup 2026, bringing the company's AI-powered imaging tec...
29/06/2026
Insight Productions has launched Insight Storm, a 53-foot mobile broadcast unit designed specifically for esports production, live entertainment, and digital-fi...
29/06/2026
Gravity Media once again provided broadcast, streaming, and content-distribution...
29/06/2026
The All England Lawn Tennis Club and IBM have introduced new and enhanced digita...
29/06/2026
Four-layer instrument aimed at dark electronic music
Excite Audio's latest software instrument has been designed with dark drum and bass, atmospheric te...
29/06/2026
New AI Assistant, Multi-channel Audio, ARA2 improvements & more
Tracktion's DAW software has just received its latest major update, gaining a selection ...
29/06/2026
Details environmental policies & results
The Focusrite Group have just announced that following a long audit process, they have published their 2026 sustain...
29/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/06/2026
CVP, one of Europes leading suppliers of professional video and broadcast solutions, has announced the launch of CVP Warranty , a new extended warranty programm...
29/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
29/06/2026
Anthropic's Claude models in Microsoft Foundry - hosted on Microsoft Azure a...
29/06/2026
Arvato Systems Achieves AWS Cloud Operations Competency
The team behind the AWS Cloud Operations Competency (from left to right: Philipp Hellmich, Johanna Bod...
29/06/2026
RT today announced that Ger Gilroy will join the RT Podcasts team to present a daily sports podcast. Launching later this year, the new show will set the spor...
29/06/2026
RT Commercial announced OUTsurance as sponsor of the Oliver Callan show on RT Radio 1 from Wednesday 1 July.
Oliver Callan doubles the fun, delivering two ...
29/06/2026
Showcasing the importance of open source innovation in American AI, Palantir'...
28/06/2026
Half-size model joins Console 1 line-up
Shortly after the release of their new Flow Studio controller, Softube have announced the launch of another new surf...
28/06/2026
New EXO Series DSP control software announced
EVE Audio's EXO Series monitor range has just gained a new software element that provides remote access to...
28/06/2026
Freedman Labs Releases PrepMyMedia and ViewMyAttic for Post Production Professio...
27/06/2026
There's no doubt that you've seen the world through Amy Vincent's ey...
27/06/2026
Brings together saturation & lo-fi effects
Following on from the release of their Voxcraft vocal-processing plug-in, UJAM have announced the launch of Retro...
27/06/2026
A record 4.84 million Australians choose SBS as the Socceroos advance at FIFA Wo...
27/06/2026
Why CRAS Upgraded to Symphony I/O MK II When an audio school runs studios all day, every day, gear doesn't just need to sound good , it needs to survive rea...
27/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
27/06/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
27/06/2026
Krotos Video to Sound Plugin Now Available for Adobe Premiere Pro
Brie Clayton June 26, 2026
0 Comments
Editors can analyze footage, generate synchron...
27/06/2026
Mirai Media Elevates Digital and Broadcast Productions with Blackmagic Design
Brie Clayton June 26, 2026
0 Comments
Studio uses Ultimatte 12 HD and Po...
27/06/2026
DURHAM, N.C. - JUNE 26, 2026 - Lutra Cafe & Bakery has opened its first brick-and-mortar location at American Tobacco Campus after owner Chris McLaurin operated...
26/06/2026
In-venue and creative video staffers at the professional and collegiate level ha...
26/06/2026
Strike Fighter League (SFL), a professional air combat digital sport combining f...
26/06/2026
Wisycom has announced three new additions to its professional wireless ecosystem...
26/06/2026
Eurovision Services inaugurated an expanded Master Control Room (MCR) in Madrid on June 1, 2026, building on a broadcast hub the company has operated in the cit...
26/06/2026
Midco Sports and the University of North Dakota (UND) have announced a two-year ...
26/06/2026
Guntermann and Drunck (G&D) and VuWall, both part of the Panoptec Technologies Group, have appointed Vutec (Pty) Ltd as exclusive distributor for their KVM and ...
26/06/2026
Visit Seattle, the official destination marketing organization for Seattle and King County, has launched what it describes as the world's first drone scoreb...
26/06/2026
CP Communications provided RF video, audio, and crew communications support for ...
26/06/2026
Produced by longtime partner Echo Entertainment, the action-sports property is now a team-based year-round league
The inaugural season of the MoonPay X Games L...
26/06/2026
The deal establishes MultiDyne Robotics and Motion Control, maintaining the well-known MRMC brand.MultiDyne Video & Fiber Optic Systems has acquired the assets ...
26/06/2026
PX1 will debut at Sonoma as TNT leans into super-slo-mo, drones, SMT data integr...
26/06/2026
Ratings Roundup is a rundown of recent rating news and is derived from press rel...