
Editor's note: This is the latest post in our NVIDIA DRIVE Labs series, which takes an engineering-focused look at individual autonomous vehicle challenges and how NVIDIA DRIVE addresses them. Catch up on all of our automotive posts, here.
Even with advanced driver assistance systems automating more driving functions, human drivers must maintain their attention at the wheel and build trust in the AI system.
Traditional driver monitoring systems typically don't understand subtle cues such as a driver's cognitive state, behavior or other activity that indicates whether they're ready to take over the driving controls.
NVIDIA DRIVE IX is an open, scalable cockpit software platform that provides AI functions to enable a full range of in-cabin experiences, including intelligent visualization with augmented reality and virtual reality, conversational AI and interior sensing.
Driver perception is a key aspect of the platform that enables the AV system to ensure a driver is alert and paying attention to the road. It also enables the AI system to perform cockpit functions that are more intuitive and intelligent.
In this DRIVE Labs episode, NVIDIA experts demonstrate how DRIVE IX perceives driver attention, activity, emotion, behaviour, posture, speech, gesture and mood with a variety of detection capabilities.
A Multi-DNN Approach Facial expressions are complex signals to interpret. A simple wrinkle of the brow or shift of the gaze can have a variety of meanings.
DRIVE IX uses multiple DNNs to recognize faces and decipher the expressions of vehicle occupants. The first DNN detects the face itself, while a second identifies fiducial points, or reference markings - such as eye location, nose, etc.
On top of these base networks, a variety of DNNs operate to determine whether a driver is paying attention or requires other actions from the AI system.
The GazeNet DNN tracks gazes by detecting the vector of the driver's eyes and mapping it to the road to check if they're able to see obstacles ahead. SleepNet monitors drowsiness, classifying whether eyes are open or closed, running through a state machine to determine levels of exhaustion. Finally, ActivityNet tracks driver activity such as phone usage, hands on/off the wheel and driver attention to road events. DRIVE IX can also detect whether the driver is properly sitting in their seat to focus on road events.
In addition to driver focus, a separate DNN can determine a driver's emotions - a key indicator of their ability to safely operate the vehicle. Taking in data from the base face-detect and fiducial-point networks, DRIVE IX can classify a driver's state as happy, surprised, neutral, disgusted or angry.
It can also tell if the driver is squinting or screaming, indicating their level of visibility or alertness and state of mind.
A Customizable Solution Vehicle manufacturers can leverage the driver monitoring capabilities in DRIVE IX to develop advanced AI-based driver understanding capabilities for personalizing the car cockpit.
The car can be programmed to alert a driver if their attention drifts from the road, or the cabin can adjust settings to soothe occupants if tensions are high.
And these capabilities extend well beyond driver monitoring. The aforementioned DNNs, together with gesture DNN and speech capabilities, enable multi-modal conversational AI offerings such as automatic speech recognition, natural language processing and speech synthesis.
These networks can be used for in-cabin personalization and virtual assistant applications. Additionally, the base facial recognition and facial key point models can be used for AI-based video conferencing platforms.
The driver monitoring capabilities of DRIVE IX help build trust between occupants and the AI system as automated driving technology develops, creating a safer, more enjoyable intelligent vehicle experience.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
02/05/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
01/05/2026
January 5 2026, 18:30 (PST) NBCUniversal's Peacock to Be First Streamer to ...
01/04/2026
As sports media organization continue to seek out new ways to streamline their p...
01/04/2026
The SVG GFX Forum hit New York City earlier this month for a day packed with sessions focused on the creative strategy and technology behind today's cutting...
01/04/2026
This year, Spotify celebrates the five-year anniversary of EQUAL, our global pro...
01/04/2026
Analogue-style tape splicing in the digital domain
In this era of digital recording and multiple layers of Undo, it seems that the fading art of tape splici...
01/04/2026
Latest release introduces new Orbita Engine
Zero G's latest release marks the start of a new series of libraries, as well as introducing an all-new engi...
01/04/2026
Until now, one format has largely been left behind
Warm Audio's extensive product range includes modern-day recreations of all manner of sought-after s...
01/04/2026
A piano with glass vessels for strings!
The Crow Hill Company's recently released Gong Piano offered a refreshing new take on piano libraries, harnessin...
01/04/2026
Remote Streaming Studio Condenser
Aim Audio have just revealed their latest creation, the ESSENCE RS Remote Streaming Studio Condenser, which becomes the wo...
01/04/2026
The National Film and Video Foundation (NFVF) is pleased to announce that the ca...
01/04/2026
Bilbao, April 1st, 2026 - AgileTV, a leading provider of end-to-end TV technolog...
01/04/2026
Green Hippo is excited to announce the launch of its new Hippotizer Media Server training courses at Pixel Academy, a purpose built AV learning hub combining ha...
01/04/2026
TAG Video Systems, a global leader in IP-native broadcast monitoring, multiviewing, and quality control, today announced a collaboration with Oracle Cloud Infra...
01/04/2026
Professional Wireless Systems (PWS), a leading provider of wireless audio solutions and RF management, was on site at the Caesars Superdome in New Orleans, wher...
01/04/2026
AgileTV, a leading provider of end-to-end TV technology solutions, has deployed next , the new IPTV platform of the Austrian telco LIWEST, marking the first st...
01/04/2026
LTN, a leader in fully managed IP video transport, and Ateme, a global leader in video compression and delivery solutions, today announced a collaboration integ...
01/04/2026
Adobe Unveils Powerful New Innovations for Creative Pros in Adobe Illustrator
Deepa Subramaniam April 1, 2026
0 Comments
I'm excited to share that...
01/04/2026
Boland Communications Introduces QD4K315HDR10 QD-OLED Series Monitors for Live P...
01/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
01/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
01/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
01/04/2026
Mediagenix Showcases Semantic Intelligence-Powered Title Management, Schedule Op...
01/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
01/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
01/04/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
01/04/2026
Victoria Mon t Brings the Multi-Hyphenate Mindset to Career Jam 2026 The Grammy-winning singer, songwriter, and producer shared how versatility and self-inves...
01/04/2026
A New Season of Expression: Save 30% On Ivory 3There are moments in music when everything changes-when new ideas break through and redefine what's possible....
01/04/2026
Wuppertal April 1, 2026
Binghamton University Strengthens Student Run Producti...
01/04/2026
Back to All News
A Demon Falls for a Human in Long Vacation: Netflix Greenlight...
01/04/2026
Back to All News
All WWE Is Now Live Only on Netflix in Italy
Entertainment
01 April 2026
GlobalItaly
Link copied to clipboard
ALL WWE IS NOW LIVE
ON NET...
01/04/2026
Harmonic's Media Processing Solutions Maximize Bandwidth Efficiency for Terrestrial Broadcast Delivery SAN JOSE, Calif. - April 1, 2026 - Harmonic (NASDAQ: ...
01/04/2026
Rugby fans won't miss a moment of the action this spring, with full Women...
01/04/2026
T Bluey ag teacht go RT ! Beginning on Monday 6 April 2026, Bluey will be available as Gaeilge on RT KIDSjr and RT Player. Children will be able to connect w...
01/04/2026
January 4 2026, 18:00 (PST) DOLBY AND DOUYIN EMPOWER THE NEXT GENERATON OF CREATORS WITH DOLBY VISION
Douyin Users Can Now Create And Share Videos With Stun...
31/03/2026
MeyerPro delivered the LED production for the Microsoft Ignite 2025 keynote at Chase Center in San Francisco, using more than 2,700 ROE Visual panels across mul...
31/03/2026
The Media Coding Industry Forum (MC-IF) is expanding membership outreach in 2026...
31/03/2026
ViewLift and MyOutdoorTV (MOTV) have announced the launch of ViewLift Conversational AI Search on the MyOutdoorTV platform. The feature enables natural language...
31/03/2026
The Atlanta Braves and Gray Media have announced a multi-year agreement to simul...
31/03/2026
Gravity Media has delivered broadcast services for TAB Golden Slipper Day at Rosehill Gardens on March 21 and will now cover The Star Championships at Royal Ran...
31/03/2026
Synamedia has announced that Mileto Tecnologia, a Brazilian pay-TV operator, has selected the Synamedia Go platform for its OTT expansion. Mileto is also deploy...
31/03/2026
KMH Integration will attend NAB Show in Las Vegas with a focus on what the company calls AV Casting - an approach built on the idea that professional AV and bro...
31/03/2026
Prime Video will carry live coverage of the first and second rounds of the 2026 Masters Tournament, beginning at 1:00 p.m. ET on Thursday, April 9 and Friday, A...
31/03/2026
The NHL and its U.S. and Canadian broadcast partners have announced a collaborat...
31/03/2026
Daktronics has partnered with Wake Forest to manufacture and install a new end z...
31/03/2026
The National Football League has announced that Las Vegas will host Super Bowl LXIII in 2029 at Allegiant Stadium. The announcement was made at the NFL Annual M...
31/03/2026
The NFL has announced a partnership with TMRW Sports to develop and operate a professional flag football league for women and men. The league will launch with i...
31/03/2026
Sennheiser's Spectera wideband bidirectional wireless system was used by bot...