
Editor's note: This is the latest post in our NVIDIA DRIVE Labs series, which takes an engineering-focused look at individual autonomous vehicle challenges and how NVIDIA DRIVE addresses them. Catch up on all of our automotive posts, here.
Even with advanced driver assistance systems automating more driving functions, human drivers must maintain their attention at the wheel and build trust in the AI system.
Traditional driver monitoring systems typically don't understand subtle cues such as a driver's cognitive state, behavior or other activity that indicates whether they're ready to take over the driving controls.
NVIDIA DRIVE IX is an open, scalable cockpit software platform that provides AI functions to enable a full range of in-cabin experiences, including intelligent visualization with augmented reality and virtual reality, conversational AI and interior sensing.
Driver perception is a key aspect of the platform that enables the AV system to ensure a driver is alert and paying attention to the road. It also enables the AI system to perform cockpit functions that are more intuitive and intelligent.
In this DRIVE Labs episode, NVIDIA experts demonstrate how DRIVE IX perceives driver attention, activity, emotion, behaviour, posture, speech, gesture and mood with a variety of detection capabilities.
A Multi-DNN Approach Facial expressions are complex signals to interpret. A simple wrinkle of the brow or shift of the gaze can have a variety of meanings.
DRIVE IX uses multiple DNNs to recognize faces and decipher the expressions of vehicle occupants. The first DNN detects the face itself, while a second identifies fiducial points, or reference markings - such as eye location, nose, etc.
On top of these base networks, a variety of DNNs operate to determine whether a driver is paying attention or requires other actions from the AI system.
The GazeNet DNN tracks gazes by detecting the vector of the driver's eyes and mapping it to the road to check if they're able to see obstacles ahead. SleepNet monitors drowsiness, classifying whether eyes are open or closed, running through a state machine to determine levels of exhaustion. Finally, ActivityNet tracks driver activity such as phone usage, hands on/off the wheel and driver attention to road events. DRIVE IX can also detect whether the driver is properly sitting in their seat to focus on road events.
In addition to driver focus, a separate DNN can determine a driver's emotions - a key indicator of their ability to safely operate the vehicle. Taking in data from the base face-detect and fiducial-point networks, DRIVE IX can classify a driver's state as happy, surprised, neutral, disgusted or angry.
It can also tell if the driver is squinting or screaming, indicating their level of visibility or alertness and state of mind.
A Customizable Solution Vehicle manufacturers can leverage the driver monitoring capabilities in DRIVE IX to develop advanced AI-based driver understanding capabilities for personalizing the car cockpit.
The car can be programmed to alert a driver if their attention drifts from the road, or the cabin can adjust settings to soothe occupants if tensions are high.
And these capabilities extend well beyond driver monitoring. The aforementioned DNNs, together with gesture DNN and speech capabilities, enable multi-modal conversational AI offerings such as automatic speech recognition, natural language processing and speech synthesis.
These networks can be used for in-cabin personalization and virtual assistant applications. Additionally, the base facial recognition and facial key point models can be used for AI-based video conferencing platforms.
The driver monitoring capabilities of DRIVE IX help build trust between occupants and the AI system as automated driving technology develops, creating a safer, more enjoyable intelligent vehicle experience.
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
17/11/2026
Fabric Insights and Fonn Group have announced a partnership to connect editorial...
17/11/2026
The National Association of Black Journalists is offering up a Thanksgiving Eve treat on Wednesday, Nov. 25, in the form of a live streaming event featuring for...
17/11/2026
Bridge Technologies has announced that its VB440 production probe now supports both monitoring and signal generation for Apple ProRes video streams. The additio...
17/11/2026
Canon U.S.A., Inc. recently welcomed 21 Jericho High School students to its Melv...
17/11/2026
Spectrum News has deployed the Amagi platform to support its live news operations. Amagi says the platform lets Spectrum News streamline newsroom workflows, red...
17/11/2026
Microsoft has expanded its use of Haivision's live video contribution ecosys...
17/11/2026
Setanta Sports has deployed Ateme's TITAN Live platform to support its OTT video delivery operations. Ateme's transcoding technology is integrated into ...
17/11/2026
Media Links has joined the KAIROS Alliance Partner program for Panasonic's KAIROS IT/IP live video production platform. The company completed interoperabili...
17/11/2026
Behind The Mic provides a roundup of recent news regarding on-air talent, including new deals, departures, and assignments compiled from press releases and repo...
17/11/2026
In live sports and in life, things go by in the blink of an eye. Savoring the mo...
17/11/2026
Satellite operators are adding a new generation of low-Earth-orbit (LEO) network...
17/11/2026
Clear-Com has delivered five customized test systems for electromagnetic securit...
17/11/2026
Stephen Arnold Music (SAM) has created the sonic identity for WTGL, the women's team golf league from TMRW Sports, created in partnership with the LPGA and ...
17/11/2026
The Professional Audio Manufacturers Alliance (PAMA) has introduced Give Sound a Voice, an initiative aimed at raising awareness of the value of sound among the...
17/11/2026
Fanatics Studios, the sports entertainment joint venture between Fanatics and OBB, has named Jamal Henderson its first President of Film & TV, announced Michael...
17/11/2026
The NFL's Thanksgiving Week games will feature halftime performances by U2, ...
17/11/2026
FanSided, a Minute brand with more than 250 fan communities, has launched a redesigned mobile app that combines team news, analysis, live game coverage, stats a...
17/11/2026
Major League Volleyball (MLV), the longest-running indoor professional volleybal...
17/11/2026
Prime Video will present a 15-hour slate of live sports on Black Friday, Nov. 27...
17/11/2026
Catherine Dior was more than a muse. A Resistance fighter, a survivor of deporta...
17/11/2026
Multiband dynamics plug-in boasts FT1 integration
Freqport's latest plug-in combines multiband upward and downward dynamics with the company's renow...
17/11/2026
Hi-fi experts launch two pro-audio models
Berlin-based hi-fi experts Teufel Audio have recently branched out into the pro-audio world with their first pairs...
17/11/2026
A year of ComposerCloud+ for $99
EastWest's annual Black Friday Sale is already live, and new users are being offered one year of the all-encompassing C...
17/11/2026
Pick your favourite gear from 2026
The annual SOS Awards are now underway, and as always, we're asking readers to help us choose the best pro-audio rele...
17/11/2026
As part of an ongoing series production program for a German automaker, production capacity has been increased at SGL Carbon's Austrian site in Ried im Innk...
17/11/2026
eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...
17/11/2026
Signiant has acquired the media intelligence technology, Ceivo, developed by Burnlab with founder Aaron Sloman joining the company as Vice President, Product Ma...
17/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
17/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
17/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
17/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
17/11/2026
Berklees 2027 Alumni Grammy Nominees: See the Full List From pop and R&B to jazz, musical theater, and video game scores, Berklee talent is represented across...
17/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
17/11/2026
Share
{alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...
17/11/2026
LA JOLLA, CA-Two Scripps Research faculty, Assistant Professor Christian Diercks...
17/11/2026
Our Biggest Sale of the Year on Ivory 3!
From November 17th through November 30th, enjoy our best savings of the year on Ivory 3 Products!
Whether it's ou...
17/11/2026
Tuesday 17 November 2026
Sky announces major free upgrade to the Sky Glass and ...
17/11/2026
Tuesday 17 November 2026
Passion, Betrayal and Scandal: Sky Arts Reveals the Ma...
17/11/2026
Exact 3D Video, a web service based in Japan, has launched its English version, ...
17/11/2026
Today, Apple Podcasts named Baby, this is Keke Palmer its Show of the Year, hono...
17/11/2026
NVIDIA's Ian Buck kicked off the company's week at SC26 in Chicago on Monday with new tools for AI agents, software that can plan experiments, run code ...
16/11/2026
The ESPN Edge Innovation Conference once again gave key ESPN technology partners as a chance to take to the stage and discuss the future of sports fan experienc...
16/11/2026
As rights holders rethink who tells their stories and where, IMG is preparing th...
16/11/2026
From the sidelines, sonic savants advocate for greater emphasis on sound as sports and entertainment increasingly merge
SVG Live!, a one-day event on Nov. 10 i...
16/11/2026
Deal combines Yamaha's audio technology with Disguise's visual-productio...
16/11/2026
Creative effects designed to encourage experimentation
Berry Effects is the brainchild of Abe and Ralph, a pair of multi-instrumentalists and audio engineer...
16/11/2026
Physics-based synth gets first major update
Anukari have just released a new version of their innovative physics-based software synth, marking the instrumen...
16/11/2026
Both versions kitted out with new tools & improvements
Hit'n'Mix have just launched the latest major version of their innovative DAW software, with ...
16/11/2026
Dynamic bands, unmasking features & new stereo tools
Launched in 2021, Eventide's SplitEQ plug-in introduced an interesting new approach to EQ, with the...