Sony Pixel Power calrec Sony

A Trusted Companion: AI Software Keeps Drivers Safe and Focused on the Road Ahead

19/01/2021

Editor's note: This is the latest post in our NVIDIA DRIVE Labs series, which takes an engineering-focused look at individual autonomous vehicle challenges and how NVIDIA DRIVE addresses them. Catch up on all of our automotive posts, here.

Even with advanced driver assistance systems automating more driving functions, human drivers must maintain their attention at the wheel and build trust in the AI system.

Traditional driver monitoring systems typically don't understand subtle cues such as a driver's cognitive state, behavior or other activity that indicates whether they're ready to take over the driving controls.

NVIDIA DRIVE IX is an open, scalable cockpit software platform that provides AI functions to enable a full range of in-cabin experiences, including intelligent visualization with augmented reality and virtual reality, conversational AI and interior sensing.

Driver perception is a key aspect of the platform that enables the AV system to ensure a driver is alert and paying attention to the road. It also enables the AI system to perform cockpit functions that are more intuitive and intelligent.

In this DRIVE Labs episode, NVIDIA experts demonstrate how DRIVE IX perceives driver attention, activity, emotion, behaviour, posture, speech, gesture and mood with a variety of detection capabilities.

A Multi-DNN Approach Facial expressions are complex signals to interpret. A simple wrinkle of the brow or shift of the gaze can have a variety of meanings.

DRIVE IX uses multiple DNNs to recognize faces and decipher the expressions of vehicle occupants. The first DNN detects the face itself, while a second identifies fiducial points, or reference markings - such as eye location, nose, etc.

On top of these base networks, a variety of DNNs operate to determine whether a driver is paying attention or requires other actions from the AI system.

The GazeNet DNN tracks gazes by detecting the vector of the driver's eyes and mapping it to the road to check if they're able to see obstacles ahead. SleepNet monitors drowsiness, classifying whether eyes are open or closed, running through a state machine to determine levels of exhaustion. Finally, ActivityNet tracks driver activity such as phone usage, hands on/off the wheel and driver attention to road events. DRIVE IX can also detect whether the driver is properly sitting in their seat to focus on road events.

In addition to driver focus, a separate DNN can determine a driver's emotions - a key indicator of their ability to safely operate the vehicle. Taking in data from the base face-detect and fiducial-point networks, DRIVE IX can classify a driver's state as happy, surprised, neutral, disgusted or angry.

It can also tell if the driver is squinting or screaming, indicating their level of visibility or alertness and state of mind.

A Customizable Solution Vehicle manufacturers can leverage the driver monitoring capabilities in DRIVE IX to develop advanced AI-based driver understanding capabilities for personalizing the car cockpit.

The car can be programmed to alert a driver if their attention drifts from the road, or the cabin can adjust settings to soothe occupants if tensions are high.

And these capabilities extend well beyond driver monitoring. The aforementioned DNNs, together with gesture DNN and speech capabilities, enable multi-modal conversational AI offerings such as automatic speech recognition, natural language processing and speech synthesis.

These networks can be used for in-cabin personalization and virtual assistant applications. Additionally, the base facial recognition and facial key point models can be used for AI-based video conferencing platforms.

The driver monitoring capabilities of DRIVE IX help build trust between occupants and the AI system as automated driving technology develops, creating a safer, more enjoyable intelligent vehicle experience.
LINK: https://blogs.nvidia.com/blog/2021/01/19/drive-ix-ai-software-drivers-...
See more stories from nvidia

Most recent headlines

20/11/2025

Cracking the Code for Resilient, Secure Space-based Communications

L3Harris has achieved NSA Cybersecurity Directorate certification for its KSV-650 space hub end cryptographic unit, ensuring secure, adaptable communications fo...

20/11/2025

Continued Commitment and Investment in Poland

L3Harris is strengthening its long-term partnership with Poland through the opening of a new facility in Warsaw to serve as a central business hub for regional ...

20/11/2025

Cinegy wins the Swedish Hockey League

15 March 2012 SHARE Facebook Twitter Linkedin Email Cinegy and Vericom are pleased to announce the recent deployment of Cinegy Archive for production and as...

20/11/2025

2012

6 September 2012 SHARE Facebook Twitter Linkedin Email FIC Turkey supplies media content to Pay TV under Fox TV Channel brands in Turkey. At the start of s...

20/11/2025

VIVA Indonesia broadcasting the World Cup Brazil 2014 with Cinegy

25 June 2014 SHARE Facebook Twitter Linkedin Email Last month VIVA finalized its Cinegy installation in order to produce and broadcast the World Cup Brazil ...

20/11/2025

2014

1 October 2014 SHARE Facebook Twitter Linkedin Email With 5 locations spread out around Baden-W rttemberg, Schw bisch Media required a scalable end to end s...

20/11/2025

Strictly Come Dancing Goes with a Cinegy Workflow

27 April 2015 SHARE Facebook Twitter Linkedin Email Cinegy, which develops and produces media asset management products that are used in flagship production...

20/11/2025

Cinegy announces new Latin America partnership

12 August 2015 SHARE Facebook Twitter Linkedin Email Munich, Germany, 26 October 2015 - Cinegy, which develops and produces software technology for digital ...

20/11/2025

2015

5 November 2015 SHARE Facebook Twitter Linkedin Email Munich, Germany 3 November 2015 - Cinegy, which develops and produces software technology for digital ...

20/11/2025

Cinegy launches Cinegy Open' initiative

12 February 2016 SHARE Facebook Twitter Linkedin Email Munich, Germany 9 February 2016 - Cinegy, which develops and produces software technology for digital...

20/11/2025

2016

22 June 2016 SHARE Facebook Twitter Linkedin Email Munich, Germany 21 June 2016 - Cinegy today announced that ABS BROADCAST, one of the largest independentl...

20/11/2025

Cinegy News - nominee of NewBay Media Awards 2016

10 January 2017 SHARE Facebook Twitter Linkedin Email Find us on page 12 of the Program Guide 2016 Tags NewBay Media Awards , Program Guide 2016 , broadc...

20/11/2025

Freeview Thailand deploys Cinegy Air PRO Bundles for multi-channel playout

15 March 2017 SHARE Facebook Twitter Linkedin Email Munich, Germany 15 March 2017 - Cinegy today announced that Thailand's Next Step direct-to-home Free...

20/11/2025

2017

12 December 2017 SHARE Facebook Twitter Linkedin Email Munich, Germany 13 December 2017 - Cinegy today announced that it is making its Cinegy Air Cloud Pack...

20/11/2025

2018

25 June 2018 SHARE Facebook Twitter Linkedin Email Munich 25th June 2018 - Cinegy today announced that Canada-based Accessible Media Inc. (AMI) has implemen...

20/11/2025

2019

27 May 2019 SHARE Facebook Twitter Linkedin Email The best quality live video from the worst networks - Haivision Although DVB and the World Wide Web are...

20/11/2025

2020

24 November 2020 SHARE Facebook Twitter Linkedin Email ATV Expand and Increase their Playout and Editing Capabilities using Cinegy Software Munich, Germany...

20/11/2025

Cinegy further commits to Eastern European market with new appointment

1 September 2021 SHARE Facebook Twitter Linkedin Email Munich, Germany, 1st September 2021: Cinegy GmbH, the premier provider of software technology for di...

20/11/2025

2021

20 September 2021 SHARE Facebook Twitter Linkedin Email ElectronicVerve continues a strong history of supporting Cinegy customers in India Munich, Germany,...

20/11/2025

2022

1 November 2022 SHARE Facebook Twitter Linkedin Email Munich, Germany, 01 November 2022: Cinegy, a premier provider of software technology for digital video...

20/11/2025

Britt Broadcast implements Cinegy Air PRO at TBC (Tanzanian Broadcasting Corporation]

31 October 2023 SHARE Facebook Twitter Linkedin Email Britt Broadcast at TBC...

20/11/2025

Oklahoma Community Television Overcomes ATSC 3.0 Translator Challenge

CINCINNATI Oklahoma Community Television (OCT) has selected GatesAir and Triveni Digital as key technology partners in an ATSC 3.0 deployment that establishes a...

20/11/2025

FCC Launches Wide-Ranging Examination of Network Affiliate Relations

WASHINGTON The Federal Communications Commission has opened a wide-ranging inquiry into the relations between broadcast networks and their affiliates that could...

20/11/2025

IAB: Creator Economy Ad Spend Now Dwarfs Ad Spend for Total Media Industry

NEW YORK Ad spend in the creator economy has more than doubled since 2021 from $13.9B to $29.5B in 2024 and that amount is projected to reach $37 billion in 202...

20/11/2025

Graduate Spotlight: Krysta Mirsik DePuy

Graduate Spotlight: Krysta Mirsik DePuy The educator from Hackettstown, New Jersey, shares how it took her 11 years to find the right graduate program for her...

20/11/2025

Rise Awards 2025 Celebrate the Industry's Best

LONDON The winners of the Rise Awards 2025, which recognize women and companies whose achievements have stood out in the media technology industry, have been an...

20/11/2025

Lionsgate, Debmar-Mercury Launch MovieSphere Gold Diginet

SANTA MONICA & NEW YORK Lionsgate's Worldwide Television Distribution Group and Debmar-Mercury have launched MovieSphere Gold in more than 30 million homes....

20/11/2025

Clear-Com Unveils New 4-Channel HelixNet Beltpack

ALAMEDA, Calif. Clear-Com has introduced its four-channel HelixNet beltpack, a next-generation advancement of its widely used two-channel model, and anticipates...

20/11/2025

Kiswe Core Aims to Simplify Cloud-Based Streaming Distribution

NEW PROVIDENCE, N.J. Streaming technology and services provider Kiswe has launched Kiswe Core, a next-generation cloud-based platform designed to simplify the s...

20/11/2025

Dolby Partners Up With Bay Area Super Bowl Host Committee

MOUNTAIN VIEW, Calif. Dolby Laboratories has signed on as an official signature partner of the Bay Area Host Committee (BAHC) for the 2026 Super Bowl and the we...

20/11/2025

Telus TV+ Expands Distribution to Samsung and LG Smart TVs

STUTTGART, Germany 3 Screen Solutions (3SS) has announced that the Canadian multiservice operator Telus has launched its Telus TV+ entertainment platform on Sam...

20/11/2025

MLB Strikes Rights Deals With ESPN, NBCUniversal, Netflix

Major League Baseball has announced deals with ESPN, NBCUniversal and Netflix covering 2026-2028 that make ESPN the exclusive distributor for MLB.TV, put regula...

20/11/2025

Berklee Presents Holiday Extravaganza: Duke Ellingtons The Nutcracker Suite and GenNext All-Stars' Noel

Berklee Presents Holiday Extravaganza: Duke Ellingtons The Nutcracker Suite and ...

20/11/2025

Richard Osman, Kyla Cobbler and Vittorio Angeloni among the guests on this week's Late Late Show

It's the Late Late Toy Show BIG BIG Ticket Giveaway day! It's the Late ...

20/11/2025

Into the Omniverse: How Smart City AI Agents Transform Urban Operations

Editor's note: This post is part of Into the Omniverse, a series focused on how developers, 3D practitioners and enterprises can transform their workflows u...

20/11/2025

Guests revealed for The 2 Johnnies Late Night Lock In tonight

The How To Gael pocast gals, comedian Chris Kent and quizzer Darragh Ennis drop by for the fifth episode of The 2 Johnnies Late Night Lock In In the penultimat...

20/11/2025

Ultimate Cloud Gaming Is Everywhere With GeForce NOW

The NVIDIA Blackwell RTX upgrade is nearing the finish line, letting GeForce NOW Ultimate members across the globe experience true next-generation cloud gaming ...

20/11/2025

The Largest Digital Zoo: Biology Model Trained on NVIDIA GPUs Identifies Over a Million Species

Tanya Berger-Wolf's first computational biology project started as a bet wit...

19/11/2025

Sphere Sound Kicks Up Its Heels at Radio City Music Hall

Sphere Sound Kicks Up Its Heels at Radio City Music HallUltra-immersive system from the singular Las Vegas venue is also ready for sportsBy Dan Daley, Audio Edi...

19/11/2025

The Future of Stadium and Arena Video Control Rooms: Tech Leaders Talk 4K, IP, and More

The Future of Stadium and Arena Video Control Rooms: Tech Leaders Talk 4K, IP, a...

19/11/2025

One Year at Intuit Dome: Walking Through the Stunning Arena's Advanced Video Production Layout with the LA Clippers

One Year at Intuit Dome: Walking Through the Stunning Arena's Advanced Video...

19/11/2025

SVG Sit-Down: IMG's Francois Westcombe Goes Inside IMG's Annual Digital Trends Report

SVG Sit-Down: IMG's Francois Westcombe Goes Inside IMG's Annual Digital ...

19/11/2025

Inside Brighton & Hove Albion's Fan-First Media Machine

Inside Brighton & Hove Albion's fan-first media machine By George Bevir Tuesday, November 18, 2025 - 10:10 Print This Story Brighton & Hove Albion'...

19/11/2025

Rock Chalk Rebuild, Part 1: Kansas Athletics Brings New Production Power to Rebuilt David Booth Kansas Memorial Stadium

Rock Chalk Rebuild, Part 1: Kansas Athletics Brings New Production Power to Rebu...

19/11/2025

Rock Chalk Rebuild, Part 2: A Pro's Guide to Kansas Athletics' New Video-Production Infrastructure

Rock Chalk Rebuild, Part 2: A Pro's Guide to Kansas Athletics' New Video...

19/11/2025

MLB Media Rights Shakeup: NBC Inks Three-Year Deal for Sunday Night Baseball, Peacock Exclusive Game, and More

MLB Media Rights Shakeup: NBC Inks Three-Year Deal for Sunday Night Baseball, Pe...

19/11/2025

Sabar Bonda (Cactus Pears) Takes a Tender View on Queer Relationships

Rohan Parashuram Kanawade attends the premiere of Sabar Bonda (Cactus Pears) at the 2025 Sundance Film Festival at Egyptian Theatre on January 26, 2025, in Pa...

19/11/2025

Sundance Institute-Supported Seeds, Apocalypse in the Tropics, Selena y Los Dinos, and More Earn IDA Documentary Awards Nominations

Awards season is heating up, and the International Documentary Association just ...