Sony Pixel Power calrec Sony

Inside AI: NVIDIA DRIVE Ecosystem Creates Pioneering In-Cabin Features With NVIDIA DRIVE IX

21/09/2022

As personal transportation becomes electrified and automated, time in the vehicle has begun to resemble that of a living space rather than a mind-numbing commute.

Companies are creating innovative ways for drivers and passengers to make the most of this experience, using the flexibility and modularity of NVIDIA DRIVE IX. In-vehicle technology companies Cerence, Smart Eye, Rightware and DSP Concepts are now using the platform to deliver intelligent features for every vehicle occupant.

These partners are joining a diverse ecosystem of companies developing on DRIVE IX, including Soundhound, Jungo and VisionLabs, providing cutting-edge solutions for any in-vehicle need.

DRIVE IX provides an open software stack for cockpit solution providers to build and deploy features that will turn personal vehicles into interactive environments, enabling intelligent assistants, graphic user interfaces and immersive media and entertainment.

Intelligent Assistants AI isn't just transforming the way people drive, but also how they interact with cars.

Using speech, gestures and advanced graphical user interfaces, passengers can communicate with the vehicle through an AI assistant as naturally as they would with a human.

An intelligent assistant will help to operate vehicle functions more intuitively, warn passengers in critical situations and provide services such as giving local updates like the weather forecast, making reservations and phone calls, and managing calendars.

Conversational AI Interaction Software partner Cerence is enabling AI-powered, voice-based interaction with the Cerence Assistant, its intelligent in-car assistant platform.

Cerence Assistant uses sensor data to serve drivers throughout their daily journeys, notifying them, for example, when fuel or battery levels are low and navigating to the nearest gas or charging station.

It features robust speech recognition, natural language understanding and text-to-speech capabilities, enhancing the driver experience.

Courtesy of Cerence Using DRIVE IX, it can empower both embedded and cloud-based natural language processing on the same architecture, ensuring drivers have access to important capabilities regardless of connectivity.

Cerence Assistant also supports major global markets and related languages, and is customizable for brand-specific speech recognition and personalization.

Gesture Recognition In addition to speech, passengers can interact with AI assistants via gesture, which relies on interior sensing technologies.

Smart Eye is a global leader in AI-based driver monitoring and interior sensing solutions. Its production driver-monitoring system is already in 1 million vehicles on the roads around the world, and will be incorporated in the upcoming Polestar 3, set to be revealed in October.

Working with DRIVE IX, Smart Eye's technology makes it possible to detect eye movements, facial expressions, body posture and gestures, bringing insight into people's behavior, activities and mood.

Courtesy of Smart Eye Using NVIDIA GPU technology, Smart Eye has been able to speed up its cabin-monitoring system - which consists of 10 deep neural networks running in parallel - by more than 10x.

This interior sensing is critical for safety - ensuring driver attention is on the road when it should be and detecting left-behind children or pets - and it customizes and enhances the entire mobility experience for comfort, wellness and entertainment.

Graphical User Interface AI assistants can communicate relevant information easily and clearly with high-resolution graphical interfaces. Using DRIVE IX, Rightware is creating a seamless visual experience across all cockpit and infotainment domains.

Caption: Courtesy of Rightware Rightware's automotive human-machine interface tool Kanzi One helps designers bring amazing real-time 3D graphical user interfaces into the car and hides the underlying operating system and framework complexity. Automakers can completely customize the vehicle's user interface with Kanzi One, providing a brand-specific signature UI.

Enhancing visual user interfaces by audio features is equally important for interacting with the vehicle. The Audio Weaver development platform from DSP Concepts can be integrated into the DRIVE IX advanced sound engine. It provides a sound design toolchain and audio framework to graphically design features.

Courtesy of DSP Concepts. Creators and sound artists can design a car- and brand-specific sound experience without the hassle of writing complex code for low-level audio features from scratch.

Designing in Simulation With NVIDIA DRIVE Sim on Omniverse, developers can integrate, refine and test all these new features in the virtual world before implementing them in vehicles.

Interior sensing companies can build driver- or occupant-monitoring models in the cockpit using the DRIVE Replicator synthetic-data generation tool on DRIVE Sim. Partners providing content for vehicle displays can first develop on a rich, simulated screen configuration.

Access to this virtual vehicle platform can significantly accelerate end-to-end development of intelligent in-vehicle technology.

By combining the flexibility of DRIVE IX with leading in-cabin solutions providers, spending time in the car can become a luxury rather than a chore.
LINK: https://blogs.nvidia.com/blog/2022/09/21/drive-ix-ecosystem/...
See more stories from nvidia

Most recent headlines

06/10/2025

France Tlvisions Wins Prestigious 2025 EBU Technology & Innovation Award in Groundbreaking Collaboration with Dalet

France T l visions, France's leading broadcaster, has received the 2025 EBU ...

06/09/2025

Twinless Is James Sweeney's Darkly Comic Exploration of Loss and Connection

(L-R) Dylan O'Brien and James Sweeney attend the 2025 Sundance Film Festival Twinless premiere at Eccles Theatre. (Photo by George Pimentel/Shutterstock f...

06/09/2025

Vizrt Launches New AI-Powered Features to Speed up AR Sports Production

LONDON Vizrt has introduced Viz Arena 6, the newest version of its all-in-one live augmented reality (AR) graphics and virtual advertising sports solution. The ...

06/09/2025

AWS To Feature Generative AI, News Distribution At IBC2025

SEATTLE Amazon Web Services (AWS) will feature 56 AWS Partners making various demos that showcase the technologies and use cases shaping the future of the Media...

06/09/2025

PBS Kids Embraces Gameplay Content

In news that highlights the ongoing importance of video games, PBS Kids is making its first foray into gameplay content with the September 5 launch of Odd Squa...

06/09/2025

PBS to Cut 15% of Staff

PBS chief executive Paula Kerger has sent an email to staff outlining plans to cut about 100 positions or 15% of its staff, following the loss of Federal fundin...

06/09/2025

IABM announces the shortlist for the new IABM Impact Awar...

A new era of recognition as IABM honors the people, projects and innovations driving real impact IABM has confirmed the shortlist for the new IABM Impact Award...

06/09/2025

Deliver multi-platform graphics from a single workflow wi...

Vizrt, the leader in live production technology revolutionizing viewer experiences, announces new capabilities to help customers create once, adapt automaticall...

06/09/2025

Studio Technologies Showcases Latest Audio and Interface...

Studio Technologies, a leading manufacturer of high-quality audio, video, and fiber-optic solutions, will spotlight four of its innovative audio solutions at th...

06/09/2025

DigitalGlue Previews Creative Intelligence CI Powered by...

DigitalGlue, creator of the award-winning creative.space managed storage platform, today announced a technology preview of Creative Intelligence (CI) powered by...

06/09/2025

Balancing heritage film and modern projectionist needs wi...

Eye Filmmuseum is the Netherlands leading film museum, offering a rich variety of experiences from screenings of classic films to cultural exhibitions. With fou...

06/09/2025

X Marks the Spot Grass Valley to Showcase Innovations and...

The latest innovations in Grass Valley's AMPP applications will be on full display at IBC 2025, as the company brings significant updates to Playout X, its ...

06/09/2025

Disguise Unveils GX 3 Plus the New Benchmark in Media Ser...

Disguise has announced the launch of the GX 3 , its most powerful media server ever. Built on NVIDIA's cutting-edge Blackwell GPU architecture and including...

06/09/2025

AUTOSCRIPT AND AUTOCUE LAUNCH NEW PTZ PROMPTER SOLUTIONS...

Autoscript and Autocue have announced the launch of a new advanced PTZ prompter system shared by both brands and designed to provide seamless, professional prom...

06/09/2025

Sachtler Expands aktiv and FSB Mk II Ranges with Higher-P...

Sachtler has added four new models to its award-winning aktiv and FSB Mk II fluid head ranges. The aktiv16T and aktiv18T, plus the FSB 16T Mk II and FSB 18T Mk...

06/09/2025

CGI to showcase next-generation newsroom at IBC2025

CGI (TSX: GIB.A) (NYSE: GIB), one of the largest independent IT and business consulting services firms in the world, will present its bold new vision for the fu...

06/09/2025

DHD Announces RM1 Pro Broadcast-from-Anywhere Production...

DHD has chosen IBC 2025 (Amsterdam, 12-15 September) as the launch venue for the latest version of its RM1 all-in-one portable audio production and broadcast sy...

06/09/2025

AJA Debuts IP25-R 4K SMPTE 2110 to 12G SDI-HDMI Mini-Conv...

AJA Video Systems debuted IP25-R, a Mini-Converter for connecting SMPTE ST 2110 networks with 4K SDI/HDMI infrastructures. IP25-R lets broadcast, production, an...

06/09/2025

AJA Introduces New Conversion and IP Video Solutions

AJA Video Systems today introduced new products and updates ahead of the International Broadcasting Convention (IBC) 2025 that streamline signal flow management...

06/09/2025

September 05, 2025

Researchers map key human proteins that power coronavirus replication, pointing to new treatment strategies Findings from Scripps Research reveal promising drug...

05/09/2025

7 Ways Spotify's New User Controls Put You in Charge of Your Listening

Your listening habits are as unique as you are-and this year, Spotify has introduced a wave of new features to help you personalize your experience. From playli...

05/09/2025

Today's Historic Settlement Underscores SBS's Powerful New Series The People v Robodebt

Today's Historic Settlement Underscores SBS's Powerful New Series The Pe...

05/09/2025

L3Harris CFO and AR President Interviewed on CNBC's 'Closing Bell: Overtime'

L3Harris Chief Financial Officer and Aerojet Rocketdyne President Ken Bedingfiel...

05/09/2025

Peacock to Stream Sunday Night Football' in Dolby Atmos

PHILADELPHIA NBC Sports will present tonight's NFL Kickoff Game between the '25 Super Bowl champion Philadelphia Eagles and Dallas Cowboys on Peacock in...

05/09/2025

Warner Bros. Discovery Sues Midjourney

Warner Bros. Discovery filed a lawsuit against Gen AI company Midjourney this week, claiming that the company violated the studio's copyright....

05/09/2025

Alum Esin Aydngz Pens Nevermore Alma Mater' for Netflix's Wednesday

Alum Esin Ayd ng z Pens Nevermore Alma Mater' for Netflix's Wednesday The Grammy-nominated composer appears on this season's soundtrack alongside...

05/09/2025

YouTube TV, Hulu to Carry C-SPAN

C-SPAN and YouTube this week announced an agreement in which YouTube will sponsor C-SPAN's America 250 programming and expand access to C-SPAN's politic...

05/09/2025

Techex Hires Peter Dawidzik for Senior Sales Role

LONDON Live broadcast infrastructure solutions provider Techex has added Peter Dawidzik as senior director, sales and business development....

05/09/2025

Reuters and AWS to Demo News Distribution System at IBC2025

As news organizations and broadcasters face more pressure than ever to capture, verify, and distribute real-time access to breaking news, Reuters and Amazon Web...

05/09/2025

HPA Opens Call For Expanded Awards

LOS ANGELES The Hollywood Professional Association (HPA) today said it has begun accepting submissions for its expanded HPA Engineering Excellence Awards, which...

05/09/2025

Sage Releases Firmware Fix

Sage has released an update to its most recent firmware for its Digital ENDEC model 3644....

05/09/2025

ThinkAnalytics To Feature Newly Introduced ThinkMetadataAI At IBC2025

LONDON and LOS ANGELES ThinkAnalytics will debut ThinkMetadataAI, the company's latest step in recommendations, search and discovery services....

05/09/2025

FCC to Lift Freeze on Applications for New LPTV, TV Translator Stations

WASHINGTON The Federal Communications Commissions Media Bureau has announced that the agency is initiating a phased process to lift the current freeze on major ...

05/09/2025

Quickplay To Highlight Newly Introduced AI Studio At IBC2025

TORONTO Quickplay will feature its newly unveiled AI Studio that assists broadcasters and streamers in transforming their content libraries into short-form asse...

05/09/2025

Boston Conservatory at Berklee Announces Five-Year Partnership with The Verdon Fosse Legacy

Boston Conservatory at Berklee Announces Five-Year Partnership with The Verdon F...

05/09/2025

Alum Esin Aydingz Pens Nevermore Alma Mater' for Netflix's Wednesday

Alum Esin Ayding z Pens Nevermore Alma Mater' for Netflix's Wednesday The Grammy-nominated composer appears on this season's soundtrack alongside...

05/09/2025

Rohde & Schwarz UK awarded Silver Award under Defence Employer Recognition Scheme

Rohde & Schwarz UK awarded Silver Award under Defence Employer Recognition Schem...

05/09/2025

Two Desperate Souls and One Desperate Choice: As You Stood By' Streams November 7

Back to All News Two Desperate Souls and One Desperate Choice: As You Stood By...

05/09/2025

Netflix Unveils New BAKI-DOU' Anime and First Look at BEASTARS FINAL SEASON' Part2 at 10th Anniversary Event in Japan

Back to All News Netflix Unveils New BAKI-DOU' Anime and First Look at BE...

05/09/2025

This weekend sees another feast of free-to-air Sport across RT

This weekend sees another feast in store for all sport fans as RT airs a jam-packed schedule of live, free-to-air sport. The Amgen Irish Open continues all we...

04/09/2025

Film Festival Watch: 9 Sundance Institute-Supported Must-Sees to Catch at the 2025 Toronto International Film Festival

(Joel Edgerton and Felicity Jones appear in Train Dreams by Clint Bentley, an of...

04/09/2025

Watch the Record-breaking Koori Knockout 2025 LIVE and EXCLUSIVE on NITV and SBS On Demand

Watch the Record-breaking Koori Knockout 2025 LIVE and EXCLUSIVE on NITV and SBS...

04/09/2025

Zixi Taps Sue Mitchell as Director of Account Management, EMEA

WALTHAM, Mass. Zixi, a provider of video-delivery-over-IP technology, has named Sue Mitchell as director of account management, EMEA....

04/09/2025

NBCU Reports Record NFL Revenue; Sells Out Ad Inventory for Super Bowl LX

NEW YORK In news that highlights the importance of the NFL and sports for the TV and streaming industry, NBCUniversal is reporting record revenue for its 20th s...

04/09/2025

Ross Video Acquires LAMA for Live Audio Mixing

OTTAWA Ross Video has acquired LAMA, a Dutch-based developer of advanced audio production software known for its innovative live mixing solutions. The acquisiti...

04/09/2025

GatesAir to Demo 5G Passthrough Over UHF at IBC2025

CINCINNATI GatesAir will bring its 5G passthrough demo to IBC audiences once again as interest in the technology's value for broadcast-to-mobile delivery gr...

04/09/2025

Autoscript, Autocue to Feature New PTZ Prompter System at IBC2025

BURY ST. EDMUNDS, England Autoscript and Autocue will showcase their newly launched PTZ prompter system during IBC2025, Sept. 12-15 at the RAI Amsterdam Convent...

04/09/2025

Watch the Benn Family Band Perform I Wont Give Up on Americas Got Talent

Watch the Benn Family Band Perform I Wont Give Up on Americas Got Talent Assistant Professor Loren Benn and her family gave an emotional live performance of t...