Sony Pixel Power calrec Sony

Inside AI: NVIDIA DRIVE Ecosystem Creates Pioneering In-Cabin Features With NVIDIA DRIVE IX

21/09/2022

As personal transportation becomes electrified and automated, time in the vehicle has begun to resemble that of a living space rather than a mind-numbing commute.

Companies are creating innovative ways for drivers and passengers to make the most of this experience, using the flexibility and modularity of NVIDIA DRIVE IX. In-vehicle technology companies Cerence, Smart Eye, Rightware and DSP Concepts are now using the platform to deliver intelligent features for every vehicle occupant.

These partners are joining a diverse ecosystem of companies developing on DRIVE IX, including Soundhound, Jungo and VisionLabs, providing cutting-edge solutions for any in-vehicle need.

DRIVE IX provides an open software stack for cockpit solution providers to build and deploy features that will turn personal vehicles into interactive environments, enabling intelligent assistants, graphic user interfaces and immersive media and entertainment.

Intelligent Assistants AI isn't just transforming the way people drive, but also how they interact with cars.

Using speech, gestures and advanced graphical user interfaces, passengers can communicate with the vehicle through an AI assistant as naturally as they would with a human.

An intelligent assistant will help to operate vehicle functions more intuitively, warn passengers in critical situations and provide services such as giving local updates like the weather forecast, making reservations and phone calls, and managing calendars.

Conversational AI Interaction Software partner Cerence is enabling AI-powered, voice-based interaction with the Cerence Assistant, its intelligent in-car assistant platform.

Cerence Assistant uses sensor data to serve drivers throughout their daily journeys, notifying them, for example, when fuel or battery levels are low and navigating to the nearest gas or charging station.

It features robust speech recognition, natural language understanding and text-to-speech capabilities, enhancing the driver experience.

Courtesy of Cerence Using DRIVE IX, it can empower both embedded and cloud-based natural language processing on the same architecture, ensuring drivers have access to important capabilities regardless of connectivity.

Cerence Assistant also supports major global markets and related languages, and is customizable for brand-specific speech recognition and personalization.

Gesture Recognition In addition to speech, passengers can interact with AI assistants via gesture, which relies on interior sensing technologies.

Smart Eye is a global leader in AI-based driver monitoring and interior sensing solutions. Its production driver-monitoring system is already in 1 million vehicles on the roads around the world, and will be incorporated in the upcoming Polestar 3, set to be revealed in October.

Working with DRIVE IX, Smart Eye's technology makes it possible to detect eye movements, facial expressions, body posture and gestures, bringing insight into people's behavior, activities and mood.

Courtesy of Smart Eye Using NVIDIA GPU technology, Smart Eye has been able to speed up its cabin-monitoring system - which consists of 10 deep neural networks running in parallel - by more than 10x.

This interior sensing is critical for safety - ensuring driver attention is on the road when it should be and detecting left-behind children or pets - and it customizes and enhances the entire mobility experience for comfort, wellness and entertainment.

Graphical User Interface AI assistants can communicate relevant information easily and clearly with high-resolution graphical interfaces. Using DRIVE IX, Rightware is creating a seamless visual experience across all cockpit and infotainment domains.

Caption: Courtesy of Rightware Rightware's automotive human-machine interface tool Kanzi One helps designers bring amazing real-time 3D graphical user interfaces into the car and hides the underlying operating system and framework complexity. Automakers can completely customize the vehicle's user interface with Kanzi One, providing a brand-specific signature UI.

Enhancing visual user interfaces by audio features is equally important for interacting with the vehicle. The Audio Weaver development platform from DSP Concepts can be integrated into the DRIVE IX advanced sound engine. It provides a sound design toolchain and audio framework to graphically design features.

Courtesy of DSP Concepts. Creators and sound artists can design a car- and brand-specific sound experience without the hassle of writing complex code for low-level audio features from scratch.

Designing in Simulation With NVIDIA DRIVE Sim on Omniverse, developers can integrate, refine and test all these new features in the virtual world before implementing them in vehicles.

Interior sensing companies can build driver- or occupant-monitoring models in the cockpit using the DRIVE Replicator synthetic-data generation tool on DRIVE Sim. Partners providing content for vehicle displays can first develop on a rich, simulated screen configuration.

Access to this virtual vehicle platform can significantly accelerate end-to-end development of intelligent in-vehicle technology.

By combining the flexibility of DRIVE IX with leading in-cabin solutions providers, spending time in the car can become a luxury rather than a chore.
LINK: https://blogs.nvidia.com/blog/2022/09/21/drive-ix-ecosystem/...
See more stories from nvidia

Most recent headlines

06/10/2025

France Tlvisions Wins Prestigious 2025 EBU Technology & Innovation Award in Groundbreaking Collaboration with Dalet

France T l visions, France's leading broadcaster, has received the 2025 EBU ...

04/09/2025

Monumental Sports & Entertainment and Dalet Win Prestigious 2025 NAB Show Project of the Year Award

Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...

01/07/2025

ITV Celebrates Best Sunday of 2025 with Code of Silence

The launch of Code of Silence, coupled with the Britains Got Talent semi final, gave ITV its best Sunday night of 2025. The first episode of the new crime dr...

01/07/2025

Romola Garai joins Shaun Evans in ITV thriller BETRAYAL, as filming begins in the North West

ITV and Mammoth Screen have announced the start of filming for Betrayal, a gripp...

01/07/2025

L3Harris Delivers Missionized Intelligence, Surveillance and Reconnaissance Aircraft

L3Harris Technologies has delivered its second Bombardier Global 6500 missionize...

01/07/2025

L3Harris Sets Date for Second Quarter 2025 Earnings Release

MELBOURNE, Fla., July 1, 2025 - L3Harris Technologies (NYSE: LHX) will release its second quarter 2025 financial results before the market opens on Thursday, Ju...

01/07/2025

Movicom Selects Clear-Com to Power Communications for Global Live Events

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({ content_source:......

01/07/2025

FCC Rejects License Challenges to 3 Baltimore TV Stations

WASHINGTON The Federal Communications Commission has rejected license challenges to three full-power Baltimore TV stations, renewing the licenses for Chesapeake...

01/07/2025

Dalet Flex LTS Update Features Improved Content Workflow Tools

Dalet has released a new update to its Dalet Flex media workflow platform, introducing powerful new capabilities to its flagship platform....

01/07/2025

New Global Game' Summit Explores Future of Soccer, Tech and Media

NEWARK, N.J. With the FIFA Club World Cup final rapidly approaching and the start of the 2026 FIFA World Cup now less than a year away, interest in soccer in th...

01/07/2025

COW Job Listing: Laser Engraved Logo

COW Job Listing: Laser Engraved Logo Brie Clayton July 1, 2025 0 Comments Laser engraved logo July 1, 2025Steffie Beltt's Mi Amor Music Video Cr...

01/07/2025

LeGrow.Studio Builds Broadcast Hub for ePro League

LeGrow.Studio Builds Broadcast Hub for ePro League Brie Clayton July 1, 2025 0 Comments TEM Constellation HD and BlackmagicURSA Broadcast G2 drive liv...

01/07/2025

Beeble launches SwitchLight 2.0, bringing AI-powered relighting to any footage

Beeble launches SwitchLight 2.0, bringing AI-powered relighting to any footage Brie Clayton July 1, 2025 0 Comments New AI model delivers full-scene p...

01/07/2025

Steffie Beltt's Mi Amor Music Video Created with Blackmagic Design

Steffie Beltt's Mi Amor Music Video Created with Blackmagic Design Brie Clayton July 1, 2025 0 Comments Blackmagic PYXIS 6K digital film camera...

01/07/2025

Sinclair Pays $500,000 to Settle FCC Investigations

WASHINGTON The Federal Communications Commission's Enforcement and Media Bureaus have entered into a consent decree with Sinclair to resolve a variety of in...

01/07/2025

LPTV Broadcasters Association to Hold Webinar on Station Sales

DENVER Low-power television (LPTV) station owners looking to navigate the complexities of selling their assets in todays dynamic media environment are invited t...

01/07/2025

Netflix to Carry Live Programming from NASA+

NASA announced today that live programming from its NASA+ channel will be available on Netflix starting sometime this summer....

01/07/2025

FCC Chair Carr Hires Katie McAuliffe as Policy Advisor

WASHINGTON Federal Communications Commission Chair Brendan Carr has appointed Katie McAuliffe to serve as policy advisor in his office....

01/07/2025

GFiber Demonstrates Network Slicing to Improve Home Internet Performance

MOUNTAIN VIEW, Calif. Alphabet's GFiber, the broadband provider formerly known as Google Fiber, has announced that it recently worked with Nokia to demonstr...

01/07/2025

DoubleVerify Debuts Attention Measurement for Social Media

NEW YORK, N.Y. DoubleVerify (DV) has announced the launch of DV Authentic Attention for Social. The product will first launch with Snap, the owner of Snapchat....

01/07/2025

FCC Rejects License Challenges to Three Baltimore TV Stations

WASHINGTON The Federal Communications Commission has rejected license challenges to three full-power Baltimore TV stations and agreed to renew the license for C...

01/07/2025

Magewell Brings NDI into Conferencing Software and More w...

Compact new converter lets users capture live NDI and streaming sources into software over a USB interface Video interface and IP workflow innovator Magewell ...

01/07/2025

Disneys Hercules Brings Mosaic Visuals To Life On Stage W...

Disguise, the award-winning tech company driving visuals for Broadway and West End hits including Redwood, Stranger Things: The First Shadow and Disney's Fr...

01/07/2025

KIT Plugins release NOIZ One Vox

Vocal-processing plug-in joins NOIZ Hub series Launched in 2024, KIT Plugins' NOIZ Hub series was created with the aim of providing a range of professio...

01/07/2025

7 Day Mastering: New course from Mastering.com

New self-paced learning programme announced Mastering.com have announced the availability of a new online course designed to cover the fundamentals of maste...

01/07/2025

Heather Gray Named Vice President and General Manager of WRAL and FOX 50

Historic appointment ushers in unified leadership for WRAL-TV, New Media, and Digital Solutions RALEIGH, N.C. - 6-27-25 - Capitol Broadcasting Company is prou...

01/07/2025

SVG New Sponsor Spotlight: Spyrosoft's Jonathan Witty on Futher Business Expansion in the U.S.

SVG New Sponsor Spotlight: Spyrosoft's Jonathan Witty on Futher Business Exp...

01/07/2025

The NIL Effect: How the Shifting Business of College Athletics Impacts On-Campus Video Production

The NIL Effect: How the Shifting Business of College Athletics Impacts On-Campus...

01/07/2025

Cherry On the Cake: Inside the Technical Production of the Tour de France 2025 with EMG / Gravity Media

Cherry on the cake: Inside the technical production of the Tour de France 2025 w...

01/07/2025

NESN's Josh Jun on Keeping Alternative Broadcasts Fresh for Boston Red Sox, Boston Bruins Fans

NESN's Josh Jun on Keeping Alternative Broadcasts Fresh for Boston Red Sox, ...

01/07/2025

TNT Sports Races Back Into NASCAR With Fresh Look, Familiar Edge

TNT Sports Races Back Into NASCAR With Fresh Look, Familiar Edge Production approach emphasizes creative freedom, bold storytelling, casual-fan-friendly tone B...

01/07/2025

cetecom advanced certifies Rohde & Schwarz test solution for the verification of Next Generation eCall functionality

cetecom advanced certifies Rohde & Schwarz test solution for the verification of...

01/07/2025

Watch: A Line Crossed: Netflix Drops Explosive Trailer for New Series, 'Marked'

Back to All News Watch: A Line Crossed: Netflix Drops Explosive Trailer for New...

01/07/2025

Broadcast Pix Showcases Live Production Tools at ACM 2025 in Boston

Tyngsboro, Mass. - June 30, 2025 - The 2025 ACM Annual Conference at Boston University was an energizing and inspiring gathering of community media professional...

01/07/2025

Teresa Smith Announced as Commissioning Editor for Factual Entertainment

RT has announced that Teresa Smith has been appointed Commissioning Editor with responsibility for Factual Entertainment following a public competition. This s...

01/07/2025

RT is Supporting 26 Arts and Cultural Events across Ireland this July

This July, RT is delighted to support Galway International Arts Festival, Earagail Arts Festival in Donegal, Belfast TradFest and 23 other arts and cultural ev...

01/07/2025

How AI Factories Can Help Relieve Grid Stress

In many parts of the world, including major technology hubs in the U.S., there's a yearslong wait for AI factories to come online, pending the buildout of n...

30/06/2025

Discover Weekly Turns 10: Celebrating 100 Billion+ Tracks Streamed and a Decade of Personalized Discovery

There's nothing quite like the magic of finding music that feels made just f...

30/06/2025

Spotify's Editors Pick Their Best Songs of the Year (So Far)

When it comes to new music, Spotify's team of editors across North America is always on the hunt for songs that make them feel, think, and move. They're...

30/06/2025

SBS On Demand boosts global news offering with launch of France 24 FAST Channel

SBS On Demand boosts global news offering with launch of France 24 FAST Channel 30 June, 2025 Media releases SBS is expanding its international news offeri...

30/06/2025

The Forsytes Season 2 Commissioned by MASTERPIECE on PBS

Star Studded Ensemble Cast Are Joined by Richard Rankin as Filming Begins on the Second Season [June 12, 2025 - Boston, MA]: The Forsytes, Debbie Horsfield...

30/06/2025

Artemis II Mission Advances with Successful RS-25 Engine Checkout Tests

The Artemis II Space Launch System core stage is integrated with the solid rocket boosters inside High Bay 3 of the Vehicle Assembly Building at NASAs Kennedy S...

30/06/2025

WRAL-WRAZ Raleigh Names Heather Gray as VP and GM

RALEIGH, N.C. Capitol Broadcasting Co. has named Heather Gray vice president and general manager of WRAL-TV and WRAZ-TV here....

30/06/2025

VAB Awards JJ Freeman Engineering Award to Bill Sewell of WTKR/WGNT

The Virginia Association of Broadcasters has recognized Bill Sewell, Director of Engineering at WTKR & WGNT in Norfolk, Va. as the recipient of the 2025 J.J. Fr...

30/06/2025

SBE Recruits 49 New Members

The Society of Broadcast Engineers said its annual member drive resulted in the recruitment of 49 individual members....

30/06/2025

Avid Releases Full Integration of MediaCentral, Wolftech News

BURLINGTON, Mass. Avid today released its fully integrated news platform, uniting MediaCentral and Wolftech News in a single newsroom solution, and will demonst...

30/06/2025

FCC Fines Sinclair $500,000

WASHINGTON The Federal Communication's Enforcement and Media Bureaus have entered into a Consent Decree with Sinclair Broadcast Group to resolve a variety o...

30/06/2025

Qu-Bit announce the Bloom v2

Eurorack sequencer module reimagined California-based modular synth innovators Qu-Bit have announced the launch of a new module that offers a fresh new take...

30/06/2025

Berklee at Umbria Jazz Clinics to Host 40th Anniversary Concert

Berklee at Umbria Jazz Clinics to Host 40th Anniversary Concert The celebration will be held on July 10 in Perugia, Italy. By Colette Greenstein June 30, 202...

30/06/2025

PremiumBeat Tips and Tricks

PremiumBeat Tips and Tricks Brie Clayton June 30, 2025 0 Comments When editing to impress, you'll need quality music, and if your studio happens t...