Sony Pixel Power calrec Sony

Inside AI: NVIDIA DRIVE Ecosystem Creates Pioneering In-Cabin Features With NVIDIA DRIVE IX

21/09/2022

As personal transportation becomes electrified and automated, time in the vehicle has begun to resemble that of a living space rather than a mind-numbing commute.

Companies are creating innovative ways for drivers and passengers to make the most of this experience, using the flexibility and modularity of NVIDIA DRIVE IX. In-vehicle technology companies Cerence, Smart Eye, Rightware and DSP Concepts are now using the platform to deliver intelligent features for every vehicle occupant.

These partners are joining a diverse ecosystem of companies developing on DRIVE IX, including Soundhound, Jungo and VisionLabs, providing cutting-edge solutions for any in-vehicle need.

DRIVE IX provides an open software stack for cockpit solution providers to build and deploy features that will turn personal vehicles into interactive environments, enabling intelligent assistants, graphic user interfaces and immersive media and entertainment.

Intelligent Assistants AI isn't just transforming the way people drive, but also how they interact with cars.

Using speech, gestures and advanced graphical user interfaces, passengers can communicate with the vehicle through an AI assistant as naturally as they would with a human.

An intelligent assistant will help to operate vehicle functions more intuitively, warn passengers in critical situations and provide services such as giving local updates like the weather forecast, making reservations and phone calls, and managing calendars.

Conversational AI Interaction Software partner Cerence is enabling AI-powered, voice-based interaction with the Cerence Assistant, its intelligent in-car assistant platform.

Cerence Assistant uses sensor data to serve drivers throughout their daily journeys, notifying them, for example, when fuel or battery levels are low and navigating to the nearest gas or charging station.

It features robust speech recognition, natural language understanding and text-to-speech capabilities, enhancing the driver experience.

Courtesy of Cerence Using DRIVE IX, it can empower both embedded and cloud-based natural language processing on the same architecture, ensuring drivers have access to important capabilities regardless of connectivity.

Cerence Assistant also supports major global markets and related languages, and is customizable for brand-specific speech recognition and personalization.

Gesture Recognition In addition to speech, passengers can interact with AI assistants via gesture, which relies on interior sensing technologies.

Smart Eye is a global leader in AI-based driver monitoring and interior sensing solutions. Its production driver-monitoring system is already in 1 million vehicles on the roads around the world, and will be incorporated in the upcoming Polestar 3, set to be revealed in October.

Working with DRIVE IX, Smart Eye's technology makes it possible to detect eye movements, facial expressions, body posture and gestures, bringing insight into people's behavior, activities and mood.

Courtesy of Smart Eye Using NVIDIA GPU technology, Smart Eye has been able to speed up its cabin-monitoring system - which consists of 10 deep neural networks running in parallel - by more than 10x.

This interior sensing is critical for safety - ensuring driver attention is on the road when it should be and detecting left-behind children or pets - and it customizes and enhances the entire mobility experience for comfort, wellness and entertainment.

Graphical User Interface AI assistants can communicate relevant information easily and clearly with high-resolution graphical interfaces. Using DRIVE IX, Rightware is creating a seamless visual experience across all cockpit and infotainment domains.

Caption: Courtesy of Rightware Rightware's automotive human-machine interface tool Kanzi One helps designers bring amazing real-time 3D graphical user interfaces into the car and hides the underlying operating system and framework complexity. Automakers can completely customize the vehicle's user interface with Kanzi One, providing a brand-specific signature UI.

Enhancing visual user interfaces by audio features is equally important for interacting with the vehicle. The Audio Weaver development platform from DSP Concepts can be integrated into the DRIVE IX advanced sound engine. It provides a sound design toolchain and audio framework to graphically design features.

Courtesy of DSP Concepts. Creators and sound artists can design a car- and brand-specific sound experience without the hassle of writing complex code for low-level audio features from scratch.

Designing in Simulation With NVIDIA DRIVE Sim on Omniverse, developers can integrate, refine and test all these new features in the virtual world before implementing them in vehicles.

Interior sensing companies can build driver- or occupant-monitoring models in the cockpit using the DRIVE Replicator synthetic-data generation tool on DRIVE Sim. Partners providing content for vehicle displays can first develop on a rich, simulated screen configuration.

Access to this virtual vehicle platform can significantly accelerate end-to-end development of intelligent in-vehicle technology.

By combining the flexibility of DRIVE IX with leading in-cabin solutions providers, spending time in the car can become a luxury rather than a chore.
LINK: https://blogs.nvidia.com/blog/2022/09/21/drive-ix-ecosystem/...
See more stories from nvidia

Most recent headlines

07/12/2022

Dalet Flex Takes a Leap Forward

Dalet, a leading technology and service provider for media-rich organizations, today announced key new capabilities available in Dalet Flex that support importa...

04/11/2022

Game better with DTS Headphone:X

The best gamers know DTS Headphone:X technology ups their play. Now major magazines have caught on, too. DTS Headphone:X technology creates immersive soundsc...

08/10/2022

Dalet Next-Gen Solutions at IBC 2022

Dalet, a leading technology and service provider for media-rich organizations, is pleased to announce its return to the IBC Show, held in Amsterdam from Septemb...

29/09/2022

GSMA MWC LAS VEGAS 2022, IN PARTNERSHIP WITH CTIA, MAKES ITS PREMIERE

GSMA MWC LAS VEGAS 2022, IN PARTNERSHIP WITH CTIA, MAKES ITS PREMIERE Mobile Economy North America Report Finds Mobile Operators' 5G Deployment Plans Keep ...

29/09/2022

GSMA, IBM and Vodafone Establish Post-Quantum Telco Network Taskforce

New taskforce will support the roadmap for post-quantum cryptography and adoption across the global telecommunications supply chain 29 September 2022, MWC Las ...

29/09/2022

Consumers Spend Only One Third of TV Viewing Time on Traditional Platforms

NEW ROCHELLE, N.Y. A new report from Horowitz Research documents just how radically viewing patterns have shifted in recent years with viewers now reporting tha...

29/09/2022

Ian Forces Ft. Myers CBS Affiliate Off-Air

FT. MYERS, Fla. As broadcasters banded together to report on one of Florida's most devastating storms in its history, one TV station was taken off the air d...

29/09/2022

Going over-the-top with OTT: The broadcasters' Catch 22

Thomas Bostr m J rgensen, CEO, Appear, queries whether broadcasters should go all in on the next generation, or maintain focus on their declining pool of tradit...

29/09/2022

Google Taps iWedia to Deliver Live TV App

LAUSANNE, Switzerland iWedia, a major provider of software components and solutions for connected TV devices, has announced that it is working with Google to de...

29/09/2022

Fox Weather Relying on 'Fox Model' For 24/7 Hurricane Coverage

NEW YORK As hurricane Ian slams into Florida with 150 mile-per-hour winds, Fox Weather has announced it will be providing 24/7 live coverage of the storm and th...

29/09/2022

Is Local OTT Ad Spending About to Surpass Traditional TV?

CHANTILLY, Va While traditional OTA broadcasting still garners the majority of TV marketing bucks, the OTT TV market is the fastest growing segment when it come...

29/09/2022

The Godfather director chooses virtual production for latest project

Francis Ford Coppola will use both traditional and virtual production for his latest film, Megalopolis By Jenny Priestley Published: September 29, 2022 Fra...

29/09/2022

Sony launches new 4K Super 35 camera for future filmmakers

The camera includes a number of professional features such as Dual Base ISO, Log shooting modes, and user-imported LUTs By Jenny Priestley Published: Septembe...

29/09/2022

Dish Reaches Carriage Agreement with Game Show Network

ENGLEWOOD, Colo. Dish and the Game Show Network have reached a new multi-year carriage agreement that restores the channel to Dish TV and Sling TV and ends a th...

29/09/2022

Public Broadcasters Losing Viewers Due to Cable Headend Consolidation

WASHINGTON Public broadcasters are urging the FCC to consider its unique position in the U.S. broadcasting environment when it comes to using DMA data to determ...

29/09/2022

EPIX to Relaunch as MGM+ in Jan. 2023

LOS ANGELES MGM's premium EPIX service has announced that it will be relaunching and rebranding as MGM+ in January 2023....

29/09/2022

Consumers Spend Only One Third of Viewing Time on Traditional Platforms

NEW ROCHELLE, N.Y. A new report from Horowitz Research documents just how radically viewing patterns have shifted in recent years with viewers now reporting tha...

29/09/2022

Filmmaker and Catch Magazine Founder Todd Moen captures the natural beauty of fly-fishing with the new Panasonic HC-X2 camcorder

Filmmaker and Catch Magazine Founder Todd Moen captures the natural beauty of fl...

29/09/2022

Sony Electronics Expands Cinema Line with New 4K Super 35 Camera for Future Filmmakers

Sony Electronics Expands Cinema Line with New 4K Super 35 Camera for Future Film...

29/09/2022

Job Listing: Multimedia Producer R013039

Job Listing: Multimedia Producer R013039 Brie Clayton September 29, 2022 0 Comments Multimedia Producer R013039 ### Looking for work? Sign up for th...

29/09/2022

Job Listing: Production Assistant News R013052

Job Listing: Production Assistant News R013052 Brie Clayton September 29, 2022 0 Comments Production Assistant News R013052 ### Looking for Work? Si...

29/09/2022

Job Listing: Technical Director 60 - 100% (m/w/d)

Job Listing: Technical Director 60 - 100% (m/w/d) Brie Clayton September 29, 2022 0 Comments Technical Director 60 100% (m/w/d) ### Enjoying the n...

29/09/2022

Sharon Osbourne: To Hell & Back' on Fox Nation September 26

Sharon Osbourne: To Hell & Back premieres on Fox Nation September 26. There are four parts, Fox Nation promising a candid and heartfelt look into Osbourne'...

29/09/2022

Allen Media Group's Local Now Launches 27 Hearst Very Local News Channels

Allen Media Group and Hearst Television said they reached an agreement under which Allen's Local Now free streaming service will carry 27 of Hearsts Very Lo...

29/09/2022

OpenAP Goes Programmatic With OpenID Across Platforms

OpenAP said advertisers can now buy commercials programmatically on linear TV and digital video using OpenID audiences....

29/09/2022

TripleLift, Zype Bring In-Show Ads to CTV Programmatically

Video platform Zype and ad tech company TripleLift said they are working together to offer in-show advertising placements that can be inserted in connected TV s...

29/09/2022

KRIV Houston Debuts The Nightcap' October 10

KRIV Houston, known as Fox 26, premieres weeknight program The Nightcap October 10 in the 11:30 p.m. CT slot. The show will explore all of the taboo and provoc...

29/09/2022

NBC Shares First Five Minutes of La Brea' Season Two on YouTube

Season two of La Brea premieres on NBC Tuesday, September 27. NBC has made the first five minutes of the season premiere available on Peacock and on NBC's Y...

29/09/2022

New Globetrotters Show Offers More Than Trick Shots

Hearst Media Production Group offered the media a peek at Harlem Globetrotters: Play It Forward, which was screened with some Globetrotters in attendance at the...

29/09/2022

Syndication Ratings: Jennifer Hudson,' Sherri' Hold Their Own in National Debut

Jennifer Hudson and Sherri syndication's two major new talk entries made...

29/09/2022

The Rookie: Feds' Will Tell Bigger Stories' Thanks To Its Federal Focus

The Rookie: Feds, a spinoff of The Rookie, starts on ABC September 27. The spinoff was introduced in a two-part event during season four of The Rookie, when Off...

29/09/2022

Game Show Network Makes a Deal To Return to Dish Network

Dish Network said it reached a new carriage agreement with Game Show Network, ending a three-week blackout....

29/09/2022

Netflix Boards Dark Wire'; Jason Bateman to Direct Feature Adaptation

Back to All News Netflix Boards Dark Wire'; Jason Bateman to Direct Feature Adaptation Entertainment 29 September 2022 GlobalUnited States Netflix has...

29/09/2022

Pigment: The true colors of next-gen business planning

By: Ajay Vashee, Somesh Dash, Michael Miao, James Black Business growth is often a function of planning and forecasting - financial, resource, product, sales, ...

29/09/2022

Nico Rossmann Joins Banijay Germany's Brainpool TV

Banijay today announces Nico Rossman will join Brainpool TV GmbH, part of Banijay Germany, as the Co-Managing Director, where he will be responsible for oversee...

29/09/2022

More of the hottest Korean shows premiere on Astro this October

29 September 2022 More of the hottest Korean shows premiere on Astro this October Cheer Up, Gaus Electronics, Three Bold Siblings, Vengeance of The Bride an...

29/09/2022

ARRI honored with Engineering Emmy for more than a century of creativity and technology

At the 74th Engineering, Science & Technology Emmy Awards ceremony on September...

29/09/2022

Roku enables brand new cross-media measurement of Traditional TV, Connected TV, Desktop, and Mobile Ad Campaigns together with Nielsen

Marketers can now deduplicate campaign reach and frequency of ads on Roku across...

29/09/2022

Actress Lusanda Mbane confirms Imbewu: The Seed' departure

Actress Lusanda Mbane confirms Imbewu: The Seed' departureActress Lusanda Mbane, who played the villainous Makhosazana in Imbewu: The Seed' confirmed ...

29/09/2022

Top 10 Rihanna songs RANKED

Top 10 Rihanna songs RANKEDRanking the ultimate pop bangers churned out by Rihanna over the years isn't an easy task, but somebody has to do it. by James ...

29/09/2022

Uzalo': Bonga Dlamini back as Mkhonto to shake things up

Uzalo': Bonga Dlamini back as Mkhonto to shake things upWith news of Nosipho's pregnancy about to hit the rumour mill, her father's brother is back ...

29/09/2022

WATCH: The Queen - Tonight's teaser E50 S7

WATCH: The Queen - Tonight's teaser E50 S7Don't miss out on what's happening on tonight's episode of The Queen and Catch the latest episode ever...

29/09/2022

WATCH: Imbewu - The Seed, tonight's teaser E121 S5

WATCH: Imbewu - The Seed, tonight's teaser E121 S5Catch up on what's going on to night on Imbewu by SA TV and Soapies 29-09-2022 16:04 in Soapies ...

29/09/2022

WATCH: Uzalo- Tonight's teaser E149 S8

WATCH: Uzalo- Tonight's teaser E149 S8Don't get left behind, catch up on Uzalo now! by SA TV and Soapies 29-09-2022 16:06 in Soapies Thursday'...

29/09/2022

WATCH: 7de Laan - Tonight's teaser E459 S22

WATCH: 7de Laan - Tonight's teaser E459 S22Don't miss out on what's happening on tonight's episode of 7de Laan and Catch the latest episode ever...

29/09/2022

WATCH: Scandal - Tonight's teaser E130 S14

WATCH: Scandal - Tonight's teaser E130 S14Get to know what's happening on tonight's episode! by SA TV and Soapies 29-09-2022 16:12 in Scandal ...

29/09/2022

WATCH: Generations - The Legacy, tonight's teaser E224 S8

WATCH: Generations - The Legacy, tonight's teaser E224 S8Keen to know what's happening on the latest episode of Generations: The Legacy? by SA TV and ...

29/09/2022

RIP Coolio: 5 hip-hop bangers by the legendary rapper [watch]

RIP Coolio: 5 hip-hop bangers by the legendary rapper [watch] Gangsta's Paradise', Fantastic Voyage' and more: Here are five of legendary rapper Co...

29/09/2022

WATCH: Diep City - Tonight's teaser E129 S2

WATCH: Diep City - Tonight's teaser E129 S2We've got you covered on what's happening tonight. by SA TV and Soapies 29-09-2022 16:16 in Soapies ...