Sony Pixel Power calrec Sony

Now You're Speaking My Language: NVIDIA Riva Sets New Bar for Fully Customizable Speech AI

21/09/2022

Whether for virtual assistants, transcriptions or contact centers, voice AI services are turning words and conversations into bits and bytes of business magic.

At GTC this week, NVIDIA announced new additions to NVIDIA Riva, a GPU-accelerated software development kit for building and deploying speech AI applications.

Riva's pretrained models are now offered in seven languages, including French and Hindi. Additional languages on the horizon: Arabic, Italian, Japanese, Korean and Portuguese. Riva also brings improvements in accuracy for English, German, Mandarin, Russian and Spanish. Additionally, it adds capabilities like word-level confidence scores and speaker diarization - the process of identifying speakers in audio streams.

Riva is built to be fully customizable at every stage of the speech AI pipeline to help solve unique problems efficiently. Developers can also deploy it where they want their data to be: on premises, for hybrid multiclouds, at the edge or in embedded devices. It's used by enterprises to bolster services, efficiency and competitive advantage.

While AI for voice services has been in high demand, development tools have lagged. More people are working and learning from home, shopping online and seeking remote customer support, which strains call centers and pushes voice applications to their limits. Customer service wait times have recently tripled as staffing shortages have hit call centers hard, according to a 2022 Bloomberg report.

Advances in speech AI offer the way forward. NVIDIA Riva enables companies to explore larger deep learning models and develop more nuanced voice systems. Speech AI applications built on Riva provide an accelerated path to better services, promising improved customer experiences and engagement.

Rising Demand for Voice AI Applications The worldwide market for contact center software reached about $27 billion in 2021, a figure expected to nearly triple to $79 billion by 2029, according to Fortune Business Insights.

This increase is due to the benefits that customized voice applications offer businesses of any size, in almost every industry - from global enterprises, to original equipment manufacturers delivering speech AI-based systems and cloud services, to systems integrators and independent software vendors.

Riva SDK Accelerates AI Workflows NVIDIA Riva includes pretrained language models that can be used as is or fine-tuned using transfer learning from the NVIDIA TAO Toolkit, which allows for custom datasets in a no-code environment. Riva automated speech recognition (ASR) and text-to-speech (TTS) models can be optimized, exported and deployed as speech services.

Voice AI is making its way into ever more types of applications, such as customer support virtual assistants and chatbots, video conferencing systems, drive-thru convenience food orders, retail by phone, and media and entertainment. Global organizations have adopted Riva to drive voice AI efforts, including T-Mobile, Deloitte, HPE, Interactions, 1-800-Flowers.com, Quantiphi and Kore.ai.

T-Mobile adopted Riva for its T-Mobile Expert Assist - a custom-built call center application that uses AI to transcribe real-time customer conversations and recommend solutions - for 17,000 customer service agents. T-Mobile plans to deploy Riva worldwide soon.

Hewlett Packard Enterprise offers HPE ProLiant servers that include NVIDIA GPUs and NVIDIA Riva software in a system capable of developing and running challenging speech AI and natural language processing workloads that can easily turn audio into insights. HPE ProLiant systems and NVIDIA Riva form a world-class, full-stack solution for running financial services and other industry applications.

To deliver the capabilities of NVIDIA Riva, HPE offers a Kubernetes-based NLP reference architecture based on HPE Ezmeral software, said Scott Ramsay, vice president of HPE GreenLake solutions at HPE. Delivered through the HPE GreenLake cloud platform, this system enables developers to accelerate the development and deployment of next-generation speech AI applications.

Deloitte supports clients looking to deploy ASR and TTS use cases, such as for order-taking systems in some of the world's largest quick-order restaurants. It's also developing chatbot services for healthcare providers that will enable accurate and efficient transcriptions for patient questions and chat summarizations.

Advances in natural language processing make it possible to design cost-efficient experiences that enable purposeful, simple and natural customer conversations, said Christine Ahn, principal at Deloitte US. Our clients are looking for a streamlined path to conversational AI deployment, and NVIDIA Riva supports that path.

Interactions has integrated Riva with its Curo software platform to create seamless, personalized engagements for customers in a broad range of industries that include telecommunications, as well as for companies such as 1-800-Flowers.com, which has deployed a speech AI order-taking system.

Kore.ai is integrating Riva with its SmartAssist speech AI contact-center-as-a-service, which powers its BankAssist, HealthAssist, AgentAssist, HR Assist and IT Assist products. Proof of concepts with NVIDIA Riva are in progress.

Quantiphi is a solution-delivery partner that is developing closed-captioning solutions using Riva for customers in media and entertainment, including Fox News. It's also developing digital avatars with Riva for telecommunications and other industries.

Complex Speech AI Pipelines, Easier Solutions Speech AI pipelines can be complex and require coordination across multiple services. Microservices are required to run at scale with ASR models, natural language understanding, TTS and domain-specific apps. NVIDIA GPUs are ideal for acceleration of these types of specialized tasks.

Riva offers softwar
LINK: https://blogs.nvidia.com/blog/2022/09/21/riva-speech-ai/...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

02/09/2026

Shotoku To Introduce Aura E2 PTZ Elevator At IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

02/09/2026

AJA to Launch New openGear SDI/Fiber Conversion Cards at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

02/09/2026

GoPro to Merge with Starman Optical

Share Copy link Facebook X Linkedin Bluesky Email...

02/09/2026

AIMS, EBU Completes Latest IPMX Certification Testing

Share Copy link Facebook X Linkedin Bluesky Email...

02/09/2026

EVS To Showcase New Neuron 4X Processor At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

02/09/2026

Sony Launches 100+ FAST Channels on Playstation 5 in the U.S.

Share Copy link Facebook X Linkedin Bluesky Email...

02/09/2026

Canon Unveils PTZ Camera Firmware Updates

Share Copy link Facebook X Linkedin Bluesky Email...

02/09/2026

EverPass Media Expands NFL Offering with Netflix Deal

Share Copy link Facebook X Linkedin Bluesky Email...

02/09/2026

Imagine Communications Unveils Latest Control Portfolio A...

Next-Generation Freeform Control Surfaces Lay the Foundation for AI-Enabled Media Operations At IBC2026 (Sept. 11 14, RAI Amsterdam, Stand #1.B73), Imagine Com...

02/09/2026

Friedrichstadt-Palast Relies on Riedel for IP-Centered Pr...

Friedrichstadt-Palast in Berlin, the world's largest theater stage, has modernized its backstage production infrastructure with a comprehensive Riedel solut...

02/09/2026

WiM to Host Reel Forward Production Conference at CSU Los...

Women in Media announces that it will host the two-day Reel/Forward in-person conference devoted to navigating today's production scene. Guests can enjoy pa...

02/09/2026

Teradek and New Media AV Expand Partnership with Full Liv...

The expanded partnership brings Teradek's Live Production solutions to New Media AV's European dealer and integrator network, opening new opportunities ...

02/09/2026

QuickLink Expands StudioEdge With WhatsApp Cisco Webex an...

QuickLink, a leading provider of award-winning video production and remote guest contribution solutions, announces a major expansion to its award winning Studio...

02/09/2026

Vipe by BCNEXXT Gives Foxtel a New Playout Model for its...

BCNEXXT, the developers of the advanced playout platform Vipe, today announced that premium entertainment brand Foxtel has selected Vipe to underpin playout for...

02/09/2026

HOT Telecommunications supercharges localisation efficien...

SubtitleNEXT helps HOT Telecom's subtitling team keep a cool head with reliable QC capabilities Profuz Digital, global developer of digital media and local...

02/09/2026

Case Study - Mission Digital Strengthens Battery Safety w...

Case Study: Mission Digital Strengthens Battery Safety with Safe-ion As productions become increasingly dependent on battery-powered equipment, the safe storag...

02/09/2026

New design strategy expands nanoparticle vaccine approach to influenza viruses

LA JOLLA, CA-Influenza viruses constantly shapeshift to evade recognition by the immune system. This shapeshifting occurs in critical proteins like hemagglutini...

02/09/2026

New AI algorithm could improve detection and prediction of heart diseases

LA JOLLA, CA-Clinicians often use a medical test called a 12-lead electrocardiogram (ECG) to diagnose heart problems, which uses electrodes placed on the chest ...

02/09/2026

Where milliseconds matter: Scripps Research scientists build new ML model to predict protein movements essential for biological function

LA JOLLA, CA-Proteins may look like rigid molecular structures, but inside our c...

01/09/2026

IBC 2026: Bridge Technologies Adds Blackmagic IP10 Support to VB440 Production Probe

Bridge Technologies will announce at IBC2026 (Booth 1.A71) that its VB440 produc...

01/09/2026

DAZN to Acquire EverPass Media to Expand U.S. Commercial Venue Distribution

DAZN has announced an agreement to acquire EverPass Media, a commercial sports distribution platform serving bars, restaurants, hotels, and other venues in the ...

01/09/2026

Kalshi Named Official Prediction Market Partner of the US Open

The USTA and Kalshi have announced a multi-year partnership making Kalshi the Official Prediction Market Partner of the US Open, beginning with the 2026 US Open...

01/09/2026

IBC 2026: MASV to Showcase Sports Video Transfer Workflows

MASV will exhibit at IBC2026 (Booth 5.B40, RAI Amsterdam, September 11-14). CTO Majed Alhajry will appear on a panel session, A Tale of Two Feeds: Automation o...

01/09/2026

IBC 2026: FingerWorks Telestrators Partners with Broadcast Rental for European Distribution

FingerWorks Telestrators has announced a partnership with Broadcast Rental to ex...

01/09/2026

IBC 2026: FOR-A Expands viztrick AiDi into Two Dedicated Products

FOR-A has announced the expansion of viztrick AiDi into two dedicated products: Go Vertical! AiDi and AiDi Sports Hub. Developed by Nippon TV and delivered glob...

01/09/2026

Sony Launches Live TV on PS5 with Free Ad-Supported Streaming in the U.S.

Sony Pictures Television has launched Live TV on PS5, a free ad-supported streaming experience available to PS5 players in the United States. The service is acc...

01/09/2026

Friedrichstadt-Palast Installs Riedel Production Infrastructure

Friedrichstadt-Palast in Berlin has installed a Riedel production infrastructure spanning video, intercom, control, and I/O across the venue, implemented in col...

01/09/2026

IBC 2026: Arkona Partners with BFE for Arkona-Branded Control Panels

Arkona technologies GmbH has announced an OEM partnership with BFE Studio und Medien Systeme GmbH to offer arkona-branded control panels for its SDI-IP routing ...

01/09/2026

Cricket Australia Launches Cricket TV Streaming Service on Eluvio Platform

Cricket Australia has launched Cricket TV, a direct-to-consumer streaming service built on Eluvio's Content Fabric platform. The service is currently in ear...

01/09/2026

Eluvio Selected to Power Pasifika+ Streaming Service for Pacific Island Communities

Eluvio has announced it was selected to power Pasifika , a new direct-to-consume...

01/09/2026

Layercake Names Jon Marquard as Director/Chairperson

Layercake, the company behind the intelligent media workflow platform Streamcake, has appointed Jon Marquard as Director and Chairperson. The appointment marks ...

01/09/2026

Gravity Media Extends Powercor Stawell Gift Broadcast Agreement Through 2031

Gravity Media has announced a multi-year renewal of its agreement with Stawell Gift Event Management to produce the complete broadcast of the Powercor Stawell G...

01/09/2026

IBC 2026: Beam Dynamics Makes Debut with License Intelligence Module

Beam Dynamics will exhibit at IBC2026 for the first time (Stand 14.FT29, Hall 14), introducing License Intelligence, a new module for managing software licenses...

01/09/2026

ZOO Digital Selects Interra Systems BATON for File-Based Quality Control

Interra Systems has announced that ZOO Digital has selected BATON for file-based quality control across its media workflows. ZOO Digital delivers localized ente...

01/09/2026

IBC 2026: Bridge Technologies Deploys VB330 Monitoring at Sunrise

Bridge Technologies has announced the deployment of its VB330 monitoring probe at Sunrise, supporting the Swiss telecommunications provider's IP-based telev...

01/09/2026

Riedel Expands Coach Communications Partnership with Scottish Rugby Union

Riedel Communications has announced the continued expansion of its managed coach communications partnership with Scottish Rugby Union, now entering its third se...

01/09/2026

Behind The Mic: Football Season Approaches, as Networks Name On Air Talent for NFL, College Broadcasts

Behind The Mic provides a roundup of recent news regarding on-air talent, includ...

01/09/2026

IBC 2026: SMPTE Brings Full-Day Software-Defined Infrastructure Roadshow

SMPTE today detailed the centerpiece of its IBC2026 program: the SMPTE Roadshow: Future of Media Infrastructure, a full-day workshop on Monday, 14 September, th...

01/09/2026

Sound Particles & SOS Webinar: John Warhurst

Inside the Music and Sound of Michael Sound Particles have announced an upcoming webinar with John Warhurst, the Academy Award- and BAFTA-winning supervisin...

01/09/2026

Roland launch FP-40 piano & Piano Sphere app

Piano offers tutorials, lessons & feedback via app Roland have just launched a new digital piano that integrates with a mobile app in an effort to encourage...

01/09/2026

Trinnov Nova goes immersive

Update introduces 7.1.4 support via Dante Trinnov have just announced a software update that will allow Nova units with eight licensed Optimizer channels to...

01/09/2026

SBS secures exclusive rights to FIFA World Cup 2030

SBS secures exclusive rights to FIFA World Cup 2030 1 September, 2026 Media releases Major sports rights deal ensures all Australians will be able to view...

01/09/2026

SBS announces the launch of outcomes-based measurement across its network

SBS announces the launch of outcomes-based measurement across its network 1 September, 2026 Media releases New offer sees national broadcaster put outcomes...

01/09/2026

Revealed: The Booster Economy' how $140bn+ in everyday inheritances' is funding the lifestyles of the next generation

Revealed: The Booster Economy' how $140bn+ in everyday inheritances'...

01/09/2026

SBS census explorer to provide new insights into contemporary Australia

SBS census explorer to provide new insights into contemporary Australia 1 September, 2026 Media releases The 2026 Census Explorer will give marketers new i...

01/09/2026

SBS and oOh!media launch exclusive SBS News content partnership across office, airports and universities

SBS and oOh!media launch exclusive SBS News content partnership across office, a...

01/09/2026

SBS offers marketers greater reach with extension into outdoor, creator economy and retail

SBS offers marketers greater reach with extension into outdoor, creator economy ...