Sony Pixel Power calrec Sony

How Deep Learning Is Aiding Preservation of Seneca and Other Endangered Languages

03/01/2019

Linguists estimate that at least half of the world's estimated 7,000 spoken languages will become extinct by the century's end, due to forces ranging from globalization to cultural assimilation.

Part of the challenge of documenting and revitalizing endangered languages is a lack of texts and speech recordings to work with. Seneca, a language of one of the six Iroquois Nations in North America, has only about 100 first-language speakers and several hundred more second-language learners.

Automatic speech recognition (ASR) technology is widely used to transcribe languages with millions or billions of speakers, like English and Mandarin. But it has only scratched the surface with languages like Seneca, which have vastly fewer speakers and significantly less data to work with.

Now a team of researchers at the Rochester Institute of Technology in New York, along with colleagues from the University at Buffalo, is tapping deep learning to bolster the ability of ASR. And while its focus is on Seneca, the project's vision encompasses the preservation of languages globally as well as an important part of our shared cultural history.

Knowing about different languages teaches us a lot about how our brain works, said Emily Prud'hommeaux, an assistant professor of computer science at Boston College and a research faculty member at RIT. When you document a language, you're preserving information not only about that language but also about how humans use language in general.

It's no coincidence that Prud'hommeaux and her team started with the Seneca language. Three members of the Seneca nation are part of the effort - a direct connection that is rare in research of this type, she said.

Leading the charge is Robbie Jimerson, a Ph.D. student in RIT's Golisano College of Computing and Information Science. He is a member of the Seneca Nation of Indians and is passionate about ensuring the survival of the Seneca language.

There's a big effort by the leaders of the tribe to preserve and promote our language, said Jimerson. I was looking for an opportunity to contribute.

Using GANs to Create More Language Samples Now in its third year, the project has had challenges when it comes to accumulating language data. Jimerson said the Seneca community can be guarded about what it shares with other people, so there wasn't an abundance of recordings of the language being spoken. He set out to change that.

He started by recording friends and elders who speak the language and asking them to record their friends. He found out whenever someone was speaking Seneca in public. He asked for family recordings of elders telling stories handed down from previous generations. And he grabbed any publicly available videos or recordings he could find online.

The team has fine-tuned an ASR model for Seneca, running it through generative adversarial networks to create more samples out of the limited number of recordings. The model turns wave files of the spoken language into streams of characters, while computing probability and making corrections.

The resulting data is fed into a deep learning model that in turn expands upon the ASR model's accuracy.

The team's networks run in two compute settings: on a nine-server machine learning lab running a variety of NVIDIA Tesla GPUs, and on a university cluster of large servers, each running 10 NVIDIA Tesla P4 GPUs. Each cluster runs a range of deep learning frameworks such as TensorFlow and Caffe.

The computer engineering cluster is for all students in the computer engineering department, and so they have to compete' for these resources, said Ray Ptucha, assistant professor of computer engineering at RIT, another collaborator on this project.

With access to these clusters at a premium, Jimerson tests code and checks the stability of models on a local machine running an NVIDIA TITAN X rather than inconvenience other students by running a model that might crash.

Achieving Better Accuracy So far, the team's efforts have brought the word error rate of its ASR model from 70 percent down to 56 percent. The goal, said Prud'hommeaux, is to get that rate down to 25 percent, which is where ASR systems were in processing English several years ago.

The more samples of spoken and written Seneca the team can accumulate, the more the error rate will decrease. (Today, English ASR models can achieve word error rates as low as 5 percent.)

The team's work is expected to help with language preservation efforts around the world.

Prud'hommeaux said the team has an agreement with an archiving institution that's a condition of a grant the project received from the National Science Foundation. The resulting language archiving database will be made available as a resource for other efforts seeking to document threatened languages.

Additionally, Prud'hommeaux said the team's work could prove helpful for any deep learning effort that has to make do with limited amounts of data.

Read more about the team's work in their research papers here and here.

Feature image: The Haudenosaunee (Iroquois Confederacy) flag, via Wikimedia Commons.
LINK: https://blogs.nvidia.com/blog/2019/01/02/deep-learning-preserves-senec...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

19/11/2026

Live From the UFL Draft: League's First Live Draft Broadcast Is Set To Innovate, Bring Viewers Close to the Action

With a sports-bar vibe and all the teams onsite in a huge atrium in Ballpark Vil...

19/11/2026

SVG Students To Watch: Niamh Campbell, Seton Hall University

The senior from Phoenix and England is balancing life as a Division I tennis player with a growing career behind the microphone The future of live sports produ...

19/11/2026

RED Connect Adds Native Colorfront Color Management for Live RED Camera Feeds

RED Digital Cinema and Colorfront have partnered to integrate native Colorfront color management into RED Connect, letting productions apply Colorfront's co...

19/11/2026

SMPTE Publishes Engineering Report on Content Provenance and Authenticity

SMPTE has published an engineering report summarizing an industry survey by its Study Group on Content Provenance and Authenticity in Media. The findings point ...

19/11/2026

CTech and Skyline Communications Partner on Integrated SATCOM Operations for Defense

CTech and Skyline Communications have announced a partnership to deliver integra...

19/11/2026

EITB Deploys SMPTE ST 2110 Infrastructure with Lawo HOME mc DSP Processing

Euskal Irrati Telebista (EITB), the Basque Country's public media group, has completed Phase 1 of a five-studio renewal with the commissioning of a Lawo IP ...

19/11/2026

Esports Foundation Expands Road to Esports Nations Cup 2027 with New Qualifiers, Larger Rosters and National Rankings

The Esports Foundation (EF) has announced an expanded Road to ENC 2027 for the E...

19/11/2026

AWSN Holds First Women's Sports Awards Show, VEON: Women Who Win, in New York City

All Women's Sports Network (AWSN) held its first awards show, VEON: Women W...

19/11/2026

Gracenote Extends DIRECTV Partnership for Sports Hubs

Gracenote, the content intelligence business unit of Nielsen, has extended its relationship with DIRECTV. Gracenote will continue to supply visual imagery and p...

19/11/2026

AES Technical Committee Expands Loudness Website with Dialogue Intelligibility Content

The Audio Engineering Society (AES) Technical Committee on Broadcast and Online ...

19/11/2026

NDI 6.4 Adds Recording and Playback APIs, HEVC 4:4:4 and Wi-Fi Receiver Buffer

NDI has released NDI 6.4, which adds Recording and Playback APIs, support for HEVC 4:4:4 and a configurable receiver buffer for Wi-Fi. The update also includes ...

19/11/2026

Lemonlight Announces Hero, an AI Production Operating System for Video

Lemonlight, the video production company behind more than 50,000 brand videos, has announced Hero, an AI production operating system, along with a new AI agent ...

19/11/2026

FanConnect Brings JPEG XS Beyond the Control Room, Cuts In-Venue IPTV Latency 89% for University of Maryland Athletics

In a first-of-its-kind deployment at XFINITY Center, the digital signage/display...

19/11/2026

NBCU Intros Peacock Performance View for Premier League Coverage

For the first time on a US streaming service, real-time player identification, contextual stats, and visual insights appear right in the live stream, available ...

19/11/2026

Dome Productions Director of Engineering Mike Johnson To Retire at Years End

His career runs from the 2-in. videotape era to Canada's first HD and UHD live-production facilities...

19/11/2026

SVG GFX Forum Returns to NYC on Feb. 24 to Unite Graphics Tech and Creative Leaders

The popular sports-graphics event features a new Chairperson and new venue...

19/11/2026

Josephine Explores the Lingering Impact of Violence Through a Child's Eyes

Beth de Ara jo, Gemma Chan, Channing Tatum and Mason Reeves attend the premiere of Josephine at Eccles Theatre on January 23, 2026, in Park City, UT. (Photo b...

19/11/2026

Expressive E release Maestro Brass

New performance-focused brass library announced Expressive E's latest release brings together four meticulously sampled brass instruments: sousaphone, b...

19/11/2026

Korg introduce phase8 companion

Acoustic synthesizer gains free web editor The phase8 acoustic synthesizer has been an ongoing project for Korg Berlin. It was unveiled as an early prototyp...

19/11/2026

Impact GX49 & GX61 Mk3 from Nektar

MIDI controller keyboards upgraded Designed for users who want a full-size keyboard and hands-on DAW control but in a relatively compact footprint, Nektar&#...

19/11/2026

IK Multimedia unveil the iLoud Micro Monitor 2

Hugely popular compact monitor overhauled IK Multimedia's ultra-compact monitors have proven to be incredibly popular, and the company say that they'...

19/11/2026

Rohde & Schwarz brings company-wide technology and service expertise to critical infrastructure

Rohde & Schwarz brings company-wide technology and service expertise to critical...

19/11/2026

Global Impact, Local Action: Highlights from Nielsen Global Impact Day 2026

On October 8, 2026, Nielsen employees came together around the world to celebrate our fourteenth company-wide day of service, Nielsen Global Impact Day (NGID). ...

19/11/2026

Nexxen and Gracenote Partner to Expand Content-Based Targeting for CTV

Integrating Gracenote's content intelligence with Nexxen's unique CTV supply allows advertisers to more closely align campaigns with audience viewing ha...

19/11/2026

Nielsen Further Evolves Audio Measurement With Introduction of 1-Minute Qualifier

Enhancement Mirrors Local TV's Recent Move to 1-Minute Qualifier (1MQ) Upda...

19/11/2026

Samba Combines Streaming, Linear TV Data

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Charting the Progress of Brazil TV 3.0 with VVC

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Skydance to Combine Warner Bros. Television Group and Paramount Television Studios

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , er...

19/11/2026

Australia's Seven Selects RTS Comms for New Headquarters

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Richard Burki Expands the Possibilities of Immersive Audi...

As Founder and Creative Director of Future Phonic Studios, the Netherlands' first Dolby Atmos music studio, Richard Burki has spent more than a decade pushi...

19/11/2026

Boris FX Black Friday Sale - 25% Off Everything

Boris FX Black Friday Sale - 25% Off Everything Brie Clayton November 19, 2026 0 Comments Check out the Boris FX Black Friday sale on Monday, November...

19/11/2026

Virtual Production Finds Its Middle Ground with Blackmagic Design

Virtual Production Finds Its Middle Ground with Blackmagic Design Brie Clayton November 19, 2026 0 Comments How Neon Vision is using PYXIS 12K and Ult...

19/11/2026

FL Studio Announces Black Friday Discounts of Up to 50% Across Its Software Lineup

FL Studio Announces Black Friday Discounts of Up to 50% Across Its Software Line...

19/11/2026

TBS Drama Series Tagusari Brothers Uses DaVinci Resolve Studio

TBS Drama Series Tagusari Brothers Uses DaVinci Resolve Studio Brie Clayton November 19, 2026 0 Comments TBS ACT streamlines post production for broad...

19/11/2026

Beeble launches SwitchX 3.0 with dynamic environments and greater creative control

Beeble launches SwitchX 3.0 with dynamic environments and greater creative contr...

19/11/2026

NDI Releases Latest Version With Recording, Playback APIs

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Newsmax Asks Court to Block Foxs Acquisition of Roku

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

HPA to Honor The Odyssey Director Christopher Nolan with Judges Award for Creativity and Innovation

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , er...

19/11/2026

Australian Professional Leagues Renews Partnership with B...

Five-year deployment has automated APL's media supply chain from fixture to archive, managing over 200,000 assets Blue Lucy, the workflow orchestration and...

19/11/2026

Riding the Australian wave through co-pros

Riding the Australian wave through co-pros 11 November 2026 L-R: The Surfer, We Bury the Dead Australian stories are captivating global audiences and attracti...

19/11/2026

Screen Australia and Australian Film Television and Radio School announce the First Nations Producer Fellowship Program 2027

Screen Australia and Australian Film Television and Radio School announce the Fi...

19/11/2026

AES Adds Dialogue Intelligibility to Loudness Website

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Rise Awards 2026 Celebrate Inspirational Women in Broadcast

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

BPS Trial at Dominion Energy Substation Proves Successful

Share {alert(Link copied)}).catch(err => {console.error(Failed to copy: , err)}) data-platform=copy_link data-action= class=font-ui-heading py-2 text-sm tex...

19/11/2026

Wisycom and DPA Prove Essential for Demanding and Unpredi...

iStreamU LLC, a rapidly growing production and systems integration company founded by longtime Producer/Director Ivan Gonzalez, has standardized its audio workf...

19/11/2026

Seven Scripps Research scientists named to Clarivate's 2026 list of Highly Cited Researchers

LA JOLLA, CA-Clarivate, a global information and analytics company, named seven ...

19/11/2026

Kerry Godliman takes star comedians on brand new U series, Kerry On Camping

Frank Skinner, Judi Love and Richard Ayoade join Kerry Godliman for three outdoor adventures across Dorset, Wales and Norfolk. Kerry Godliman is swapping comed...

19/11/2026

The Day of the Jackal: Eddie Redmayne returns in first-look teaser for series 2 of global hit Sky Original, coming March 2027

Thursday 19 November 2026 The Day of the Jackal: Eddie Redmayne returns in firs...

19/11/2026

Why the world needs the next generation at the standards table

When I first started my career in lighting engineering, it felt cutting edge and rewarding to be designing solutions that affect all of us every day, whether at...