Sony Pixel Power calrec Sony

How Deep Learning Is Aiding Preservation of Seneca and Other Endangered Languages

03/01/2019

Linguists estimate that at least half of the world's estimated 7,000 spoken languages will become extinct by the century's end, due to forces ranging from globalization to cultural assimilation.

Part of the challenge of documenting and revitalizing endangered languages is a lack of texts and speech recordings to work with. Seneca, a language of one of the six Iroquois Nations in North America, has only about 100 first-language speakers and several hundred more second-language learners.

Automatic speech recognition (ASR) technology is widely used to transcribe languages with millions or billions of speakers, like English and Mandarin. But it has only scratched the surface with languages like Seneca, which have vastly fewer speakers and significantly less data to work with.

Now a team of researchers at the Rochester Institute of Technology in New York, along with colleagues from the University at Buffalo, is tapping deep learning to bolster the ability of ASR. And while its focus is on Seneca, the project's vision encompasses the preservation of languages globally as well as an important part of our shared cultural history.

Knowing about different languages teaches us a lot about how our brain works, said Emily Prud'hommeaux, an assistant professor of computer science at Boston College and a research faculty member at RIT. When you document a language, you're preserving information not only about that language but also about how humans use language in general.

It's no coincidence that Prud'hommeaux and her team started with the Seneca language. Three members of the Seneca nation are part of the effort - a direct connection that is rare in research of this type, she said.

Leading the charge is Robbie Jimerson, a Ph.D. student in RIT's Golisano College of Computing and Information Science. He is a member of the Seneca Nation of Indians and is passionate about ensuring the survival of the Seneca language.

There's a big effort by the leaders of the tribe to preserve and promote our language, said Jimerson. I was looking for an opportunity to contribute.

Using GANs to Create More Language Samples Now in its third year, the project has had challenges when it comes to accumulating language data. Jimerson said the Seneca community can be guarded about what it shares with other people, so there wasn't an abundance of recordings of the language being spoken. He set out to change that.

He started by recording friends and elders who speak the language and asking them to record their friends. He found out whenever someone was speaking Seneca in public. He asked for family recordings of elders telling stories handed down from previous generations. And he grabbed any publicly available videos or recordings he could find online.

The team has fine-tuned an ASR model for Seneca, running it through generative adversarial networks to create more samples out of the limited number of recordings. The model turns wave files of the spoken language into streams of characters, while computing probability and making corrections.

The resulting data is fed into a deep learning model that in turn expands upon the ASR model's accuracy.

The team's networks run in two compute settings: on a nine-server machine learning lab running a variety of NVIDIA Tesla GPUs, and on a university cluster of large servers, each running 10 NVIDIA Tesla P4 GPUs. Each cluster runs a range of deep learning frameworks such as TensorFlow and Caffe.

The computer engineering cluster is for all students in the computer engineering department, and so they have to compete' for these resources, said Ray Ptucha, assistant professor of computer engineering at RIT, another collaborator on this project.

With access to these clusters at a premium, Jimerson tests code and checks the stability of models on a local machine running an NVIDIA TITAN X rather than inconvenience other students by running a model that might crash.

Achieving Better Accuracy So far, the team's efforts have brought the word error rate of its ASR model from 70 percent down to 56 percent. The goal, said Prud'hommeaux, is to get that rate down to 25 percent, which is where ASR systems were in processing English several years ago.

The more samples of spoken and written Seneca the team can accumulate, the more the error rate will decrease. (Today, English ASR models can achieve word error rates as low as 5 percent.)

The team's work is expected to help with language preservation efforts around the world.

Prud'hommeaux said the team has an agreement with an archiving institution that's a condition of a grant the project received from the National Science Foundation. The resulting language archiving database will be made available as a resource for other efforts seeking to document threatened languages.

Additionally, Prud'hommeaux said the team's work could prove helpful for any deep learning effort that has to make do with limited amounts of data.

Read more about the team's work in their research papers here and here.

Feature image: The Haudenosaunee (Iroquois Confederacy) flag, via Wikimedia Commons.
LINK: https://blogs.nvidia.com/blog/2019/01/02/deep-learning-preserves-senec...
See more stories from nvidia

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

09/10/2026

Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026

September 10 2026, 06:00 (PDT) Dolby Expands Dolby OptiView Platform with New Capabilities at IBC 2026 New Sports Intelligence helps providers better unders...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

15/09/2026

Study: 3 in 4 U.S. TV Viewers Use Smartphones While Watching TV

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Agent TiVo Will Help Track Down Your Show

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Nielsen Marketing Cloud Launches Data Enrichment Capabilities

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Six Berklee Alumni Win at 2026 Emmy Awards

Six Berklee Alumni Win at 2026 Emmy Awards The recipients were recognized for their contributions to Widow's Bay, Beef, South Park, and Bad Bunny's Su...

15/09/2026

OWC Announces Acquisition of OpenDrives, Expanding Software-Defined Video and Rich Media Storage Management Capabilities

OWC Announces Acquisition of OpenDrives, Expanding Software-Defined Video and Ri...

15/09/2026

Podcast The Vertical Buzz Shot with Blackmagic Pocket Cinema Camera 6K Pro

Podcast The Vertical Buzz Shot with Blackmagic Pocket Cinema Camera 6K Pro Brie Clayton September 14, 2026 0 Comments Production team builds premium p...

15/09/2026

Grass Valley Launches AVORA at IBC2026

Grass Valley Launches AVORA at IBC2026 Brie Clayton September 14, 2026 0 Comments New standalone solution gives production teams everything they need ...

15/09/2026

Brandon Woody Joins Berklee Student Ensemble for Signature Series Concert

Brandon Woody Joins Berklee Student Ensemble for Signature Series Concert The acclaimed trumpeter, composer, and bandleader will lead a Berklee student ensemb...

15/09/2026

IBC2026 Announces IBC Innovation Award Winners

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

IEEE BTS to Host Broadcast Technology Forum at NAB Headquarters

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Huw Mills Joins Technetix as SVP, Global Operations

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

TiVo Introduces Agent TiVo

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Study: Younger Fans Are Watching More Sports Than Ever

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

NFL Melbourne Game Scores 18.5 Million U.S. Viewers on Netflix

Share Copy link Facebook X Linkedin Bluesky Email...

15/09/2026

Applications open for Future Leaders Delegation to BitSummit 2027

Applications open for Future Leaders Delegation to BitSummit 2027 15 September 2026 Applications are open for Screen Australia's annual Future Leaders Dele...

14/09/2026

ESPNs MNF Gets in Tune With Apple Music, Adds Ludacris to In the Air Tonight Open

Lil Baby's Dead Fresh kicks off ESPN's Week 1 Monday Night Football, ...

14/09/2026

ESPN's Monday Night Football Begins Its Super Bowl Run With Year 2 of Flagship, New Tech, and 4K HDR Distribution

With Super Bowl LXI waiting in Los Angeles, ESPN will use the regular season to ...

14/09/2026

Give Me the Backstory: Get to Know Padraic McKinley, the Director of The Weight

By Bailey Pennick One of the most exciting things about the Sundance Film Festival is having a front-row seat for the bright future of independent filmmaking. ...

14/09/2026

Sony expand WH headphone line-up

Three new models introduced Sony have just announced the launch of three new pairs of headphones that span their premium, mid-range and entry-level line-ups...

14/09/2026

Audient unveil Horizon interfaces

New flagship Thunderbolt units aimed at pro studios Audient's latest announcement sees the company introduce three new high-end audio interfaces designe...

14/09/2026

Cobalt Digital to Bring New and Enhanced Practical Solutions to Evolving Broadcast Workflows at IBC2026

Cobalt Digital IBC Stand 8.F90 // Journalists: Click to visit Cobalt Highlights...

14/09/2026

TV Tech Unveils Best of Show Winners at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

14/09/2026

TV Skyline Becomes 'World's First Ultrix FR30 Customer

Share Copy link Facebook X Linkedin Bluesky Email...

14/09/2026

Bitmovin AI Scene Analysis Selected by Nine to Enhance it...

Bitmovin, a leading provider of video streaming solutions, has announced that Australia's largest media company, Nine Entertainment (Nine), has deployed Bit...

14/09/2026

Creativepool Annual 2026 Winners Announced

Creativepool Annual 2026 Winners Announced Brie Clayton September 13, 2026 0 Comments The creative industry's Most' awards celebrates another...

14/09/2026

Award-winning network Sky Mobile to Offer iPhone Duo, iPhone 18 Pro, iPhone 18 Pro Max, Apple Watch Series 12, and AirPods 5

Monday 14 September 2026 Award-winning network Sky Mobile to Offer iPhone Duo, ...

14/09/2026

Major updates for Apple\u2019s software platforms are now\u00A0available - UPDATE - Posted on 14 September 2026

Apple's latest software updates introduce Siri AI, a more intelligent, knowl...

14/09/2026

WTA Awards Tier 4 to Agility Beyond Space Subic Bay and Cikarang sites

WTA Awards Tier 4 to Agility Beyond Space Subic Bay and Cikarang sites...

14/09/2026

Perplexity Portable Computer Is Now Available on Windows, Powered by NVIDIA RTX

As local models become more capable, AI agents can handle more work directly on a PC while keeping sensitive information on the device. Portable Computer is a ...

14/09/2026

First look image of The Walsh Sisters series two released

RT in association with the BBC today released first look image from the second series of The Walsh Sisters, inspired by the novels of international best-sellin...

13/09/2026

Elektron reveal the Outbox 8

Offers eight audio and CV outputs via USB Elektron's latest launch offers a convenient way for users to integrate hardware instruments, effects and mixe...

13/09/2026

Pixel Academy Announces Autumn Courses

Pixel Academy Announces Autumn Courses Brie Clayton September 13, 2026 0 Comments The ACT Entertainment tvONE and Green Hippo Pixel Academy has releas...

13/09/2026

2Vision Powers Dawid Podsiado's Obrotowy Tour with Blackmagic Design

2Vision Powers Dawid Podsiad o's Obrotowy Tour with Blackmagic Design Brie Clayton September 13, 2026 0 Comments Touring multicamera workflow buil...

13/09/2026

Chyron, Matrox Video Partner At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

13/09/2026

SES's Final Three O3b mPOWER Satellites Successfully Launched

Luxembourg, September 13, 2026 - SES today announced the successful launch of its eleventh, twelfth and thirteenth O3b mPOWER satellites, further expanding its ...

13/09/2026

Sky releases trailer for Crystal Lake, an A24 produced prequel series to Friday the 13th, coming this October

Sunday 13 September 2026 Sky releases trailer for Crystal Lake, an A24 produced...

12/09/2026

If I Go Will They Miss Me Explores Fractured Fatherhood Through a Poetic Lens

J. Alphonse Nicholson, Danielle Brooks, Walter Thompson-Hernandez, and Bodhi Dell attend the premiere of If I Go Will They Miss Me at the Library Center Theat...

12/09/2026

Transformer Boost from Great Eastern FX Co.

Latest Obsolete Devices pedal announced Great Eastern FX Co. have just launched the latest pedal in their Obsolete Devices series, a range of effects pedals...

12/09/2026

Colorfront And Qumulo Team-Up To Make Every Frame Of Footage Searchable For The Life Of A Production

September 11, 2026 BUDAPEST & SEATTLE, 10 September 2026 - Qumulo and Colorfron...

12/09/2026

New Type RT console and Apex M6 Modular I/O Platform

Calrec expands its IP ecosystem with new Type RT console and Apex M6 Modular I/O Platform at IBC 2026 Type RT is the centrepiece of Calrec's news at IBC 202...

12/09/2026

Calrec expands its IP ecosystem with new Type RT console...

At IBC 2026, Calrec has unveiled Type RT, a new 6, 12 and 18-motorised fader console range that condenses everything a broadcast audio desk needs into a compact...

12/09/2026

Matrox, NVIDIA Integrate ORIGIN, Holoscan For Media

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

Ross Video Debuts New Live Production Technology at IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

FCC Nominee Thumann Severs to Testify in Senate Sept. 17

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

TV Skyline Becomes The World's First Ultrix FR30 Customer

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

Ikegami Introduces VN Versions of Four UNICAM XE Cameras At IBC2026

Share Copy link Facebook X Linkedin Bluesky Email...

12/09/2026

Riedel Technology Powers Record Breaking Esports World Cu...

WUPPERTAL, Germany Sept. 11, 2026 From July 6 to Aug. 23, 2026, Paris hosted the Esports World Cup (EWC), a seven-week live production spanning eight stages...