Sony Pixel Power calrec Sony

Salsa Sound Eyes U.S. Market for Automated Audio Mixing

06/10/2021

Salsa Sound Eyes U.S. Market for Automated Audio Mixing College football is an early target sector By Dan Daley, Audio Editor

Wednesday, October 6, 2021 - 6:55 am

Print This Story | Subscribe

Story Highlights

Salsa Sound gained attention when its vCrowd artificial-crowd-sound solution became the go-to for Manchester City FC games and other sports after the COVID pandemic drove actual crowds from the soccer stands. Before that, though, the company had already started down the path of AI-based audio mixing.

In 2019, the UK company launched an innovative automated system that creates live audio mixes for soccer matches. Based on Salsa Sound's patented AI technology, the system takes audio from conventional broadcast microphones at a venue and algorithmically creates a real-time mix. It automatically mutes profanity from pitch-side mics and can be used onsite or through remote production, over IP or in the cloud.

MIXaiR, as the AI engine is dubbed, has been trained on hours and hours of content from Premier League and Championship Games, with the mixes broadcast over Man City's digital channel, says Salsa Sound Co-Founder/Director Rob Oldfield.

Salsa Sound's Rob Oldfield: We have all the infrastructure we want to move into American football; all we need is some content.

[AI is] kind of the bedrock of our company, he explains, and all came out of a university research project into interactive broadcasting. To do this, you need to have an object-based paradigm for the audio, so we developed AI algorithms that would listen to the microphones and, when something interesting was detected, would automatically chop that up as an audio object and triangulate its location so you could have this object-based audio representation. In doing this, we realized it was an opportunity not just for future broadcast but also to automate current mixing processes.

It's a way of consistently keeping the most interesting field effects of a game front and center, he says. That has been done manually for decades by opening and closing individual microphone channels as the ball moves between them, he adds, but it's suited to an automated approach, given the size of a soccer pitch and the constant noise of crowds and especially as broadcast sports moves closer to immersive mixes. The trick is a proprietary process - a really clever way, he says - of doing a crossfade over different frequency bands and using power (that is, gain) matching, so that fades from one microphone to the other are seamless transitions.

Next Steps The next step for MIXaiR in the UK is a project dubbed 5G Edge-XR, a 5G-network-based pilot backed by such entities as British Telecom; the government's Ministry for Digital, Media, Culture, and Sport; and the University of Bristol. The project is intended to enable people to immersively view sports events from all angles across a broad range of devices: smartphones, tablets, AR and VR headsets, as well as televisions. MIXaiR is to be applied first to boxing matches within the Edge-XR envelope, something Oldfield says is scheduled to take place by January.

Beyond that, Salsa is also looking at the U.S. broadcast-sports market, initially at collegiate football - particularly from the perspective of audio submixes: specifically, automating the parabolic microphones along the sidelines.

Producing that parabolic submix is a labor-intensive, difficult task, he notes. We can automate that. AI provides a much more robust and much more intelligent way of doing automated mixing - automatically recognizing what the significant audio moments are in the game - because, with parabolic microphones, it needs to have some intelligence behind it.

What's standing between MIXaiR and its U.S. application is content: authentic audio from actual games that can be used to train the AI algorithms. Specifically, he says, individual audio stems rather than fully mixed sound tracks are needed to enable the AI to analyze discrete sonic elements. For that, Salsa Sound has approached NCAA football, which he says is a huge market that could benefit from the cost-effectiveness of automated mixing.

We have all the infrastructure we want to move into American football; all we need is some content, he says. That applies to any sport. We'd just be creating a new AI module for it.

So far, no automated approaches to broadcast audio have made any swatches of its human workforce redundant, but it's a natural concern for pretty much any worker these days, especially in budget-focused broadcast.

Oldfield says they shouldn't worry: We're not making things that are trying to put people out of business; rather, we're trying to create tools that will help people work better. There's always a need for more and more content. Everybody's trying to do more but on the same budget and the same personnel roster that they've always had. This is about enabling people to create more content of a higher quality and without incurring additional costs.

And that might be music to a U.S. broadcaster's ears.
LINK: https://www.sportsvideo.org/2021/10/06/salsa-sound-eyes-u-s-market-for...
See more stories from svg

More from Sports Video Group

02/12/2021

SVG Voices: WWE Director of Television Production Management Jeremy Shand

SVG Voices: WWE Director of Television Production Management Jeremy Shand By SVG Staff Thursday, December 2, 2021 - 6:30 am Print This Story | Subscribe ...

02/12/2021

SVG Esports Production Summit: NBA 2K League's Matt Arden & TJ Canty on Pivoting to Remote Production, Creating a New Fan Experience

SVG Esports Production Summit: NBA 2K League's Matt Arden & TJ Canty on Pivo...

02/12/2021

Sky Deutschland Pushes Ahead With Pioneering 5G Trials for In-Stadium App and e2e Broadcasting

Sky Deutschland pushes ahead with pioneering 5G trials for in-stadium app and e2...

02/12/2021

SVG, Hazeleden Betty Ford Families in Recovery Series Looks at Dealing with Stigma, Shame, and Guilt

SVG, Hazeleden Betty Ford Families in Recovery Series Looks at Dealing with Stig...

02/12/2021

Sports Broadcasting Hall of Fame 2020-21: Fred Gaudelli, Father of the Modern Pro-Football Broadcast

Sports Broadcasting Hall of Fame 2020-21: Fred Gaudelli, Father of the Modern Pr...

02/12/2021

The SVG Podcast: Inside the League of Legends World Championship Final With Riot Games' Nick Troop and Carrie Dunn

The SVG Podcast: Inside the League of Legends World Championship Final With Riot...

02/12/2021

SVG Summit Preview: Dec. 14 Sessions Dive Deep in Market Segments

SVG Summit Preview: Dec. 14 Sessions Dive Deep in Market Segments By SVG Staff Thursday, December 2, 2021 - 2:09 pm Print This Story | Subscribe Story H...

30/11/2021

SVG Voices: Fox Sports Senior Manager of Technical and Field Ops Lindsay Waine

SVG Voices: Fox Sports Senior Manager of Technical and Field Ops Lindsay Waine By SVG Staff Tuesday, November 30, 2021 - 6:30 am Print This Story | Subscr...

30/11/2021

SVG Esports Production Summit: Do Not Peek Entertainment's Jason Baker on the Important Role of the In-Game Observer

SVG Esports Production Summit: Do Not Peek Entertainment's Jason Baker on th...

30/11/2021

Sports Broadcasting Hall of Fame 2020-21: Charles Barkley, the Voice of the NBA Player

Sports Broadcasting Hall of Fame 2020-21: Charles Barkley, the Voice of the NBA ...

30/11/2021

SVG Summit Preview: Hot Tech Showcase Puts Focus on 5G, HDR, AR, Shallow Depth of Field, and Drones

SVG Summit Preview: Hot Tech Showcase Puts Focus on 5G, HDR, AR, Shallow Depth o...

30/11/2021

SVG Sit-Down: Inside Signiant's Acquisition of Levels Beyond With Mike Flathers, Jon Finegold, Art Raymond

SVG Sit-Down: Inside Signiant's Acquisition of Levels Beyond With Mike Flath...

30/11/2021

All Sessions From SVG Esports Production Now Available to Watch On Demand

All Sessions From SVG Esports Production Now Available to Watch On Demand By SVG Staff Tuesday, November 30, 2021 - 11:14 am Print This Story | Subscribe ...

30/11/2021

It's Giving Tuesday! Donate to the Sports Broadcasting Fund Today

It's Giving Tuesday! Donate to the Sports Broadcasting Fund Today By Ken Kerschbaumer, Editorial Director Tuesday, November 30, 2021 - 2:53 pm Print Th...

29/11/2021

SVG Voices: Fox Sports Replay Operator Paul Zecca

SVG Voices: Fox Sports Replay Operator Paul Zecca By SVG Staff Monday, November 29, 2021 - 6:45 am Print This Story | Subscribe Story Highlights Many f...

29/11/2021

Sky Italia and Cinevideo Power First 4K Production for Lega Serie B

Sky Italia and Cinevideo power first 4K production for Lega Serie B By Roberto Landini, Italian Correspondent Thursday, November 25, 2021 - 10:54 Print Thi...

29/11/2021

Sports Broadcasting Hall of Fame 2020-21: James Brown, All-World Host and Human Being

Sports Broadcasting Hall of Fame 2020-21: James Brown, All-World Host and Human ...

23/11/2021

SVG Voices: Fox Sports A2 Assist Anthony Lomastro

SVG Voices: Fox Sports A2 Assist Anthony Lomastro By SVG Staff Tuesday, November 23, 2021 - 6:30 am Print This Story | Subscribe Story Highlights Many ...

23/11/2021

SVG Esports Production Summit: FACEIT's Andrew Lane on Setting the Blueprint for the Return to LAN Events, What's to Come Next Year

SVG Esports Production Summit: FACEIT's Andrew Lane on Setting the Blueprint...

23/11/2021

NVP Delivers First Champions League Match in 4K HDR HLG for Sky Italia

NVP delivers first Champions League match in 4K HDR HLG for Sky Italia By Roberto Landini, Italian Correspondent Monday, November 22, 2021 - 15:51 Print Th...

23/11/2021

Stadium Hops Aboard the REMI Train for 2021-22 College Hoops Season

Stadium Hops Aboard the REMI Train for 2021-22 College Hoops Season OTT service will split production 50-50 between onsite and REMI production By Jason Dachman...

23/11/2021

Rising COVID Concerns Prompts IBC to Cancel In-Person Event in Amsterdam

Rising COVID concerns prompts IBC to cancel in-person event in Amsterdam IBC will now focus on bringing the content and technology community together via IBC Di...

23/11/2021

Turner Sports Looks To Transport The Match' Viewers Onto the Course With Cart Cam, Drones, and More

Turner Sports Looks To Transport The Match' Viewers Onto the Course With Ca...

22/11/2021

World Rally Championship Moves Into Hybrid Electric Era, Refreshed Production for 2022

World Rally Championship moves into hybrid electric era and refreshed production...

22/11/2021

SVG Voices: WWE Production Designer Jason Robinson

SVG Voices: WWE Production Designer Jason Robinson By SVG Staff Monday, November 22, 2021 - 7:00 am Print This Story | Subscribe Story Highlights Many ...

22/11/2021

SVG Esports Production Summit: Populous' Amber Luther on New Esports Builds, Entertaining In-Arena Fans

SVG Esports Production Summit: Populous' Amber Luther on New Esports Builds,...

22/11/2021

Los Angeles Chargers' Sean Tabler Highlights First Year With Fans, New Activations at SoFi Stadium

Los Angeles Chargers' Sean Tabler Highlights First Year With Fans, New Activ...

22/11/2021

SVG On Demand: Inside NFL Media's New Production Mothership in Hollywood Park

SVG On Demand: Inside NFL Media's New Production Mothership in Hollywood Par...

22/11/2021

Silver Spoon Expands Staff, Operations in Los Angeles

Silver Spoon Expands Staff, Operations in Los Angeles By SVG Staff Monday, November 22, 2021 - 12:11 pm Print This Story | Subscribe Story Highlights S...

22/11/2021

New York Islanders Are Finally Home in $1 Billion UBS Arena at Belmont Park Complex

New York Islanders Are Finally Home in $1 Billion UBS Arena at Belmont Park Comp...

19/11/2021

SVG Voices: Fox Sports Lead Technical Producer Tom Lynch

SVG Voices: Fox Sports Lead Technical Producer Tom Lynch By SVG Staff Friday, November 19, 2021 - 7:00 am Print This Story | Subscribe Story Highlights ...

19/11/2021

SVG Esports Production Summit: Ross Video's Phil Englert on Company Involvement, Current Industry Trends

SVG Esports Production Summit: Ross Video's Phil Englert on Company Involvem...

19/11/2021

NBC Sports Group Retains Premier League Rights in the U.S. With New Six-Year Deal

NBC Sports Group Retains Premier League Rights in the U.S. With New Six-Year Dea...

19/11/2021

SoFi Stadium, One Year Later: Los Angeles Chargers, Rams Shine in NFL's West Coast Palace

SoFi Stadium, One Year Later: Los Angeles Chargers, Rams Shine in NFL's West...

19/11/2021

Sports Broadcasting Hall of Fame 2020-21: Hugo Gaggioni, Technical Visionary

Sports Broadcasting Hall of Fame 2020-21: Hugo Gaggioni, Technical Visionary By Ken Kerschbaumer, Editorial Director Friday, November 19, 2021 - 1:08 pm Pr...

19/11/2021

Fox Sports Makes K-Array PA System Look as Good as It Sounds

Fox Sports Makes K-Array PA System Look as Good as It Sounds Custom towers are created for Big Noon Kickoff live broadcasts By Dan Daley, Audio Editor Friday...

19/11/2021

IBC 2021: Blackmagic Design, Canon, Grass Valley, LiveU, and Telestream Among Companies Pulling Out

IBC 2021: Blackmagic Design, Canon, Grass Valley, LiveU, and Telestream Among Co...

18/11/2021

IBC Confirms 2021 Show Will Take Place Next Month; Amends Opening Hours

IBC confirms that 2021 show will take place next month but with amended opening hours By Will Strauss, Editor Tuesday, November 16, 2021 - 12:11 Print Th...

18/11/2021

Sports Broadcasting Hall of Fame 2020-21: Phyllis George, Trailblazing Sportscaster

Sports Broadcasting Hall of Fame 2020-21: Phyllis George, Trailblazing Sportscas...

18/11/2021

SVG Esports Production Summit: EA's Joe Lynch on Returning to the Facility, Future Live Events in 2022

SVG Esports Production Summit: EA's Joe Lynch on Returning to the Facility, ...

18/11/2021

SVG Returns to In-Person Events With Industry-Unifying Esports Production Forum in L.A.

SVG Returns to In-Person Events With Industry-Unifying Esports Production Forum ...

17/11/2021

Golden State Warriors Celebrate Their Past, Future With 75th-Anniversary-Themed Intro Video

Golden State Warriors Celebrate Their Past, Future With 75th-Anniversary-Themed ...

16/11/2021

SVG Voices: THUMBWAR Engineer Trevor Carlson

SVG Voices: THUMBWAR Engineer Trevor Carlson By SVG Staff Tuesday, November 16, 2021 - 3:45 am Print This Story | Subscribe Story Highlights Many fans ...

16/11/2021

Equal Opportunities: Sky Sports on Taking Its Women's Super League Broadcasts to Premier League Levels

Equal opportunities: Sky Sports on taking its Women's Super League broadcast...

16/11/2021

Sports Broadcasting Hall of Fame 2020-21: Tim Finchem, Transformative Leader

Sports Broadcasting Hall of Fame 2020-21: Tim Finchem, Transformative Leader By Ken Kerschbaumer, Editorial Director Tuesday, November 16, 2021 - 7:00 am P...

16/11/2021

SVG On Demand: The Power of Edge Computing at the Video Source for Sports Betting A Videon Case Study

SVG On Demand: The Power of Edge Computing at the Video Source for Sports Bettin...

16/11/2021

Mediapro Canada Production of Canadian Premier League Embraces New Workflows, Tech

Mediapro Canada Production of Canadian Premier League Embraces New Workflows, Te...

15/11/2021

OB Company Arena Television and Sister Firm Arena Aviation Cease Trading

OB company Arena Television and sister firm Arena Aviation cease trading By Will Strauss, Editor Thursday, November 11, 2021 - 16:47 Print This Story Aren...

15/11/2021

SVG On Demand: As New York Legalizes Mobile Sports Betting, MSG Networks Invests Early in Gaming-Focused Studio Programming

SVG On Demand: As New York Legalizes Mobile Sports Betting, MSG Networks Invests...

15/11/2021

PPI's ProCrewz App Connects Crewers, Freelancers To Make Getting a Gig Easier Than Ever

PPI's ProCrewz App Connects Crewers, Freelancers To Make Getting a Gig Easie...