Sony Pixel Power calrec Sony

Mixing Clever: Salsa Sound Embraces the Power of AI in MIXaiR 2.0

22/09/2021

Mixing clever: Salsa Sound embraces the power of AI in MIXaiR 2.0 By Michael Burns

Monday, September 20, 2021 - 10:41

Print This Story

Salsa Sound co-founder and CEO, Rob Oldfield

Regular readers of SVG Europe will be well aware of how innovative technology companies working in sports broadcasting can be, but MIXaiR from Salsa Sound looks likely to set a new bar for live audio and the craft of sound mixing.

When the pandemic caused football games to be played in silent stadiums Salsa Sound came to the rescue of broadcasters with its vCrowd real time virtual crowd atmosphere system, which rightly won plaudits. However, MIXaiR is based on technology that the company has been working on for several years, through academia, R&D, beta versions and a soft launch of the system a year ago.

Our company was founded in 2017, but prior to that we were part of the University of Salford, where we were working on a lot of innovative audio techniques, says co-founder and CEO, Rob Oldfield. In particular we were looking at how to leverage artificial intelligence (AI) to recognise sound events and then create the best possible mix, not based on tracking but just based on what is actually [captured by] those microphones.

Fast forward to the future, next month in fact, and the new version of MIXaiR, an AI-driven system that automatically creates and enhances audio mixes for live broadcast, is set to be released.

MIXaiR 2.0 is jam packed with new features and a much more intuitive, easy to use interface, says Oldfield. The idea for v2.0 is you put all your microphones feeds in and then MIXaiR creates different submixes. So you might have a crowd, a commentary, or a pitch mix or aux in, and MIXaiR will automatically balance the levels between them, apply some processing, then create the best possible mix out of it without any human interaction, other than setting it up in the first place.

Hard tackle

According to Oldfield, the hardest mix, by a country mile, is the pitch mix. Historically, it's such a dynamic process by engineers and difficult to replicate, he explains. To make sure you've always got the nearest microphone active in the mix at any one point, requires constant attention and raising and lowering of faders. It's a really clever balancing act.

Rather like the players whose kicks it tracks, MIXaiR's AI has gone through an extensive training regime. Using machine learning technology, Salsa Sound has been training MIXaiR with many hours of content, microphone recordings and mixes across leagues.

People don't realise how hard it is to mix really well. That's why we've gone through pains to get an AI solution that takes the strain from some of the really difficult grunt work of mixing

We know what makes a great mix, says Oldfield. The AI is constantly analysing all of the sounds it is hearing. We tell it what to make of these sound events and it learns what's a kick, what's a whistle, what's a ball bounce, so that when it sees or hears sound in the wild, it can make an intelligent decision based on it.

Oldfield says MIXaiR delivers an even pitch mix, without any slightly awkward transitions and unbalanced crowd noise.

Our approach is to have the AI listen to those live microphone feeds, and when it hears a sound that's interesting like a kick, whistle, ball bounce or hitting the crossbar, you name it it will automatically add that microphone feed into the mix. It tracks the game around, always choosing the microphone that's closest to the action, and [performs] a seamless transition between them.

People don't realise how hard it is to mix really well, he adds. That's why we've gone through pains to get an AI solution that takes the strain from some of the really difficult grunt work of mixing. It can enable these guys to explore creative avenues and to create more innovative content. When you're not completely locked into your screen trying to create the best mix, you can actually lean in to MIXaiR a little bit more, let that create the stems and then you can have a bit of cognitive space to craft a mix, rather than chasing a mix.

Salsa Sound's MIXaiR GUI

The commentary and crowd noise are dynamically processed to provide mix components. These sub mixes are basically ingredients that you can throw into the output mixes, explains Oldfield. Then it's just a drag and drop process. You can create whatever output mixes you want, as many as you want, in different formats. You can have international sound, a French mix, a German mix, a Spanish mix, or whatever, and within that you can have different flavours: the stereo mix, the 5.1 mix, the mono mix. The only limitation is the number of channels that you've got available on your output board. You can also apply VST plug-ins to add your own compression or EQ or effects to the submixes, so it becomes a creative tool, allowing you to craft your mixes.

Importantly, [all mixes] are loudness normalised, he adds. If you're streaming on YouTube, or your own video on demand platform, or when it is for broadcast, they all have different loudness requirements. So within MIXaiR, you just decide which requirement you want, click on it and it will ensure that the mix adheres to those standards, so you don't end up with a fine from the regulator for making too much noise, or making not enough noise.

MIXaiR users also have an option to enhance the pitch mix with pre-recorded sounds. When somebody whacks the ball in the middle of the park, the [sound supervisor] can't even hear it because it's a long way away from the microphones, says Oldfield. However the AI can pick up a kick in the middle of the pitch. The algorithm can detect a kick, go to a bank of pre-recorded kicks and pick out the most appropriate one, and then
LINK: https://www.svgeurope.org/blog/headlines/mixing-clever-salsa-sound-emb...
See more stories from svg

Most recent headlines

01/06/2029

IMT AIRBORNE VIDEO DOWNLINK SYSTEM (AVDS) TAKES OFF AT ALEA EXPO 06

Jun29 IMT AIRBORNE VIDEO DOWNLINK SYSTEM (AVDS) TAKES OFF AT ALEA EXPO 2016 SAVANNAH, GA, JUNE 29, 2016 - Integrated Microwave Technologies (IMT), a leader in...

01/04/2025

Images from NAB 2017

Apr25 Images from NAB 2017 Mike Payne of Vislink delivers a presentation on newsnet, a secure, high-bandwidth IP network that completely transforms traditiona...

01/04/2024

VISLINK UNVEILS ALL-NEW HCAM, HEVC 4K UHD CAMERA TRANSMITTER AT NAB 2017

Apr24 VISLINK UNVEILS ALL-NEW HCAM, HEVC 4K UHD CAMERA TRANSMITTER AT NAB 2017 18 Unit Purchase by UK Based-Broadcast RF to be Finalized at Show LAS VEGAS, ...

03/12/2021

Spotify Joins the Valuable 500 With a Commitment to Disability Inclusion

Product accessibility has always been a focus for Spotify. Earlier this year, we introduced improvements to Spotify's mobile experience that included button...

03/12/2021

Space Development Agency Approves L3Harris' Missile-Tracking Satellite Design

MELBOURNE, Fla. - L3Harris Technologies (NYSE:LHX) successfully completed the fi...

03/12/2021

Fox Weather's Weekend Programming To Simulcast On Fox Business Network

NEW YORK Fox News Media's new AVOD streaming service Fox Weather will start simulcasting its live weekend programming on the Fox Business Network (FBN) on D...

03/12/2021

Gray Television Closes On The Acquisition Of Merediths TV Stations

ATLANTA As expected, Gray Television, Inc. has closed its acquisition of Meredith Corporation's Local Media Group and its 17 television stations in 12 local...

03/12/2021

Grass Valley Signs $31M, Five-Year Deal With Broadcast Solutions Group

MONTREAL Grass Valley and Broadcast Solutions Group have inked a $31 million deal that will see the systems integrator investing the sum over five years as it a...

03/12/2021

Sky Deutschland Taps Rohde for Storage Upgrade

MUNICH German broadcaster Sky Deutschland has installed storage technology from Rohde & Schwarz, which Rohde says will now give Sky the benefits of a highly rob...

03/12/2021

NewTek Adds to TriCaster Line

SAN ANTONIO, Texas NewTek has launched the new TriCaster 1 Pro, a streamlined live video production system with support for 4K UHD switching, live streaming, re...

03/12/2021

NAB Show Now Accepting Technical Paper and Panel Proposals

WASHINGTON, D.C. The 2022 NAB Show has issued a call for technical papers and panel proposals for the Broadcast Engineering and Information Technology (BEIT) tr...

03/12/2021

Demo Artist and Trainer Loni Fiscus Joins PlayBox Neo's U.S. Operations

PlayBox Neo has hired Loni Fiscus as a trainer for the U.S.-based PlayBox Neo team, providing training and demonstrations of the newest versions of the PlayBox ...

03/12/2021

Latency, Controlling Costs Top the List of Streaming Tech Challenges

SAN FRANCISCO, Calif. A new survey of video developers by Bitmovin highlights a number of ongoing tech challenges facing streaming services, with 41% of those t...

03/12/2021

Grass Valley signs $31 million deal with Broadcast Solutions Group

Broadcast Solutions Groups Nordic team will also establish a new facility in Helsinki based on Grass Valley's cloud-based Agile Media Processing Platform (A...

03/12/2021

France Tlvisions future proofs newsroom with Fairlight

Broadcaster has implemented 31 Fairlight Advanced Consoles in two bay systems, across 24 regional newsroom hubs throughout France By Jenny Priestley Published...

03/12/2021

IPG Mediabrands To Use NewsGuard To Evaluate News Shows for Clients

Media buyer IPG Mediabrands said it will be working with NewsGuard to create an exclusive tool to determine whether individual news channels and shows are relia...

03/12/2021

Xandr Helps Future Today Grow CTV Advertising Revenue 200%

Future Today, a streaming video company with channels including HappyKids, Fawesome and Filmrise, says working with AT&T's Xandr unit is helping it cash in ...

03/12/2021

Cheryle Harrison Named Head of Bounce by Scripps Networks

Scripps Networks said it named Cheryle Harrison head of Bounce, the TV network serving African-Americans....

03/12/2021

NewFronts Scheduled To Be Held In May and In Person

The 2022 NewFronts will be held the week of May 2, with the first four days planned as in-person events, the Interactive Advertising Bureau (IAB) said Thursday....

03/12/2021

American Idol' Back on ABC Feb. 27

Season 20 of American Idol is on ABC starting Sunday, Feb. 27. Ryan Seacrest hosts and Luke Bryan, Katy Perry and Lionel Richie are the judges. It is American I...

03/12/2021

Battlebots' Returns to Discovery Jan. 6

Battlebots returns on Discovery Jan. 6. The robot-fighting competition sees more than 60 teams head to Las Vegas to compete for The Giant Nut trophy. There are ...

03/12/2021

Women of the Movement', About Aftermath of Emmett Till Murder, on ABC Jan. 6

ABC will debut the limited series Women of the Movement, about Mamie Till-Mobley, who in 1955 risked her life to find justice for her son Emmett's murder, o...

03/12/2021

Kenny G Gets His Close-Up in HBO Documentary

Listening to Kenny G, a film about the notorious saxophonist, premieres on HBO December 2. Penny Lane directs and Bill Simmons executive produces....

03/12/2021

Dave Morgan, Pete Sniderman Retiring at Litton Entertainment

Dave Morgan, founder, president and CEO of Litton Entertainment, and Pete Sniderman, Litton's COO, will retire at the end of the year, Hearst Television ann...

03/12/2021

David Schafer Joins MSG Networks as Senior VP of Operations

MSG Networks said it hired David Schafer as senior VP, operations....

03/12/2021

Beverley Callard joins cast of Newark, Newark

Thursday 2 December 2021 Beverley Callard (Coronation Street) is set to star as Pauline in Golds recently announced comedy, Newark, Newark. The series is produc...

03/12/2021

SVG Voices: WWE Propmaster Mark Shilstone

SVG Voices: WWE Propmaster Mark Shilstone By SVG Staff Friday, December 3, 2021 - 6:30 am Print This Story | Subscribe Story Highlights Many fans know ...

03/12/2021

SVG Esports Production Summit: Super League Gaming's Brian Gramo on the Emergence of Cloud-Based Workflows, Virtualis Studios

SVG Esports Production Summit: Super League Gaming's Brian Gramo on the Emer...

03/12/2021

Los Angeles Rams' Sarah Schuler on Tapping Into Local Talent for an Engaging, Entertaining Gameday

Los Angeles Rams' Sarah Schuler on Tapping Into Local Talent for an Engaging...

03/12/2021

Grass Valley Executive Chairman Louis Hernandez on Cloud-Based Future, $31M Deal With Broadcast Solutions Group

Grass Valley Executive Chairman Louis Hernandez on Cloud-Based Future, $31M Deal...

03/12/2021

Sports Broadcasting Hall of Fame 2020-21: Don Cornelli, The Lens Through Which America Watches Sports

Sports Broadcasting Hall of Fame 2020-21: Don Cornelli, The Lens Through Which A...

03/12/2021

Riot, Blizzard, EA, FACEIT, and NBA 2K League Talk Live Esports Production Workflows in the Pandemic Era

Riot, Blizzard, EA, FACEIT, and NBA 2K League Talk Live Esports Production Workf...

03/12/2021

Third Man Records Powers World-Class Performances with HARMAN Professional Solutions in New London Location

December 03, 2021 LONDON - December 03, 2021 - HARMAN Professional Solutions, t...

03/12/2021

Nokia to build new campus in Oulu

Nokia to build new campus in Oulu Press Release Nokia to build new campus in Oulu 3 December 2021 Espoo, Finland - Nokia today announced the decision to ...

03/12/2021

Antoine Fuqua Forms First Look Partnership With Netflix; Announces New Production Company Name Hill District Media

Back to All News Antoine Fuqua Forms First Look Partnership With Netflix; Annou...

03/12/2021

It all started with a pan of soup!

Posted on 03 Dec 2021 For our second week of Give Back Fridays, weve got behind the volunteers at Wesleys Community Kitchen and Larder on the Fylde. After don...

03/12/2021

Fox Corporation Chief Financial Officer Steven Tomsic to Participate at Upcoming UBS Global TMT Virtual Conference

Fox Corporation Chief Financial Officer Steven Tomsic to Participate at Upcoming...

03/12/2021

Brian Skeels: Respect makes a difference on International Day of Persons with Disabilities

News | December 03 2021 Brian Skeels: Respect makes a difference on Internatio...

03/12/2021

2021-12-03

His Royal Highness Prince William will be the next Time to Walk guest on Apple Fitness+, closing the second season of the series with a special holiday episode ...

03/12/2021

Amp Sims: Garbage In, Garbage Out

An astute Friday Tip reader commented that while the tip on how to level the outputs of amp sim presets was indeed useful, I should also write about the importa...

03/12/2021

EBU News Committee urges Qatar to respect freedom of expression and journalists right to work

EBU News Committee urges Qatar to respect freedom of expression and journalists ...

03/12/2021

DiepCity' Review: Troubled Nox can't raise bail money for Bonga

DiepCity' Review: Troubled Nox can't raise bail money for BongaDiepCity's Nox, played by actress, Nozuko Ncayiyane, is unemployed at the moment and ...

03/12/2021

7de Laan: What is happening Friday 03 December 2021 - E242 S22

7de Laan: What is happening Friday 03 December 2021 - E242 S22Don't miss out on what's happening on tonight's episode! by SA TV and Soapies 03-12...

03/12/2021

Skeem Saam: Tonight's episode, E370 S9 - Friday 03 December 2021

Skeem Saam: Tonight's episode, E370 S9 - Friday 03 December 2021Find out what's going on tonight on Skeem Saam! by SA TV and Soapies 03-12-2021 in ...

03/12/2021

TONIGHT'S EPISODE: Scandal - Friday 03 December 2021 (E3968 S13)

TONIGHT'S EPISODE: Scandal - Friday 03 December 2021 (E3968 S13)Get to know what's happening on tonight's episode! by SA TV and Soapies 03-12-202...

03/12/2021

Gomora: What's happening tonight Friday, 03 December 2021 - E160 S2

Gomora: What's happening tonight Friday, 03 December 2021 - E160 S2Don't miss out on what's happening on tonight's episode of Gomora! by SA TV...

03/12/2021

Friday's Episode: Generations - The Legacy, E270 S30 (03 December 2021)

Friday's Episode: Generations - The Legacy, E270 S30 (03 December 2021)Keen to know what's happening on the latest episode of Generations: The Legacy? ...

03/12/2021

The River: what is happening E215 S4 - Friday 03 December 2021

The River: what is happening E215 S4 - Friday 03 December 2021On tonight's episode of The River . by SA TV and Soapies 03-12-2021 in SA TV and Film Th...

03/12/2021

TONIGHT'S EPISODE: Diep City E175 S1 - Friday 03 December 2021

TONIGHT'S EPISODE: Diep City E175 S1 - Friday 03 December 2021We've got you covered on what's happening tonight. by SA TV and Soapies 03-12-2021 ...