Sony Pixel Power calrec Sony

Mixing Clever: Salsa Sound Embraces the Power of AI in MIXaiR 2.0

22/09/2021

Mixing clever: Salsa Sound embraces the power of AI in MIXaiR 2.0 By Michael Burns

Monday, September 20, 2021 - 10:41

Print This Story

Salsa Sound co-founder and CEO, Rob Oldfield

Regular readers of SVG Europe will be well aware of how innovative technology companies working in sports broadcasting can be, but MIXaiR from Salsa Sound looks likely to set a new bar for live audio and the craft of sound mixing.

When the pandemic caused football games to be played in silent stadiums Salsa Sound came to the rescue of broadcasters with its vCrowd real time virtual crowd atmosphere system, which rightly won plaudits. However, MIXaiR is based on technology that the company has been working on for several years, through academia, R&D, beta versions and a soft launch of the system a year ago.

Our company was founded in 2017, but prior to that we were part of the University of Salford, where we were working on a lot of innovative audio techniques, says co-founder and CEO, Rob Oldfield. In particular we were looking at how to leverage artificial intelligence (AI) to recognise sound events and then create the best possible mix, not based on tracking but just based on what is actually [captured by] those microphones.

Fast forward to the future, next month in fact, and the new version of MIXaiR, an AI-driven system that automatically creates and enhances audio mixes for live broadcast, is set to be released.

MIXaiR 2.0 is jam packed with new features and a much more intuitive, easy to use interface, says Oldfield. The idea for v2.0 is you put all your microphones feeds in and then MIXaiR creates different submixes. So you might have a crowd, a commentary, or a pitch mix or aux in, and MIXaiR will automatically balance the levels between them, apply some processing, then create the best possible mix out of it without any human interaction, other than setting it up in the first place.

Hard tackle

According to Oldfield, the hardest mix, by a country mile, is the pitch mix. Historically, it's such a dynamic process by engineers and difficult to replicate, he explains. To make sure you've always got the nearest microphone active in the mix at any one point, requires constant attention and raising and lowering of faders. It's a really clever balancing act.

Rather like the players whose kicks it tracks, MIXaiR's AI has gone through an extensive training regime. Using machine learning technology, Salsa Sound has been training MIXaiR with many hours of content, microphone recordings and mixes across leagues.

People don't realise how hard it is to mix really well. That's why we've gone through pains to get an AI solution that takes the strain from some of the really difficult grunt work of mixing

We know what makes a great mix, says Oldfield. The AI is constantly analysing all of the sounds it is hearing. We tell it what to make of these sound events and it learns what's a kick, what's a whistle, what's a ball bounce, so that when it sees or hears sound in the wild, it can make an intelligent decision based on it.

Oldfield says MIXaiR delivers an even pitch mix, without any slightly awkward transitions and unbalanced crowd noise.

Our approach is to have the AI listen to those live microphone feeds, and when it hears a sound that's interesting like a kick, whistle, ball bounce or hitting the crossbar, you name it it will automatically add that microphone feed into the mix. It tracks the game around, always choosing the microphone that's closest to the action, and [performs] a seamless transition between them.

People don't realise how hard it is to mix really well, he adds. That's why we've gone through pains to get an AI solution that takes the strain from some of the really difficult grunt work of mixing. It can enable these guys to explore creative avenues and to create more innovative content. When you're not completely locked into your screen trying to create the best mix, you can actually lean in to MIXaiR a little bit more, let that create the stems and then you can have a bit of cognitive space to craft a mix, rather than chasing a mix.

Salsa Sound's MIXaiR GUI

The commentary and crowd noise are dynamically processed to provide mix components. These sub mixes are basically ingredients that you can throw into the output mixes, explains Oldfield. Then it's just a drag and drop process. You can create whatever output mixes you want, as many as you want, in different formats. You can have international sound, a French mix, a German mix, a Spanish mix, or whatever, and within that you can have different flavours: the stereo mix, the 5.1 mix, the mono mix. The only limitation is the number of channels that you've got available on your output board. You can also apply VST plug-ins to add your own compression or EQ or effects to the submixes, so it becomes a creative tool, allowing you to craft your mixes.

Importantly, [all mixes] are loudness normalised, he adds. If you're streaming on YouTube, or your own video on demand platform, or when it is for broadcast, they all have different loudness requirements. So within MIXaiR, you just decide which requirement you want, click on it and it will ensure that the mix adheres to those standards, so you don't end up with a fine from the regulator for making too much noise, or making not enough noise.

MIXaiR users also have an option to enhance the pitch mix with pre-recorded sounds. When somebody whacks the ball in the middle of the park, the [sound supervisor] can't even hear it because it's a long way away from the microphones, says Oldfield. However the AI can pick up a kick in the middle of the pitch. The algorithm can detect a kick, go to a bank of pre-recorded kicks and pick out the most appropriate one, and then
LINK: https://www.svgeurope.org/blog/headlines/mixing-clever-salsa-sound-emb...
See more stories from svg

More from Sports Video Group

11/07/2025

Behind the Mic: Amazon Prime Preps for First Season of NBA Action; MSG Networks Adjusts Broadcast Booths for Rangers, Devils

Behind the Mic: Amazon Prime Preps for First Season of NBA Action; MSG Networks ...

11/07/2025

SVG New Sponsor Spotlight: Suite Studios' Craig Hering on Adapting to Clients' Needs With Scalable Cloud-Based Storage

SVG New Sponsor Spotlight: Suite Studios' Craig Hering on Adapting to Client...

11/07/2025

2025 SVG Content Management Forum Breaks Down AI's Impact, Continued Transition to the Cloud

2025 SVG Content Management Forum Breaks Down AI's Impact, Continued Transit...

11/07/2025

A Journey HOME: University of Nebraska's HuskerVision Goes IP

A Journey HOME: University of Nebraska's HuskerVision Goes IP Leaders from the HuskerVision and Lawo share their IP learnings By SVG Staff Friday, July 1...

11/07/2025

CMSI, Remote Picture Labs, Ace ESPN's Cloud-Based Editing Efforts for Wimbledon

CMSI, Remote Picture Labs, Ace ESPN's Cloud-Based Editing Efforts for Wimble...

11/07/2025

Netflix Enters the Live-Boxing-Production Ring for Round 2 With Historic Taylor-Serrano 3 Card at MSG

Netflix Enters the Live-Boxing-Production Ring for Round 2 With Historic Taylor-...

10/07/2025

5G for All? What the DFL's Use of Easy5G, RefCam Could Mean for Events in the Future

5G for all? What the DFL's use of Easy5G and RefCam could mean for events in...

10/07/2025

Save the Date: PGA TOUR Studios Welcomes SVG Remote Production Summit on Oct 14-15

Save the Date: PGA TOUR Studios Welcomes SVG Remote Production Summit on Oct 14-...

10/07/2025

Cloud on the Road: How Remote-Production-Service Providers Are Adapting to a New Era

Cloud on the Road: How Remote-Production-Service Providers Are Adapting to a New...

10/07/2025

Seattle Kraken's Ryan Schaber on the NHL Team Taking Live Game Productions In-House

Seattle Kraken's Ryan Schaber on the NHL Team Taking Live Game Productions I...

10/07/2025

FOX Sports Reboots Small Control Room in Los Angeles as Hub for Vertical-First Production

FOX Sports Reboots Small Control Room in Los Angeles as Hub for Vertical-First P...

10/07/2025

SVG Sit-Down: MSE's Zach Leonsis, ViewLift's Rick Allen Go Deep on Joint Venture Targeting Local-Sports-Media Market

SVG Sit-Down: MSE's Zach Leonsis, ViewLift's Rick Allen Go Deep on Joint...

09/07/2025

Monumental Sports & Entertainment, ViewLift Unveil Broadcast/Streaming Joint Venture as Regional Sports Market Transforms

Monumental Sports & Entertainment, ViewLift Unveil Broadcast/Streaming Joint Ven...

09/07/2025

SVG Europe Audio - State of Wireless Mics Forum: If We Lose the Spectrum, It's Going Back to the Boring Stuff

SVG Europe Audio State of Wireless Mics Forum: If we lose the spectrum, it...

09/07/2025

Tech Focus: Athlete Audio - Venues Provide Sound Just for the Players

Tech Focus: Athlete Audio - Venues Provide Sound Just for the Players From locker room to field of play, personalized systems help rev up the athletes By Dan D...

08/07/2025

Groundbreaking Gamecocks: Inside University of South Carolina's Four-Control Room Production Palace

Groundbreaking Gamecocks: Inside University of South Carolina's Four-Control...

08/07/2025

Monumental Sports & Entertainment's Samantha Brady on the Power of the RSN's Direct-to-Consumer Streaming Service Monumental+

Monumental Sports & Entertainment's Samantha Brady on the Power of the RSN&#...

08/07/2025

Live From 2025 FIFA Club World Cup: FIFA, HBS Focus on Tournament Wrap, With an Eye to 2026 Men's World Cup

Live From 2025 FIFA Club World Cup: FIFA, HBS Focus on Tournament Wrap, With an ...

08/07/2025

SVG Rewind: NESN Goes Behind the Scenes of 1975 Red Sox Retro Broadcast

SVG Rewind: NESN Goes Behind the Scenes of 1975 Red Sox Retro Broadcast NESN is following up the retrocast with a week-long celebration of the Green Monster By...

07/07/2025

1-2 Punch: The Cloud, Generative AI, and the Future of Sports-Content Distribution

1-2 Punch: The Cloud, Generative AI, and the Future of Sports-Content Distributi...

07/07/2025

Formula E: Host Broadcaster Aurora on Launching New AR Graphics at the Jakarta E-Prix

Tests and decisions: Formula E host broadcaster Aurora on launching new AR graph...

07/07/2025

Formula E: Using New AR Graphics for Storytelling at the Formula E Penultimate, Final E-Prix of the Season

Building tension: Using new AR graphics for storytelling at the Formula E penult...

07/07/2025

SVG Rewind: Four NFL Clubs Bring Us on Set of Respective Media Day Shoots

SVG Rewind: Four NFL Clubs Bring Us on Set of Respective Media Day Shoots An in-depth conversation with 49ers Laura Johnson, Ravens Jay O'Brien, Las Vegas R...

07/07/2025

Cosm To Build Fifth Shared Reality Venue in Cleveland as Part of Bedrock's Rock Block' Development

Cosm To Build Fifth Shared Reality Venue in Cleveland as Part of Bedrock's ...

02/07/2025

World RX of Sweden: Aurora's Matt Beal on Taking Up the Broadcast Reins Alongside the FIA

Progressive realism: Aurora on taking up the broadcast reins for World RX alongs...

02/07/2025

World RX of Sweden: Getting the Production Together With NEP Finland, Cloudbass Graphics

Great speed: New host broadcaster Aurora on getting the World RX 2025 season pro...

02/07/2025

World RX of Sweden: Host Broadcaster Aurora Looks Ahead to This Weekend's Second Race of the Season in Hljes

Seat of its pants: Aurora boxes clever and looks ahead for the FIA as new host b...

02/07/2025

UEFA Women's Euro 2025: EBU, BBC Sport, Sunset+Vine Talk Coverage Plans, Distribution and Maintaining Momentum

UEFA Women's Euro 2025: EBU, BBC Sport and Sunset Vine talk coverage plans, ...

02/07/2025

UEFA Women's Euro 2025: Women's Super League Launches New Content Series to Support Teams, Players Over Summer of Football

UEFA Women's Euro 2025: Women's Super League launches new content series...

02/07/2025

UEFA Women's Euro 2025: Ignite Puts Fans, Players Front and Center With Title Sequence for ITV

UEFA Women's Euro 2025: Ignite puts fans and players front and centre with t...

02/07/2025

Storytelling in the Live Game Broadcast: ESPN Director Jimmy Platt Breaks Down the Craft

Storytelling in the Live Game Broadcast: ESPN Director Jimmy Platt Breaks Down t...

02/07/2025

CONCACAF's Miguel Angel Garcia on the Gold Cup's Enhanced 2025 Production Plan

CONCACAF's Miguel Angel Garcia on the Gold Cup's Enhanced 2025 Productio...

01/07/2025

SVG New Sponsor Spotlight: Spyrosoft's Jonathan Witty on Futher Business Expansion in the U.S.

SVG New Sponsor Spotlight: Spyrosoft's Jonathan Witty on Futher Business Exp...

01/07/2025

The NIL Effect: How the Shifting Business of College Athletics Impacts On-Campus Video Production

The NIL Effect: How the Shifting Business of College Athletics Impacts On-Campus...

01/07/2025

Cherry On the Cake: Inside the Technical Production of the Tour de France 2025 with EMG / Gravity Media

Cherry on the cake: Inside the technical production of the Tour de France 2025 w...

01/07/2025

NESN's Josh Jun on Keeping Alternative Broadcasts Fresh for Boston Red Sox, Boston Bruins Fans

NESN's Josh Jun on Keeping Alternative Broadcasts Fresh for Boston Red Sox, ...

01/07/2025

TNT Sports Races Back Into NASCAR With Fresh Look, Familiar Edge

TNT Sports Races Back Into NASCAR With Fresh Look, Familiar Edge Production approach emphasizes creative freedom, bold storytelling, casual-fan-friendly tone B...

27/06/2025

How Smarter Video Compression is Creating a Sustainable Future

How smarter compression is creating a sustainable future By Michael Burns Monday, June 23, 2025 - 14:13 Print This Story Live sport is especially vulnerab...

27/06/2025

RTL Group To Acquire Sky Deutschland

RTL Group To Acquire Sky Deutschland By George Bevir, Editorial Director, SVG Europe Friday, June 27, 2025 - 8:00 am Print This Story | Subscribe Story ...

27/06/2025

Frictionless, At Scale: The Current State of Live Video Streaming Techology

Frictionless, At Scale: The Current State of Live Video Streaming Techology Leaders from Bitmovin, Comcast Technology Solutions, Harmonic, IMAX, and Phenix brea...

27/06/2025

Marquee Sports Network's Nick Steger on Meeting the Moment of the Contending Chicago Cubs

Marquee Sports Network's Nick Steger on Meeting the Moment of the Contending...

27/06/2025

NHL Draft 2025: The League Is Primed for First Decentralized Draft in Non-Pandemic Era

NHL Draft 2025: The League Is Primed for First Decentralized Draft in Non-Pandem...

26/06/2025

10th-Annual SVG Regional Sports Production Summit Presents Useful Roadmap for the Future of the RSN, Local Media Business

10th-Annual SVG Regional Sports Production Summit Presents Useful Roadmap for th...

26/06/2025

The Big Cloud Debate: Public vs. Private vs. Hybrid

The Big Cloud Debate: Public vs. Private vs. Hybrid Tech leaders from CineSys, Diversified, and Net Insight breaks down all flavors of cloud By Jason Dachman, ...

26/06/2025

Program Productions' Jess Kowatch on Training the Next and Current Generation of Sports TV Technicians

Program Productions' Jess Kowatch on Training the Next and Current Gener...

25/06/2025

SVG College Summit 2025: Select Sessions Now Available to Watch on SVG PLAY

SVG College Summit 2025: Select Sessions Now Available to Watch on SVG PLAY Tackling the latest in college sports video: NIL, live production, virtual productio...

25/06/2025

ESPN Is Set To Bring AR Graphics to Wimbledon, Revamps Bunker and Studio 18 VO Booths

ESPN Is Set To Bring AR Graphics to Wimbledon, Revamps Bunker and Studio 18 VO B...

24/06/2025

2025 NBA Draft: ABC/ESPN Prepares for Two-Day Draft at Barclays Center

2025 NBA Draft: ABC/ESPN Prepares for Two-Day Draft at Barclays Center Partners Game Creek Video, CP Communications, NEP Specialty Capture will be on hand By M...