
Mixing clever: Salsa Sound embraces the power of AI in MIXaiR 2.0 By Michael Burns
Monday, September 20, 2021 - 10:41
Print This Story
Salsa Sound co-founder and CEO, Rob Oldfield
Regular readers of SVG Europe will be well aware of how innovative technology companies working in sports broadcasting can be, but MIXaiR from Salsa Sound looks likely to set a new bar for live audio and the craft of sound mixing.
When the pandemic caused football games to be played in silent stadiums Salsa Sound came to the rescue of broadcasters with its vCrowd real time virtual crowd atmosphere system, which rightly won plaudits. However, MIXaiR is based on technology that the company has been working on for several years, through academia, R&D, beta versions and a soft launch of the system a year ago.
Our company was founded in 2017, but prior to that we were part of the University of Salford, where we were working on a lot of innovative audio techniques, says co-founder and CEO, Rob Oldfield. In particular we were looking at how to leverage artificial intelligence (AI) to recognise sound events and then create the best possible mix, not based on tracking but just based on what is actually [captured by] those microphones.
Fast forward to the future, next month in fact, and the new version of MIXaiR, an AI-driven system that automatically creates and enhances audio mixes for live broadcast, is set to be released.
MIXaiR 2.0 is jam packed with new features and a much more intuitive, easy to use interface, says Oldfield. The idea for v2.0 is you put all your microphones feeds in and then MIXaiR creates different submixes. So you might have a crowd, a commentary, or a pitch mix or aux in, and MIXaiR will automatically balance the levels between them, apply some processing, then create the best possible mix out of it without any human interaction, other than setting it up in the first place.
Hard tackle
According to Oldfield, the hardest mix, by a country mile, is the pitch mix. Historically, it's such a dynamic process by engineers and difficult to replicate, he explains. To make sure you've always got the nearest microphone active in the mix at any one point, requires constant attention and raising and lowering of faders. It's a really clever balancing act.
Rather like the players whose kicks it tracks, MIXaiR's AI has gone through an extensive training regime. Using machine learning technology, Salsa Sound has been training MIXaiR with many hours of content, microphone recordings and mixes across leagues.
People don't realise how hard it is to mix really well. That's why we've gone through pains to get an AI solution that takes the strain from some of the really difficult grunt work of mixing
We know what makes a great mix, says Oldfield. The AI is constantly analysing all of the sounds it is hearing. We tell it what to make of these sound events and it learns what's a kick, what's a whistle, what's a ball bounce, so that when it sees or hears sound in the wild, it can make an intelligent decision based on it.
Oldfield says MIXaiR delivers an even pitch mix, without any slightly awkward transitions and unbalanced crowd noise.
Our approach is to have the AI listen to those live microphone feeds, and when it hears a sound that's interesting like a kick, whistle, ball bounce or hitting the crossbar, you name it it will automatically add that microphone feed into the mix. It tracks the game around, always choosing the microphone that's closest to the action, and [performs] a seamless transition between them.
People don't realise how hard it is to mix really well, he adds. That's why we've gone through pains to get an AI solution that takes the strain from some of the really difficult grunt work of mixing. It can enable these guys to explore creative avenues and to create more innovative content. When you're not completely locked into your screen trying to create the best mix, you can actually lean in to MIXaiR a little bit more, let that create the stems and then you can have a bit of cognitive space to craft a mix, rather than chasing a mix.
Salsa Sound's MIXaiR GUI
The commentary and crowd noise are dynamically processed to provide mix components. These sub mixes are basically ingredients that you can throw into the output mixes, explains Oldfield. Then it's just a drag and drop process. You can create whatever output mixes you want, as many as you want, in different formats. You can have international sound, a French mix, a German mix, a Spanish mix, or whatever, and within that you can have different flavours: the stereo mix, the 5.1 mix, the mono mix. The only limitation is the number of channels that you've got available on your output board. You can also apply VST plug-ins to add your own compression or EQ or effects to the submixes, so it becomes a creative tool, allowing you to craft your mixes.
Importantly, [all mixes] are loudness normalised, he adds. If you're streaming on YouTube, or your own video on demand platform, or when it is for broadcast, they all have different loudness requirements. So within MIXaiR, you just decide which requirement you want, click on it and it will ensure that the mix adheres to those standards, so you don't end up with a fine from the regulator for making too much noise, or making not enough noise.
MIXaiR users also have an option to enhance the pitch mix with pre-recorded sounds. When somebody whacks the ball in the middle of the park, the [sound supervisor] can't even hear it because it's a long way away from the microphones, says Oldfield. However the AI can pick up a kick in the middle of the pitch. The algorithm can detect a kick, go to a bank of pre-recorded kicks and pick out the most appropriate one, and then
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
04/08/2026
Dalet, a leading technology and service provider for media-rich organizations, t...
04/07/2026
April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...
01/06/2026
January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026
Throughout the week, Dolby brings to life the latest innovatio...
27/05/2026
Telestream has announced that its Board of Directors has appointed Benjamin Desbois as Chief Executive Officer, effective July 1, 2026. Desbois, currently Teles...
27/05/2026
ESPN garnered 10 awards; NBC's Sunday Night Football received the Outstandin...
27/05/2026
Matrox Video is celebrating its 50th anniversary, marking five decades of operations from its headquarters in Montreal, Canada. Founded in 1976, the company has...
27/05/2026
Major League Baseball has announced a series of initiatives tied to America's Semiquincentennial, including a national marketing campaign, Fourth of July br...
27/05/2026
Advanced Systems Group (ASG) has announced that Brian Gross has joined the company as an Account Manager on its Audio team, based in the Burbank office. He will...
27/05/2026
Nielsen has released new research on soccer fandom ahead of the FIFA World Cup 2...
27/05/2026
ESL FACEIT Group (EFG) has unveiled a new partnership with TikTok to bring broad...
27/05/2026
FIFA's Oscar Sanchez gives a deeper look to how this tournament will be cove...
27/05/2026
The soon-to-be senior from Charlottesville is building her skills in replay, TD, and even creative content for HokieVision and its ACC Network productions
In t...
27/05/2026
FOX Sports' Mike Davies breaks down the vision for this summer's showcas...
27/05/2026
HBS's Paul King, FIFA's Oscar Sanchez preview how the masses at home wil...
27/05/2026
FOX's MLB coverage dominated the night at the 47th Annual Sports Emmy Awards...
27/05/2026
One of the most memorable Postseasons in baseball history would have had no memo...
27/05/2026
NBC's Sunday Night Football is among the most decorated and most watched programs in the history of television. It added to its jam-packed trophy case on Tu...
27/05/2026
The 2026 Sports Emmys marked a watershed moment for Prime Video Sports. After bu...
27/05/2026
With the Opening Match just over two weeks away, the entire sports-production-te...
27/05/2026
Spotify already brings together listeners' favorite music, podcasts, and audiobooks in one place. Now, we're trialing a new format that expands the cont...
27/05/2026
The best podcast moments deserve more than just a mental note. That's why today, we're making those moments easier to save and share with clips.
Whethe...
27/05/2026
On Purpose is one of the most popular podcasts in the world, known for conversat...
27/05/2026
On May 8, 1,500 of Olivia Rodrigo's top fans gathered in Barcelona's Tea...
27/05/2026
Hybrid design combines large-diaphragm capsule & ribbon
JZ Microphones have teamed up with Grammy-winning producer and engineer Marc Urselli to develop a ne...
27/05/2026
Three new plug-ins inspired by classic tape effects
AIR Music Tech's latest release delivers a set of plug-ins that aim to capture the character, moveme...
27/05/2026
Piano played on the edge of silence
The Crow Hill Company's Vaults collection offers a continual rotation of instruments that are given away for free fo...
27/05/2026
Recreates Moog's iconic Memorymoog polysynth
Arturia's vast software instrument range offers a combination of new and old, with innovative modern so...
27/05/2026
Offers loudness levelling for speech and dialogue
Accentize have built up a solid reputation with their audio-restoration tools, and their latest plug-in is...
27/05/2026
10,000 units strong - The Rohde & Schwarz R&S M3SR Radio 4400 Rohde & Schwarz celebrates a major manufacturing milestone, producing its 10,000th R&S M3SR Radi...
27/05/2026
The XL Converge 300P radio system emerges with a groundbreaking feature set enhancing the mission-critical communications of public safety, federal and critica...
27/05/2026
Pairing Two47 MCX software with existing LTE networks means tailored system upgrades that can save time, money and lives....
27/05/2026
PAC-3 MSE offers improved range, speed, and maneuverability, making it an effect...
27/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
27/05/2026
Star Trek VFX: Recreating John Knoll's Iconic Warp Stars without a Slitscan ...
27/05/2026
Adventure World Uses Blackmagic Replay for Marine Live
Brie Clayton May 27, 2026
0 Comments
Large screen displays and slow motion replays dynamically ...
27/05/2026
Berklee Alumna and Assistant Professor Olivia P rez-Collellmir to Premiere Origi...
27/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
27/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
27/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
27/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
27/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
27/05/2026
Co-founder Dan Castles to transition to Executive Chair; internal promotion reinforces continuity and long-term growth
Telestream, a global leader in media wor...
27/05/2026
Big Blue Marble today announced that its Nakolos platform is the first end-to-end 5G Broadcast solution worldwide to implement the complete feature set introduc...
27/05/2026
Lightware recently hosted the Girls' Day event in April at its headquarters in Budapest, welcoming students for an interactive introduction to engineering a...
27/05/2026
27 May 2026
VEON's Kyivstar and Uklon Launch Ukraine's First Live Testi...
27/05/2026
May 27th, 2026 May 27, 2026
Press Materials Available Here
TRIBECA X Announc...
26/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
26/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
26/05/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...