
Mixing clever: Salsa Sound embraces the power of AI in MIXaiR 2.0 By Michael Burns
Monday, September 20, 2021 - 10:41
Print This Story
Salsa Sound co-founder and CEO, Rob Oldfield
Regular readers of SVG Europe will be well aware of how innovative technology companies working in sports broadcasting can be, but MIXaiR from Salsa Sound looks likely to set a new bar for live audio and the craft of sound mixing.
When the pandemic caused football games to be played in silent stadiums Salsa Sound came to the rescue of broadcasters with its vCrowd real time virtual crowd atmosphere system, which rightly won plaudits. However, MIXaiR is based on technology that the company has been working on for several years, through academia, R&D, beta versions and a soft launch of the system a year ago.
Our company was founded in 2017, but prior to that we were part of the University of Salford, where we were working on a lot of innovative audio techniques, says co-founder and CEO, Rob Oldfield. In particular we were looking at how to leverage artificial intelligence (AI) to recognise sound events and then create the best possible mix, not based on tracking but just based on what is actually [captured by] those microphones.
Fast forward to the future, next month in fact, and the new version of MIXaiR, an AI-driven system that automatically creates and enhances audio mixes for live broadcast, is set to be released.
MIXaiR 2.0 is jam packed with new features and a much more intuitive, easy to use interface, says Oldfield. The idea for v2.0 is you put all your microphones feeds in and then MIXaiR creates different submixes. So you might have a crowd, a commentary, or a pitch mix or aux in, and MIXaiR will automatically balance the levels between them, apply some processing, then create the best possible mix out of it without any human interaction, other than setting it up in the first place.
Hard tackle
According to Oldfield, the hardest mix, by a country mile, is the pitch mix. Historically, it's such a dynamic process by engineers and difficult to replicate, he explains. To make sure you've always got the nearest microphone active in the mix at any one point, requires constant attention and raising and lowering of faders. It's a really clever balancing act.
Rather like the players whose kicks it tracks, MIXaiR's AI has gone through an extensive training regime. Using machine learning technology, Salsa Sound has been training MIXaiR with many hours of content, microphone recordings and mixes across leagues.
People don't realise how hard it is to mix really well. That's why we've gone through pains to get an AI solution that takes the strain from some of the really difficult grunt work of mixing
We know what makes a great mix, says Oldfield. The AI is constantly analysing all of the sounds it is hearing. We tell it what to make of these sound events and it learns what's a kick, what's a whistle, what's a ball bounce, so that when it sees or hears sound in the wild, it can make an intelligent decision based on it.
Oldfield says MIXaiR delivers an even pitch mix, without any slightly awkward transitions and unbalanced crowd noise.
Our approach is to have the AI listen to those live microphone feeds, and when it hears a sound that's interesting like a kick, whistle, ball bounce or hitting the crossbar, you name it it will automatically add that microphone feed into the mix. It tracks the game around, always choosing the microphone that's closest to the action, and [performs] a seamless transition between them.
People don't realise how hard it is to mix really well, he adds. That's why we've gone through pains to get an AI solution that takes the strain from some of the really difficult grunt work of mixing. It can enable these guys to explore creative avenues and to create more innovative content. When you're not completely locked into your screen trying to create the best mix, you can actually lean in to MIXaiR a little bit more, let that create the stems and then you can have a bit of cognitive space to craft a mix, rather than chasing a mix.
Salsa Sound's MIXaiR GUI
The commentary and crowd noise are dynamically processed to provide mix components. These sub mixes are basically ingredients that you can throw into the output mixes, explains Oldfield. Then it's just a drag and drop process. You can create whatever output mixes you want, as many as you want, in different formats. You can have international sound, a French mix, a German mix, a Spanish mix, or whatever, and within that you can have different flavours: the stereo mix, the 5.1 mix, the mono mix. The only limitation is the number of channels that you've got available on your output board. You can also apply VST plug-ins to add your own compression or EQ or effects to the submixes, so it becomes a creative tool, allowing you to craft your mixes.
Importantly, [all mixes] are loudness normalised, he adds. If you're streaming on YouTube, or your own video on demand platform, or when it is for broadcast, they all have different loudness requirements. So within MIXaiR, you just decide which requirement you want, click on it and it will ensure that the mix adheres to those standards, so you don't end up with a fine from the regulator for making too much noise, or making not enough noise.
MIXaiR users also have an option to enhance the pitch mix with pre-recorded sounds. When somebody whacks the ball in the middle of the park, the [sound supervisor] can't even hear it because it's a long way away from the microphones, says Oldfield. However the AI can pick up a kick in the middle of the pitch. The algorithm can detect a kick, go to a bank of pre-recorded kicks and pick out the most appropriate one, and then
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
06/09/2026
June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...
18/08/2026
SportStream 2026, a free three-day virtual event, will take place September 15-17. One registration provides access to all three days of live programming and on...
18/08/2026
BeckTV will introduce BeckFlow to the European market at IBC2026, demonstrated on the Providius stand (10.F53).
BeckFlow is a web-based schematic documentation...
18/08/2026
Boland Communications will introduce a SMPTE ST 2110 input option for its 4K monitors at IBC2026, along with a new 55-inch super-narrow bezel display for video ...
18/08/2026
Dolby Laboratories and the Seattle Seahawks have announced a partnership integrating Dolby OptiView into the Seahawks' live streaming coverage, making the S...
18/08/2026
For BMG Executive Producer of Sports Production, Graham Taylor, producing live s...
18/08/2026
TMRW Sports has appointed Rufus Hack as President of Golf, a newly created role in which he will lead the company's golf businesses including TGL presented ...
18/08/2026
SMT will provide race technology for FOX Sports' coverage of the Freedom 250 Grand Prix of Washington, D.C. on August 23, when the NTT INDYCAR SERIES races ...
18/08/2026
The live, YouTube-native roundtables combine fan voices, credentialed reporters,...
18/08/2026
Behind The Mic provides a roundup of recent news regarding on-air talent, includ...
18/08/2026
The industry legend sounds off on replacing the Heat's iconic Medusa score...
18/08/2026
William F. Rasmussen, the sports fan-turned broadcaster and entrepreneur whose out-of-the-box idea of a 24-hour cable sports network, ESPN, changed forever the ...
18/08/2026
DAZN Group has completed its acquisition of ViewLift, a provider of streaming and digital solutions for sports content owners. The acquisition was first announc...
18/08/2026
The American Association of Professional Baseball (AAPB) has added SI TV, Sports Illustrated's 24/7 streaming channel, as a broadcast partner for the remain...
18/08/2026
The Esports Foundation has announced that the inaugural Esports Nations Cup (ENC), originally scheduled for November 2026 in Riyadh, will be postponed to Novemb...
18/08/2026
Diversified has announced a new Global Managed Services Practice, consolidating the company's managed services capabilities into one organization. Rob Mello...
18/08/2026
Appear has completed a proof of concept with Thoroughbred Racing Productions (TRP), demonstrating multi-camera remote live production over bonded 5G cellular an...
18/08/2026
Riedel Communications has announced that Edith Cowan University (ECU) in Perth, ...
18/08/2026
Company launch with stereo-imaging tool
Panoramic is the debut release from Panorama Labs, a new company formed by mastering engineer Nicholas Di Lorenzo. C...
18/08/2026
Control software now available for older interfaces
Focusrite have just announced the launch of an update that extends Control 2 software support their Scar...
18/08/2026
The National Film and Video Foundation (NFVF), an agency of the Department of Sp...
18/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
18/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
18/08/2026
Lightware announces an integration with SpectralBot that helps system integrators and AV operators troubleshoot faster using augmented reality (AR), AI-assisted...
18/08/2026
Command Frame for After Effects
Scott Black August 18, 2026
0 Comments
Free download, demonstrations, hands-on tests, and creator resources
Want to t...
18/08/2026
At Stand 14.A57, the data company will demonstrate GreenDot and IBM Aspera together, giving media and entertainment businesses real-time visibility of what thei...
18/08/2026
New tool provides a robust audit of operational workflows, calculating the tangible value each delivers today, and informing business decisions for tomorrow.
W...
18/08/2026
Media Utilities is integrating its activities into DigiNet and will maintain a recognisable presence in the market under the name: Media Utilities, a DigiNet br...
18/08/2026
Proof of Concept validates reliable multi-camera live production from remote racecourses without fixed network infrastructure
Appear ASA (Appear, OSE:APR), a g...
18/08/2026
Stingr, a new venture from the founders of Hornets Tech, is bringing its second-screen interaction platform to IBC2026.
The second screen has never really wor...
18/08/2026
Long-established satellite equipment manufacturer and systems integrator Hiltron Communications will promote its new HACUX-IDU2 antenna control unit touchscreen...
18/08/2026
EMAM, PlayBox Neo and SNEWS Launch Combined Nuvex System
Brie Clayton August 17, 2026
0 Comments
Integrated platform melds media asset management, pla...
18/08/2026
The United Stand Scales Live Fan Show with Blackmagic Design Workflow
Brie Clayton August 17, 2026
0 Comments
ATEM Constellation 8K and HyperDeck Stud...
18/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
18/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
18/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
18/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
18/08/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
18/08/2026
Triveni Digital Now Offers a Joint Solution With MediaKind and a Lab System Bundle Supporting ISDB-Tb and TV 3.0 Broadcast Services
Triveni Digital, a trusted ...
18/08/2026
At IBC2026, BeckTV, a premier systems integrator for the broadcast industry, will introduce BeckFlow to the European market. BeckFlow is the first web-based sch...
18/08/2026
New flagship PTZ camera combines cinematic 4K imaging, professional broadcast connectivity and the complete Horizon intelligent video experience for productions...
18/08/2026
At IBC2026, VisualOn will demonstrate how video service providers can slash bandwidth costs, maximize ad revenue, and deploy premium interactive features withou...
18/08/2026
The relationships built during graduate school often continue to shape careers long after a degree is earned, creating a community of scientists who learn from ...
18/08/2026
Tuesday 18 August 2026
Sky Sports and The Fast and the Curious announce new partnership
Sky Sports and The Fast and the Curious have announced a new long-term...
18/08/2026
Wuppertal August 18, 2026
Riedel Brings Professional Live Production Into the Classrooms of ECURiedel Communications today announced that Edith Cowan Universi...
18/08/2026
In my previous article, The AI Shift Feels Familiar. Our Response Should Be Different., I argued that the greatest challenge organizations face is no longer the...
18/08/2026
Apple today announced changes to its business terms for apps in the European Uni...
18/08/2026
THE HEALY RAES: BLOOD, SWEAT & TEARS AIRS WEDNESDAY AUGUST 19 ON RT ONE AT 9:35PM
A new documentary The Healy-Raes: Blood, Sweat & Tears airs on RT One and ...