
Mixing clever: Salsa Sound embraces the power of AI in MIXaiR 2.0 By Michael Burns
Monday, September 20, 2021 - 10:41
Print This Story
Salsa Sound co-founder and CEO, Rob Oldfield
Regular readers of SVG Europe will be well aware of how innovative technology companies working in sports broadcasting can be, but MIXaiR from Salsa Sound looks likely to set a new bar for live audio and the craft of sound mixing.
When the pandemic caused football games to be played in silent stadiums Salsa Sound came to the rescue of broadcasters with its vCrowd real time virtual crowd atmosphere system, which rightly won plaudits. However, MIXaiR is based on technology that the company has been working on for several years, through academia, R&D, beta versions and a soft launch of the system a year ago.
Our company was founded in 2017, but prior to that we were part of the University of Salford, where we were working on a lot of innovative audio techniques, says co-founder and CEO, Rob Oldfield. In particular we were looking at how to leverage artificial intelligence (AI) to recognise sound events and then create the best possible mix, not based on tracking but just based on what is actually [captured by] those microphones.
Fast forward to the future, next month in fact, and the new version of MIXaiR, an AI-driven system that automatically creates and enhances audio mixes for live broadcast, is set to be released.
MIXaiR 2.0 is jam packed with new features and a much more intuitive, easy to use interface, says Oldfield. The idea for v2.0 is you put all your microphones feeds in and then MIXaiR creates different submixes. So you might have a crowd, a commentary, or a pitch mix or aux in, and MIXaiR will automatically balance the levels between them, apply some processing, then create the best possible mix out of it without any human interaction, other than setting it up in the first place.
Hard tackle
According to Oldfield, the hardest mix, by a country mile, is the pitch mix. Historically, it's such a dynamic process by engineers and difficult to replicate, he explains. To make sure you've always got the nearest microphone active in the mix at any one point, requires constant attention and raising and lowering of faders. It's a really clever balancing act.
Rather like the players whose kicks it tracks, MIXaiR's AI has gone through an extensive training regime. Using machine learning technology, Salsa Sound has been training MIXaiR with many hours of content, microphone recordings and mixes across leagues.
People don't realise how hard it is to mix really well. That's why we've gone through pains to get an AI solution that takes the strain from some of the really difficult grunt work of mixing
We know what makes a great mix, says Oldfield. The AI is constantly analysing all of the sounds it is hearing. We tell it what to make of these sound events and it learns what's a kick, what's a whistle, what's a ball bounce, so that when it sees or hears sound in the wild, it can make an intelligent decision based on it.
Oldfield says MIXaiR delivers an even pitch mix, without any slightly awkward transitions and unbalanced crowd noise.
Our approach is to have the AI listen to those live microphone feeds, and when it hears a sound that's interesting like a kick, whistle, ball bounce or hitting the crossbar, you name it it will automatically add that microphone feed into the mix. It tracks the game around, always choosing the microphone that's closest to the action, and [performs] a seamless transition between them.
People don't realise how hard it is to mix really well, he adds. That's why we've gone through pains to get an AI solution that takes the strain from some of the really difficult grunt work of mixing. It can enable these guys to explore creative avenues and to create more innovative content. When you're not completely locked into your screen trying to create the best mix, you can actually lean in to MIXaiR a little bit more, let that create the stems and then you can have a bit of cognitive space to craft a mix, rather than chasing a mix.
Salsa Sound's MIXaiR GUI
The commentary and crowd noise are dynamically processed to provide mix components. These sub mixes are basically ingredients that you can throw into the output mixes, explains Oldfield. Then it's just a drag and drop process. You can create whatever output mixes you want, as many as you want, in different formats. You can have international sound, a French mix, a German mix, a Spanish mix, or whatever, and within that you can have different flavours: the stereo mix, the 5.1 mix, the mono mix. The only limitation is the number of channels that you've got available on your output board. You can also apply VST plug-ins to add your own compression or EQ or effects to the submixes, so it becomes a creative tool, allowing you to craft your mixes.
Importantly, [all mixes] are loudness normalised, he adds. If you're streaming on YouTube, or your own video on demand platform, or when it is for broadcast, they all have different loudness requirements. So within MIXaiR, you just decide which requirement you want, click on it and it will ensure that the mix adheres to those standards, so you don't end up with a fine from the regulator for making too much noise, or making not enough noise.
MIXaiR users also have an option to enhance the pitch mix with pre-recorded sounds. When somebody whacks the ball in the middle of the park, the [sound supervisor] can't even hear it because it's a long way away from the microphones, says Oldfield. However the AI can pick up a kick in the middle of the pitch. The algorithm can detect a kick, go to a bank of pre-recorded kicks and pick out the most appropriate one, and then
Most recent headlines
05/01/2027
Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...
07/10/2026
Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...
10/09/2026
Tedial is introducing Media Business Hub (MBH) at IBC 2026, a new business enablement platform designed to help media organizations unlock the full value of the...
10/09/2026
Globecast, a leading provider of broadcast, media and entertainment managed services, will unveil the next phase of its transformation at IBC2026 with a preview...
10/09/2026
Fabric Data and TMT Insights today announced that the two companies are combining to create Fabric Insights, uniting authoritative data, purpose-built software,...
10/09/2026
Operative, the preferred advertising and broadcast management provider for the world's leading media brands, today announced a comprehensive slate of new pr...
10/09/2026
Test & measurement innovator, Leader Electronics of Europe, has announced the launch of its latest range of handheld signal generation, analysis and monitoring ...
10/09/2026
The partnership begins with native Zixi protocol support on the Kiloview D350 and will extend to deeper product integration and joint go-to-market initiatives
...
10/09/2026
Avid and FilmLight announce strategic partnership to reimagine the color pipelin...
10/09/2026
Maxon Brings Exclusive Preview of Fall Innovations to IBC2026
Brie Clayton September 10, 2026
0 Comments
IBC attendees will get the first look at new ...
10/09/2026
Puget Systems Launches Built Different by Puget Systems, A New Podcast That Go...
10/09/2026
Three Boston Conservatory Dance Alums Honored for Their Early-Career Promise India Hobbs and Demetrius Lee received Princess Grace Awards, while Lilly David t...
10/09/2026
MonoNeon Returns to Berklee to Kick Off Signature Series The Grammy-winning bassist and alumnus performs with students and faculty from the Planet MicroJam In...
10/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
10/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
10/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
10/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
10/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...
10/09/2026
RT to Broadcast Amgen Irish Open free-to-air
New multi-year agreement will see RT continue to bring the Amgen Irish Open to Irish audiences
Ryder Cup hig...
10/09/2026
More than 30 women report allegations of sexual harassment, misogyny and bullying within National Ambulance Service
Tonight on RT Prime Time, 9:35pm, RT One ...
10/09/2026
Series 3 of Nero's Class begins Friday 11 September on RT Listen
The third...
10/09/2026
Gear up: The latest PC games and major updates are ready to play on GeForce NOW ...
10/09/2026
AI inference chipmaker d-Matrix today announced it will use NVIDIA NVLink Fusion to connect its next-generation Raptor XPUs to NVIDIA's AI infrastructure pl...
09/09/2026
Sony Electronics has announced the SEL814G, the company's first fisheye zoom G Lens for full-frame Alpha E-mount cameras. The lens will be available in Octo...
09/09/2026
Telestream has announced an expansion of its Practical AI capabilities across th...
09/09/2026
Haivision and Chyron have announced a technology partnership integrating Haivisi...
09/09/2026
Omaha Productions has released ManningCast: Heist, a short film featuring Peyton and Eli Manning attempting to break into NFL Commissioner Roger Goodell's o...
09/09/2026
Imagine Communications will demonstrate the next evolution of XVR at IBC2026 (Stand 1.B73, RAI Amsterdam, September 11-14).
XVR is Imagine's channel-in-a-b...
09/09/2026
swXtch.io has announced abbe, an AI-based orchestration layer for live media workflows, making its world premiere at IBC2026 (Meeting Room 5.MR13, Hall 5, Septe...
09/09/2026
NFL Films has announced the second season of Inside the NFL on X as an X Original, premiering Wednesday, September 9. The series marks Inside the NFL's 50th...
09/09/2026
LiveU has announced an expanded partnership with The Associated Press, deploying the largest fleet of LU900Q intelligent production units in the industry as par...
09/09/2026
Diversified has announced plans to consolidate its four existing New Jersey locations into a new facility in Newark, expected to be fully operational by the end...
09/09/2026
Wisycom will exhibit new RF products at IBC2026 (Stand 8.D60, September 11-14), including the MATF Wideband Antenna Matrix, PFL Portable RF over Fiber Box, and ...
09/09/2026
Guntermann & Drunck (G&D) and VuWall, both Panoptec companies, will introduce vsNEO at IBC2026 (Stand 8.B63, September 11, RAI Amsterdam). Pre-orders open in ea...
09/09/2026
Mo-Sys has completed a business restructuring and relocated to a new facility in Canada Water, London. As part of the reorganization, Selin Kemal has been promo...
09/09/2026
Aicox has integrated TAG Video Systems' Core monitoring platform into Telef nica's TSAmediaHUB audiovisual contribution and distribution infrastructure....
09/09/2026
Blackmagic Design has released DaVinci Resolve 21.1, a free update available now through the Blackmagic Design website. The release adds new AI tools, workflow ...
09/09/2026
ESPN and Apple Music have announced a collaboration on music curation for Monday...
09/09/2026
Sacramento Production Services has completed a wireless audio overhaul at Sutter Health Park, home of the Athletics during their three-year residency in Sacrame...
09/09/2026
NDI and NVIDIA have announced a collaboration to develop AI-powered workflows enabling broadcasters to create and distribute multilingual content from a single ...
09/09/2026
Christopher Chip Adams, Troy Aikman, Jim Dove, Jim Eady, Bucky Gunts, Robert A. Iger, Charlie Jablonski, Robert Kraft, Tom Rinaldi, and Dick Stockton to be ho...
09/09/2026
ND2 returns as the primary unit, While FNIA gets SSQC and new flexible Rover...
09/09/2026
New parts aimed at hip-hop and pop productions
The latest update to Celemony's innovative virtual session musician expands the collection of built-in in...
09/09/2026
Save up to 40% until 21 September 2026
Sonarworks are currently running their Autumn Sale, with discounts of up to 40% currently available across their rang...
09/09/2026
Upcoming title officially launches in September 2026
Bjooks' celebrations for this year's 909 Day will be welcome news amongst drum machine lovers, ...
09/09/2026
NITV to bring First Nations netball to audiences nationwide
9 September, 2026
Media releases
Every match of the 2026 First Nations Tournament will be live ...
09/09/2026
The National Film and Video Foundation (NFVF) invites eligible Tier 1 and 2 South African production companies to submit proposals to serve as the Facilitating ...
09/09/2026
Italy launch follows UK and Germany as Nielsen expands product across EMEA
Milan, Italy, September 9, 2026 - Nielsen, a global leader in audience measurement, ...
09/09/2026
Planned solutions tackle accuracy, cost and latency barriers to deploying AI at ...
09/09/2026
Share
Copy link
Facebook
X
Linkedin
Bluesky
Email...