Sony Pixel Power calrec Sony

Mixing Clever: Salsa Sound Embraces the Power of AI in MIXaiR 2.0

22/09/2021

Mixing clever: Salsa Sound embraces the power of AI in MIXaiR 2.0 By Michael Burns

Monday, September 20, 2021 - 10:41

Print This Story

Salsa Sound co-founder and CEO, Rob Oldfield

Regular readers of SVG Europe will be well aware of how innovative technology companies working in sports broadcasting can be, but MIXaiR from Salsa Sound looks likely to set a new bar for live audio and the craft of sound mixing.

When the pandemic caused football games to be played in silent stadiums Salsa Sound came to the rescue of broadcasters with its vCrowd real time virtual crowd atmosphere system, which rightly won plaudits. However, MIXaiR is based on technology that the company has been working on for several years, through academia, R&D, beta versions and a soft launch of the system a year ago.

Our company was founded in 2017, but prior to that we were part of the University of Salford, where we were working on a lot of innovative audio techniques, says co-founder and CEO, Rob Oldfield. In particular we were looking at how to leverage artificial intelligence (AI) to recognise sound events and then create the best possible mix, not based on tracking but just based on what is actually [captured by] those microphones.

Fast forward to the future, next month in fact, and the new version of MIXaiR, an AI-driven system that automatically creates and enhances audio mixes for live broadcast, is set to be released.

MIXaiR 2.0 is jam packed with new features and a much more intuitive, easy to use interface, says Oldfield. The idea for v2.0 is you put all your microphones feeds in and then MIXaiR creates different submixes. So you might have a crowd, a commentary, or a pitch mix or aux in, and MIXaiR will automatically balance the levels between them, apply some processing, then create the best possible mix out of it without any human interaction, other than setting it up in the first place.

Hard tackle

According to Oldfield, the hardest mix, by a country mile, is the pitch mix. Historically, it's such a dynamic process by engineers and difficult to replicate, he explains. To make sure you've always got the nearest microphone active in the mix at any one point, requires constant attention and raising and lowering of faders. It's a really clever balancing act.

Rather like the players whose kicks it tracks, MIXaiR's AI has gone through an extensive training regime. Using machine learning technology, Salsa Sound has been training MIXaiR with many hours of content, microphone recordings and mixes across leagues.

People don't realise how hard it is to mix really well. That's why we've gone through pains to get an AI solution that takes the strain from some of the really difficult grunt work of mixing

We know what makes a great mix, says Oldfield. The AI is constantly analysing all of the sounds it is hearing. We tell it what to make of these sound events and it learns what's a kick, what's a whistle, what's a ball bounce, so that when it sees or hears sound in the wild, it can make an intelligent decision based on it.

Oldfield says MIXaiR delivers an even pitch mix, without any slightly awkward transitions and unbalanced crowd noise.

Our approach is to have the AI listen to those live microphone feeds, and when it hears a sound that's interesting like a kick, whistle, ball bounce or hitting the crossbar, you name it it will automatically add that microphone feed into the mix. It tracks the game around, always choosing the microphone that's closest to the action, and [performs] a seamless transition between them.

People don't realise how hard it is to mix really well, he adds. That's why we've gone through pains to get an AI solution that takes the strain from some of the really difficult grunt work of mixing. It can enable these guys to explore creative avenues and to create more innovative content. When you're not completely locked into your screen trying to create the best mix, you can actually lean in to MIXaiR a little bit more, let that create the stems and then you can have a bit of cognitive space to craft a mix, rather than chasing a mix.

Salsa Sound's MIXaiR GUI

The commentary and crowd noise are dynamically processed to provide mix components. These sub mixes are basically ingredients that you can throw into the output mixes, explains Oldfield. Then it's just a drag and drop process. You can create whatever output mixes you want, as many as you want, in different formats. You can have international sound, a French mix, a German mix, a Spanish mix, or whatever, and within that you can have different flavours: the stereo mix, the 5.1 mix, the mono mix. The only limitation is the number of channels that you've got available on your output board. You can also apply VST plug-ins to add your own compression or EQ or effects to the submixes, so it becomes a creative tool, allowing you to craft your mixes.

Importantly, [all mixes] are loudness normalised, he adds. If you're streaming on YouTube, or your own video on demand platform, or when it is for broadcast, they all have different loudness requirements. So within MIXaiR, you just decide which requirement you want, click on it and it will ensure that the mix adheres to those standards, so you don't end up with a fine from the regulator for making too much noise, or making not enough noise.

MIXaiR users also have an option to enhance the pitch mix with pre-recorded sounds. When somebody whacks the ball in the middle of the park, the [sound supervisor] can't even hear it because it's a long way away from the microphones, says Oldfield. However the AI can pick up a kick in the middle of the pitch. The algorithm can detect a kick, go to a bank of pre-recorded kicks and pick out the most appropriate one, and then
LINK: https://www.svgeurope.org/blog/headlines/mixing-clever-salsa-sound-emb...
See more stories from svg

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

07/10/2026

Dalet Flex LTS Delivers Smarter Media Operations from Ingest to Distribution

Dalet, a leading technology and service provider for media-rich organizations, today announced the latest Long-Term Supported (LTS) release of Dalet Flex. Build...

06/09/2026

Dolby and MagentaTV Bring Fans Closer to the FIFA World Cup 2026 in Germany with Dolby Vision and Dolby Atmos

June 9 2026, 23:00 (PDT) Dolby and MagentaTV Bring Fans Closer to the FIFA Worl...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

29/07/2026

Grass Valley Op-Ed Series: Seven Paradoxes Shaping the Next Era of Media Production

In this series, Grass Valley explores the seven paradoxes shaping the next era o...

29/07/2026

SVG Students to Watch: A Look Back at a Year of Spotlighting the Emerging Talent in Live Sports Production

Thats a wrap on Season 1 of SVG Students to Watch! Across the country, these stu...

29/07/2026

DAZN to Become Exclusive DTC In-Market Streaming Home of YES Network, MSG Networks; Gotham App to Shut Down

The agreement will move Gotham Sports App subscribers to DAZN during the 2026-27...

29/07/2026

Big South Promotes Emily Dassel to Associate Commissioner for Brand and Creative Strategy

Longtime digital-media leader expands role overseeing conference branding, video...

29/07/2026

Give Me the Backstory: Get to Know Gregg Araki, the Director of I Want Your Sex

By Bailey Pennick One of the most exciting things about the Sundance Film Festival is having a front-row seat for the bright future of independent filmmaking. ...

29/07/2026

TiME UK announce transatlantic partnership

Organisation team up with TI:ME USA Founded in 2019 with the aim of helping educators to embrace new music technology, Technology in Music Education (TiME U...

29/07/2026

Multiply 2: Free plug-in from Acon Digital

Doubling & chorus processor gets an overhaul Acon Digital have just launched the latest version of their free voice-doubling and chorus plug-in. Multiply 2 ...

29/07/2026

Origin Effects launch the EQDeluxe

New Pultec-inspired pedal revealed The latest addition to the Origin Effects line-up brings the legendary Pultec EQ into pedal format. Based on the EQP-1A, ...

29/07/2026

SBS Appoints Chief Commercial Officer and Director of Marketing and Audiences

SBS Appoints Chief Commercial Officer and Director of Marketing and Audiences 29 July, 2026 Media releases SBS is pleased to announce the appointment of Ni...

29/07/2026

Rohde & Schwarz showcases unified next-generation broadcasting ecosystem at SET Expo 2026 in Brazil

Rohde & Schwarz showcases unified next-generation broadcasting ecosystem at SET ...

29/07/2026

Central Christian Church Connects Remote Production Teams with Clear-Com's Gen-IC...

eds3_5_jq(document).ready(function($) { $(#eds_sliderM519).chameleonSlider_2_1({...

29/07/2026

Streaming Embarks on Annual Summer Ascent in Nielsen's May 2026 Gauge Reports

Streaming Hits 48.6% of Total TV Usage in May YouTube Leads in Media Distributo...

29/07/2026

WVIT's Joseph DiMaggio Named SBE Flanders Engineer of the Year

Share Copy link Facebook X Linkedin Bluesky Email...

29/07/2026

Amagi Appoints Martin Wacker to Lead Sales for DACH -- St...

Industry veteran joins Amagi to drive growth in Europe's leading broadcast market and advance cloud-native broadcast, FAST, and AI-driven operations. LONDO...

29/07/2026

WebTransport opens new route for broadcast-quality media...

Work is ongoing to specify how to run RIST over WebTransport. This will deliver secure, stable, broadcast quality video playback and origination to any platform...

29/07/2026

Offline Files Makes the Drive Shelf Searchable on Mac

Offline Files Makes the Drive Shelf Searchable on Mac Brie Clayton July 29, 2026 0 Comments A local Mac app for finding files, photos, and footage acr...

29/07/2026

Blackmagic Design Announces New UltraStudio Mini 12G

Blackmagic Design Announces New UltraStudio Mini 12G Brie Clayton July 29, 2026 0 Comments New extremely portable Thunderbolt 4 capture and playback ...

29/07/2026

Brightline Lighting Introduces the MOD1

Brightline Lighting, a premier manufacturer of energy-efficient lighting systems for broadcast, videoconferencing, government, education and corporate applicati...

29/07/2026

Applications open for IFFI/WAVES Film Bazaar in Goa - Producer Delegation

Applications open for IFFI/WAVES Film Bazaar in Goa - Producer Delegation 28 July 2026 Image credit: Four Years Later Screen Australia has opened applications...

29/07/2026

Brightline Unveils Compact, Suspended MOD1 LED Light

Share Copy link Facebook X Linkedin Bluesky Email...

29/07/2026

NAB Meets With Trusty on Ownership Caps

Share Copy link Facebook X Linkedin Bluesky Email...

29/07/2026

QuickLink To Feature New StudioPro AnywhereTally At IBC 2026

Share Copy link Facebook X Linkedin Bluesky Email...

29/07/2026

HBO Max Launches Vertical Shorts to Improve Content Discovery

Share Copy link Facebook X Linkedin Bluesky Email...

29/07/2026

New Tool Identifies Sources Of Fake Videos

Share Copy link Facebook X Linkedin Bluesky Email...

29/07/2026

DNEG Migrates Editorial Workflows to Foundrys Hiero

Foundry today announced that Academy Award-winning creative studio DNEG has implemented Hiero to support its editorial workflows. Part of the Nuke product famil...

29/07/2026

QuickLink Unveils New StudioPro AnywhereTally Remote Tall...

The Latest Addition to the Brand's StudioPro Ecosystem Combines Simple Deployment, Cloud Control and Professional Grade Wireless Reliability QuickLink, a l...

29/07/2026

The Secret Master Adjustment Layer Hack in After Effects

The Secret Master Adjustment Layer Hack in After Effects Graham Quince July 28, 2026 0 Comments Trish Meyer (who literally beta-tested the original Af...

29/07/2026

Post Completed with Blackmagic Cloud for Shane Kosugi's Feature Film SEEK

Post Completed with Blackmagic Cloud for Shane Kosugi's Feature Film SEEK Brie Clayton July 28, 2026 0 Comments Cannes Indie International Film Fe...

29/07/2026

Isabeau Miller Named Chair of Berklee Songwriting Department

Isabeau Miller Named Chair of Berklee Songwriting Department The Berklee alumna, who previously served on the Songwriting faculty, will begin her new role on ...

29/07/2026

Hayu is coming to Sky, bringing fan-favourite franchises The Real Housewives, Below Deck and more to customers, at no extra cost

Wednesday 29 July 2026 Hayu is coming to Sky, bringing fan-favourite franchises...

29/07/2026

New RT true crime podcast launches today

RT launches Unsolved, a true crime podcast, presented by crime journalist Barry Cummins and presenter Katja Mia. Unsolved is a weekly podcast exploring unsol...

28/07/2026

LiveUs World Cup Record: 1,700 Units Support Wide Range of Transmission Needs

LiveU, the pioneer in IP-video transmission and cloud-based remote production, today detailed its historic performance records set during the 2026 FIFA World Cu...

28/07/2026

Case Study: How the Dallas Cowboys Removed Bottlenecks in Off-site Content Production

The NFL franchise rebuilt their off-site content operation for an era when teams...

28/07/2026

A New Way To Watch': How Formula 1 and Sky Sports Are Pushing Race Coverage Into a New Era

Longtime partners expand viewer choice, data-driven analysis, access, immersive ...

28/07/2026

Grass Valley Op Ed: Seven Paradoxes Shaping the Next Era of Media Production

There is a unique moment before every major production. The audience never sees it. The cameras are ready. The talent is preparing. Directors review the final...

28/07/2026

The CW Network, ESPN Ink Streaming Agreement With Launch on Aug. 4

The CW Network and ESPN have announced their highly anticipated streaming agreement to bring CW Sports' live events to the ESPN App will officially launch o...

28/07/2026

Lawo Delivers Audio Excellence for Europes Largest Classical Open-Air Concert on Bastille Day

As more than tens of thousands of spectators filled Paris' Champ de Mars and...

28/07/2026

Appear Assists Chile's First Large-Scale 4K FIFA World Cup Viewing Experience

Appear's X Platform played a central role in Chile's first large-scale c...

28/07/2026

IBC 2026: Solid State Logic Highlights Transition to Software-Defined Production

Responding to the broadcast industry's shift to embrace more flexible production platforms, Solid State Logic (SSL) is evolving its comprehensive System T p...

28/07/2026

TNT Sports Goes to Greater Heights With New DUNKMAN League

Production leverages innovative camera technologies, AI, and data to capture the action in four-week inaugural competition The first-ever professional dunking ...

28/07/2026

Rogers, Prime Video Ink 12-Year Sublicensing Deal for NHL Rights in Canada

Prime Video to exclusively broadcast Wednesday night national NHL regular-season games in Canada...

28/07/2026

CBS Sports Snags U.S. English-Language Rights for CONCACAF Champions Cup

Every match will stream live on Paramount+ beginning in February,...

28/07/2026

TK Audio unveil the TK-Lizer 3

Baxandall-inspired hardware EQ overhauled TK Audio's Baxandall-inspired hardware EQ unit has just made a return, bringing the popular unit back into the...

28/07/2026

Asparion reveal the D700 Rack

D700 system gains new live-focused rackmount surface Asparion have just announced an expansion of their D700 control surface range, introducing a new model ...

28/07/2026

Six NFVF Presidential Employment Stimulus Programme (PESP)-Funded Films Selected for the 47th Durban International Film Festival (DIFF)

27 July 2026, Johannesburg - The National Film and Video Foundation (NFVF), an a...

28/07/2026

Nielsen Launches Ad Intel AI: the Only Product of its Kind that Transforms Fragmented Ad Data into Actionable Intelligence

Ad Intel AI is Nielsen's first in a new generation of AI products built to t...