Salsa Sound Eyes U.S. Market for Automated Audio Mixing
06/10/2021
Wednesday, October 6, 2021 - 6:55 am
Print This Story | Subscribe
Story Highlights
Salsa Sound gained attention when its vCrowd artificial-crowd-sound solution became the go-to for Manchester City FC games and other sports after the COVID pandemic drove actual crowds from the soccer stands. Before that, though, the company had already started down the path of AI-based audio mixing.
In 2019, the UK company launched an innovative automated system that creates live audio mixes for soccer matches. Based on Salsa Sound's patented AI technology, the system takes audio from conventional broadcast microphones at a venue and algorithmically creates a real-time mix. It automatically mutes profanity from pitch-side mics and can be used onsite or through remote production, over IP or in the cloud.
MIXaiR, as the AI engine is dubbed, has been trained on hours and hours of content from Premier League and Championship Games, with the mixes broadcast over Man City's digital channel, says Salsa Sound Co-Founder/Director Rob Oldfield.
Salsa Sound's Rob Oldfield: We have all the infrastructure we want to move into American football; all we need is some content.
[AI is] kind of the bedrock of our company, he explains, and all came out of a university research project into interactive broadcasting. To do this, you need to have an object-based paradigm for the audio, so we developed AI algorithms that would listen to the microphones and, when something interesting was detected, would automatically chop that up as an audio object and triangulate its location so you could have this object-based audio representation. In doing this, we realized it was an opportunity not just for future broadcast but also to automate current mixing processes.
It's a way of consistently keeping the most interesting field effects of a game front and center, he says. That has been done manually for decades by opening and closing individual microphone channels as the ball moves between them, he adds, but it's suited to an automated approach, given the size of a soccer pitch and the constant noise of crowds and especially as broadcast sports moves closer to immersive mixes. The trick is a proprietary process - a really clever way, he says - of doing a crossfade over different frequency bands and using power (that is, gain) matching, so that fades from one microphone to the other are seamless transitions.
Next Steps The next step for MIXaiR in the UK is a project dubbed 5G Edge-XR, a 5G-network-based pilot backed by such entities as British Telecom; the government's Ministry for Digital, Media, Culture, and Sport; and the University of Bristol. The project is intended to enable people to immersively view sports events from all angles across a broad range of devices: smartphones, tablets, AR and VR headsets, as well as televisions. MIXaiR is to be applied first to boxing matches within the Edge-XR envelope, something Oldfield says is scheduled to take place by January.
Beyond that, Salsa is also looking at the U.S. broadcast-sports market, initially at collegiate football - particularly from the perspective of audio submixes: specifically, automating the parabolic microphones along the sidelines.
Producing that parabolic submix is a labor-intensive, difficult task, he notes. We can automate that. AI provides a much more robust and much more intelligent way of doing automated mixing - automatically recognizing what the significant audio moments are in the game - because, with parabolic microphones, it needs to have some intelligence behind it.
What's standing between MIXaiR and its U.S. application is content: authentic audio from actual games that can be used to train the AI algorithms. Specifically, he says, individual audio stems rather than fully mixed sound tracks are needed to enable the AI to analyze discrete sonic elements. For that, Salsa Sound has approached NCAA football, which he says is a huge market that could benefit from the cost-effectiveness of automated mixing.
We have all the infrastructure we want to move into American football; all we need is some content, he says. That applies to any sport. We'd just be creating a new AI module for it.
So far, no automated approaches to broadcast audio have made any swatches of its human workforce redundant, but it's a natural concern for pretty much any worker these days, especially in budget-focused broadcast.
Oldfield says they shouldn't worry: We're not making things that are trying to put people out of business; rather, we're trying to create tools that will help people work better. There's always a need for more and more content. Everybody's trying to do more but on the same budget and the same personnel roster that they've always had. This is about enabling people to create more content of a higher quality and without incurring additional costs.
And that might be music to a U.S. broadcaster's ears.
LINK: | https://www.sportsvideo.org/2021/10/06/salsa-sound-eyes-u-s-market-for... |
See more stories from svg |
More from Sports Video Group
25/04/2024
NFL Draft 2024: Verizon Expands Broadband Capacity To Handle the Spike in Demand
NFL Draft 2024: Verizon Expands Broadband Capacity To Handle the Spike in Demand Mobile cells will help accommodate first responders, social media, sports betti...
25/04/2024
NFL Draft 2024: NFL Media Teams With The Fantasy Footballers on Hybrid, REMI Production of Post-First-Round Draft Show on NFL+
NFL Draft 2024: NFL Media Teams With The Fantasy Footballers on Hybrid, REMI Pro...
25/04/2024
NFL Draft 2024: ESPN Motors Into Detroit With Trio of Simultaneous Live Presentations
NFL Draft 2024: ESPN Motors Into Detroit With Trio of Simultaneous Live Presenta...
24/04/2024
Howie Schwab - Beloved ESPN Researcher, Producer, and Trivia Star - Dies at 63
Howie Schwab - Beloved ESPN Researcher, Producer, and Trivia Star - Dies at 63 By SVG Staff Wednesday, April 24, 2024 - 6:46 am Print This Story | Subscri...
24/04/2024
Miss the SVG Venue Summit at Allegiant Stadium? All Panel Recordings Now Available on SVG PLAY
Miss the SVG Venue Summit at Allegiant Stadium? All Panel Recordings Now Availab...
23/04/2024
Soccer's Appeal to Younger Audiences: Inside the Gamification of European Football Coverage
Soccer's Appeal to Younger Audiences: Inside the Gamification of European Fo...
23/04/2024
With NBA and NHL Playoffs in Full Swing, Never a Dull Moment for TNT Sports Production and Ops Teams
With NBA and NHL Playoffs in Full Swing, Never a Dull Moment for TNT Sports Prod...
23/04/2024
NAB 2024: AT&T Business's Scott Beckett Details Transmission Firepower With Robo Dog, Mini Copter
NAB 2024: AT&T Business's Scott Beckett Details Transmission Firepower With ...
23/04/2024
NAB 2024: Manufacturers Focus on Cinematic Look for Live Productions
NAB 2024: Manufacturers focus on cinematic look for live productions By George Bevir Tuesday, April 23, 2024 - 10:40 Print This Story With live sports pro...
23/04/2024
Save the Date: SVG Sports Content Management Forum Returns to NYC on July 24
Save the Date: SVG Sports Content Management Forum Returns to NYC on July 24 By SVG Staff Tuesday, April 23, 2024 - 4:05 pm Print This Story | Subscribe ...
22/04/2024
NEP Battles Weather to Keep the Going Good for Grand National Coverage
NEP battles weather to keep the going good for Grand National coverage By Adrian Pennington Monday, April 15, 2024 - 11:48 Print This Story The 2024 Grand...
22/04/2024
ITV Racing Under Starters Orders Live at the Grand National Festival
ITV Racing under starters orders live at the Grand National Festival By Adrian Pennington Friday, April 12, 2024 - 09:10 Print This Story The Grand Nation...
22/04/2024
Inside the Deal: EFL Fans to View Enhanced Broadcasts For the Next Five Seasons as IMG Becomes Official Production Partner
Inside the deal: EFL fans to view enhanced broadcasts for the next five seasons ...
22/04/2024
To 4G, or Not To 4G: EMG on Bringing the Iconic 2024 London Marathon to Viewers Globally
To 4G, or not to 4G: EMG on bringing the iconic 2024 London Marathon to viewers ...
22/04/2024
NAB Show 2024: Our Full Collection of Video Interviews From the Show Floor
NAB Show 2024: Our Full Collection of Video Interviews From the Show Floor Industry insights from key leaders on the NAB Show exhibit floor By SVG Staff Mond...
22/04/2024
PENN Entertainment Adds ESPN/Disney Exec Aaron LeBerge as CTO
PENN Entertainment Adds ESPN/Disney Exec Aaron LeBerge as CTO By SVG Staff Monday, April 22, 2024 - 3:18 pm Print This Story | Subscribe Story Highlight...
19/04/2024
NAB 2024 in Review: West Hall - SportsTech Buzz From AWS, Appear, Ateme, The Switch, TATA Communications, Telstra, TVU Networks, Verizon, and More
NAB 2024 in Review: West Hall - SportsTech Buzz From AWS, Appear, Ateme, The Swi...
19/04/2024
NAB 2024 Draws 61,000+ Attendees With More Than Half Attending the Show for the First Time
NAB 2024 Draws 61,000+ Attendees With More Than Half Attending the Show for the ...
18/04/2024
Ping Pong for the Masses: Bringing an Old Sport to a Brand New Audience With World Table Tennis
Ping pong for the masses: Bringing an old sport to a brand new audience with Wor...
18/04/2024
Fanatical Fans: IMG on Bringing the World of Table Tennis to a New Global Audience for WTT
Fanatical fans: IMG on bringing the world of table tennis to a new global audien...
17/04/2024
Live From NAB Show 2024: Zixi CEO Gordon Brooks on Live Cloud Production with the NHL and Version 17 of the Zixi Platform
Live From NAB Show 2024: Zixi CEO Gordon Brooks on Live Cloud Production with th...
17/04/2024
SportsTechBuzz at NAB 2024: Wednesday's Latest From Vegas
SportsTechBuzz at NAB 2024: Wednesday's Latest From Vegas By SVG Staff Wednesday, April 17, 2024 - 3:00 am Print This Story The NAB Show is in full sw...
17/04/2024
Live From NAB Show 2024: Zixi CEO Gordon Brooks on Live Cloud Production with the NHL and Version 12 of the Zixi Platform
Live From NAB Show 2024: Zixi CEO Gordon Brooks on Live Cloud Production with th...
16/04/2024
SportsTechBuzz at NAB 2024: Tuesday's Latest From Vegas
SportsTechBuzz at NAB 2024: Tuesday's Latest From Vegas By SVG Staff Tuesday, April 16, 2024 - 3:15 am Print This Story The NAB Show is in full swing,...
16/04/2024
Live From NAB Show 2024: Calrec's Henry Goodman, Solid State Logic's Tom Knowles on Audio in the Cloud
Live From NAB Show 2024: Calrecs Henry Goodman, Solid State Logics Tom Knowles o...
16/04/2024
Live From NAB Show 2024: The Switch's George Lopez on Remote Production, The Cloud, and the Future of Connectivity
Live From NAB Show 2024: The Switchs George Lopez on Remote Production, The Clou...
16/04/2024
Live From NAB Show 2024: LiveU's Steve Wind-Mozley on IP, REMI Solutions for Light Weight Production
Live From NAB Show 2024: LiveUs Steve Wind-Mozley on IP, REMI Solutions for Ligh...
16/04/2024
Live From NAB Show 2024: Blackmagic Design's Bob Caniglia on Upgrades to ATEM Production Switchers, Recent Work in Replay and IP
Live From NAB Show 2024: Blackmagic Designs Bob Caniglia on Upgrades to ATEM Pro...
16/04/2024
Live From NAB Show 2024: Canon's Staff Gives a Tour of New Lenses, Multi-Camera Control App, Enhanced Use of Free Viewpoint
Live From NAB Show 2024: Canons Staff Gives a Tour of New Lenses, Multi-Camera C...
15/04/2024
SportsTechBuzz at NAB 2024: Monday's Latest From Vegas
SportsTechBuzz at NAB 2024: Monday's Latest From Vegas By SVG Staff Monday, April 15, 2024 - 3:00 am Print This Story The NAB Show is in full swing, a...
15/04/2024
Live From NAB Show 2024: Vizrt's Nicholas Jameson on the Democratization of High-End Graphics Tech
Live From NAB Show 2024: Vizrts Nicholas Jameson on the Democratization of High-...
15/04/2024
Live From NAB Show 2024: Sony's Hugo Gaggioni on the Power of Sharing and Connecting Live Production Resources
Live From NAB Show 2024: Sonys Hugo Gaggioni on the Power of Sharing and Connect...
15/04/2024
Live From NAB Show 2024: Lawo's Andreas Hilmer Walks Through HOME Apps, Dishes Latest on IP
Live From NAB Show 2024: Lawos Andreas Hilmer Walks Through HOME Apps, Dishes La...
15/04/2024
Live From NAB Show 2024: AWS' Julie Souza on the Maturation of Live Sports Production in the Cloud
Live From NAB Show 2024: AWS Julie Souza on the Maturation of Live Sports Produc...
15/04/2024
Live From NAB Show 2024: FUJINON Lenses' Stosh Durbacz on the Debut of the Duvo HZK14-100mm Lens, Adding Cinematic Feel to Broadcasts
Live From NAB Show 2024: FUJINON Lenses Stosh Durbacz on the Debut of the Duvo H...
14/04/2024
SportsTechBuzz at NAB 2024: Sunday's Latest From Vegas
SportsTechBuzz at NAB 2024: Sunday's Latest From Vegas By SVG Staff Sunday, April 14, 2024 - 12:41 am Print This Story The NAB Show kicks off today, a...
14/04/2024
Live From NAB Show 2024: Program Productions' Bob Carzoli on Investment Growth and Supporting Freelancers with the ProCrewz App
Live From NAB Show 2024: Program Productions Bob Carzoli on Investment Growth an...
14/04/2024
Live From NAB Show 2024: Appear's Thomas Bostrm Jrgensen, Alex Pannell, and Ed McGivern on Backing the Continued Growth of Live Sports
Live From NAB Show 2024: Appears Thomas Bostr m J rgensen, Alex Pannell, and Ed ...
14/04/2024
Live From NAB Show 2024: Amagi's Dan Marshall on Migrating On-Prem Data Centers to The Cloud and the Exciting Growth of FAST Channels
Live From NAB Show 2024: Amagis Dan Marshall on Migrating On-Prem Data Centers t...
14/04/2024
Live From NAB Show 2024: Ross Video's David Ross on Celebrating 50 Years with Major Product Intros
Live From NAB Show 2024: Ross Videos David Ross on Celebrating 50 Years with Maj...
14/04/2024
NAB 2024: NHL, Verizon Business, and AWS Roll Out 5G-enabled Cloud Broadcasting Solution
NAB 2024: NHL, Verizon Business, and AWS Roll Out 5G-enabled Cloud Broadcasting ...
12/04/2024
Inside the MultiVersus NHL Face-Off' Live Animated Broadcast With the NHL's David Lehanski and Keith Horstman
Inside the MultiVersus NHL Face-Off' Live Animated Broadcast With the NHL...
12/04/2024
NAB 2024: Suppliers Continue To Expand Networked-Audio Offerings
NAB 2024: Suppliers Continue To Expand Networked-Audio Offerings New and updated products boast IP and ST 2110, software systems, virtual control By Dan Daley,...
12/04/2024
Amazon Prime Video Chooses Onsite Production Path for Its 27 NWSL Matches
Amazon Prime Video Chooses Onsite Production Path for Its 27 NWSL Matches The streamer made its league debut with the 2024 NWSL Challenge Cup on March 15 By Kr...
12/04/2024
ESPN Rides Wave of Women's-Hoops Momentum Into WNBA Draft Production at Brooklyn Academy of Music
ESPN Rides Wave of Women's-Hoops Momentum Into WNBA Draft Production at Broo...
12/04/2024
SVG New Sponsor Spotlight: Mimir's Andr Torsvik on Enabling Remote Collaboration Through the Cloud
SVG New Sponsor Spotlight: Mimir's Andr Torsvik on Enabling Remote Collabor...
12/04/2024
Inside the MultiVersus NHL Face-Off Live Animated Broadcast With the NHL's David Lehanski and Keith Horstman
Inside the MultiVersus NHL Face-Off Live Animated Broadcast With the NHL's D...