Sony Pixel Power calrec Sony

AI and Audio: Implications as the Technology Moves Into the Broadcast Soundscape

15/01/2025

AI and Audio: Implications as the Technology Moves Into the Broadcast Soundscape Audio execs see artificial intelligence as an ultra-smart, ultra-fast assistant By Dan Daley, Audio Editor

Wednesday, January 15, 2025 - 7:00 am

Print This Story | Subscribe

Story Highlights

Artificial intelligence (AI) already has significant presence in professional audio. It's automating and streamlining such tasks as editing, mixing, mastering, and, increasingly, music creation and generation. It allows producers and engineers to work faster and more efficiently and offers new creative possibilities. Even so, there are concerns regarding the potential for loss of human creative input and the ethical implications of AI-generated content.

SVG asked some industry thought leaders for their views on this inflective moment in pro audio's evolution.

NBC Sports' Karl Malone: The beauty of AI lies in its ability to analyze a scenario and evaluate far more parameters of an audio signal than we ever could as humans.

Karl Malone, senior director, audio engineering, NBC Sports:

I'm excited to have the ability to see what can be achieved with new AI tools in broadcast audio. We already look to Cedars, Isotopes, and upmix engines to look after complex tasks, and the use of Kick for mixing ball effects in European football should be enough for us to take automated and intelligent technology seriously.

The beauty of AI lies in its ability to analyze a scenario and evaluate far more parameters of an audio signal than we ever could as humans. Although A1s excel at brain-to-hand-to-eye coordination, we simply cannot match the computational foresight of AI. It can process information in real time, anticipate outcomes, and make decisions or offer suggestions based on both its analysis and the specific training it has received for a given situation.

However, the artistic nuances and creative expertise that define an A1's work are irreplaceable, making AI unsuitable for mixing a major broadcast show on its own. That said, AI could be highly effective in handling secondary outputs, such as creating a dedicated mix for second-screen feeds - focusing, for instance, on mixing close ball effects and radio commentary as a separate audio feed.

AI can also be helpful in the QC of large numbers of program feeds to be able to check audio and video for all sorts of visual- and audio-mix issues: out-of-sync audio and video, artifacts in video-resolution-quality fluctuations, missing audio, clipping, metadata timing, phase, etc. It can alert the MCR/BOC operator to take a closer look or listen.

Ultimately, we decide if we want to use it in these early stages or not, so it's not being forced upon anyone to implement.

Audio-Technica's Gary Dixon: AI is a tool for humans to better react to unpredictable events caused by interesting human nature.

Gary Dixon, director, broadcast and production business development, Audio-Technica:

Audio is dynamic, and the moments worth hearing are typically unpredictable: such as a crash in racing, the eruption of the crowd at the 18th hole, or holding a music note just a little longer at a concert. AI in professional audio and in microphones specifically will be used as a tool for quickly adapting hardware in unpredictable audio situations. Hardware can have limitations in gain structure, dynamics, and general EQ, whereas AI can assist the human in reacting to these situations.

However, for audio to appeal to humans, the final monitoring stage and final adjustments will need to be done by humans. AI is a tool for humans to better react to unpredictable events caused by interesting human nature.

Christian Scheck, head of marketing content, Lawo:

From a content-creation perspective, generative AI is proving extremely powerful. As far as video is concerned, it is already possible to feed a generative AI engine with some information to get usable footage.

Similarly, on the audio side, music written and performed by AI engines is beginning to scare songwriters and performers alike, while artificially generated voiceovers for videos and live commentary for broadcasts manage to fool a growing number of listeners into believing that they are listening to a human.

AI has been used to good effect for the generation of closed captioning, which used to be a time-consuming task and can now be prepared within minutes. Results, however, still need to be checked by a human for consistency, tone of voice, and, critically, accuracy.

Lawo's Christian Scheck: AI has been used to good effect for the generation of closed captioning, which used to be a time-consuming task. Results, however, still need to be checked by a human.

In the broadcast industry, more-advanced algorithms [can] help audio engineers, for instance, cope with a rapidly growing workload, not least in immersive-audio-mixing scenarios that require the supervision and delivery of several presentations and downmix formats - all from one console and by a single A1.

Ultimately, the success of AI in live-production scenarios will depend on how well it responds to unexpected situations. It may very well become a powerful assistant that complements media production based on the use of Lawo solutions, but whether it will be able to replace DSP audio or high-quality video processing remains to be seen.

AI can add value in other ways. On a modern, software-based platform like HOME Apps, for instance, AI can streamline process monitoring, vastly improve debug times, and shorten downtimes, as well as assist with data analysis and help predict failure conditions.

Other applications could include advanced auto-mixing algorithms or the intelligent deployment of apps and services to max out hardware and software utilization in scenarios with a limited number of computing resources.

However, AI needs to be applied wi
LINK: https://www.sportsvideo.org/2025/01/15/ai-and-audio-implications-as-th...
See more stories from svg

More from Sports Video Group

18/02/2025

Save the Date! SVG Cloud Production Forum Returns to NYC on May 15

Save the Date! SVG Cloud Production Forum Returns to NYC on May 15 Third-annual event will address one of the hottest topics in the industry By SVG Staff Tue...

15/02/2025

Live From 2025 NBA All-Star Weekend: After 25 Years, TNT Sports Goes All-In on Final Production

Live From 2025 NBA All-Star Weekend: After 25 Years, TNT Sports Goes All-In on F...

15/02/2025

Live From 2025 NBA All-Star Weekend: After 25 Years, Turner Sports All-In on Final Production

Live From 2025 NBA All-Star Weekend: After 25 Years, Turner Sports All-In on Fin...

15/02/2025

Live From 2025 NBA All-Star Game Weekend: After 25 Years, Turner Sports All-In For Final Production

Live From 2025 NBA All-Star Game Weekend: After 25 Years, Turner Sports All-In F...

15/02/2025

NASCAR Driver Cam on Max Embraces Cloud-Based Workflow for 2025 Season

NASCAR Driver Cam on Max Embraces Cloud-Based Workflow for 2025 Season WBD Sports' Chris Brown says Mobii will be key in delivering signals from the track t...

14/02/2025

ESPN's College GameDay Pulls Double Duty With Back-to-Back Shows at Alabama on Saturday, South Carolina on Sunday

ESPN's College GameDay Pulls Double Duty With Back-to-Back Shows at Alabama ...

14/02/2025

2025 Daytona 500: FOX Sports Looks To Ride Super Bowl LIX Momentum Into NASCAR Season

2025 Daytona 500: FOX Sports Looks To Ride Super Bowl LIX Momentum Into NASCAR S...

14/02/2025

NBA All-Star: More Games, More Teams, More Music, More Sound From the Court

NBA All-Star: More Games, More Teams, More Music, More Sound From the Court Turner Sports' team will deploy familiar tech to capture all the audio By Dan D...

14/02/2025

LIV Golf Continues To Innovate With Drones, Data-Driven Graphics, and All-Access Features in Year 4

LIV Golf Continues To Innovate With Drones, Data-Driven Graphics, and All-Access...

14/02/2025

Stay Tuned to SVG for Live Coverage From NBA All-Star 2025 in San Francisco This Weekend

Stay Tuned to SVG for Live Coverage From NBA All-Star 2025 in San Francisco This...

14/02/2025

ESPN's College GameDay Pulls Double Duty With Back-to-Back Shows at Auburn on Saturday, South Carolina on Sunday

ESPN's College GameDay Pulls Double Duty With Back-to-Back Shows at Auburn o...

13/02/2025

FIA World Rally Championship: Bringing the New WRC Command Centre to Life With Tests at Rallye Monte-Carlo

Alarm bells: FIA World Rally Championship begins rolling out its Command Centre ...

13/02/2025

FIA World Rally Championship: From Hearing Private Conversations to Seeing Ghost Cars

Listening in: From hearing private conversations to seeing ghost cars, what FIA ...

13/02/2025

So Long, Secaucus: MLB Network To Move to New 207,000 Sq. Ft. Facility in Elmwood Park, NJ in 2028

So Long, Secaucus: MLB Network To Move to New 207,000 Sq. Ft. Facility in Elmwoo...

13/02/2025

DAZN Partners With TelevisaUnivision to Bring 18 Matches of FIFA Club World Cup 2025 to Spanish-language Linear Networks

DAZN Partners With TelevisaUnivision To Bring 18 Matches of FIFA Club World Cup ...

13/02/2025

Esports Production on a Budget: Creating High-Quality Broadcasts Without Breaking the Bank

Esports Production on a Budget: Creating High-Quality Broadcasts Without Breakin...

12/02/2025

Super Bowl LIX in Review: All of SVG's Onsite Coverage From New Orleans (ICYMI)

Super Bowl LIX in Review: All of SVG's Onsite Coverage From New Orleans (ICY...

12/02/2025

Game On: Inside the 5G Trials for Enhanced Sports Broadcasting for Fans by the ONE4HDD Consortium

Game on: Inside the 5G trials for enhanced sports broadcasting for fans by the O...

12/02/2025

NBC Universal Lays Out Programming Plans for 2026 Winter Olympics

NBC Universal Lays Out Programming Plans for 2026 Winter Olympics By Ken Kerschbaumer, Editorial Director Wednesday, February 12, 2025 - 12:01 pm Print Thi...

12/02/2025

Super Bowl LIX in Review: All of SVG's On-Site Coverage From New Orleans (ICYMI)

Super Bowl LIX in Review: All of SVG's On-Site Coverage From New Orleans (IC...

11/02/2025

SVG College Sports Media Awards 2025: Entry Window Now Open!

SVG College Sports Media Awards 2025: Entry Window Now Open! Deadline to enter the 17th-annual competition is April 9; ceremony hosted at SVG College Summit on ...

11/02/2025

Inside the Esports Control Room: A Conversation on the Latest Tech Powering the Biggest Events

Inside the Esports Control Room: A Conversation on the Latest Tech Powering the ...

11/02/2025

Turin 2025: EMG / Gravity Media Italy Supports FISU for Host Coverage of the Winter Universiade

Turin 2025: EMG / Gravity Media Italy supports FISU for host coverage of the Win...

11/02/2025

Nothin' But Net: NBA Celebrates a Slam Dunk at the Paris Games 2025 and Outlines the Evolution of its European Broadcast Strategy

Nothin' but net: NBA celebrates a slam dunk at the Paris Games 2025 and outl...

11/02/2025

Where Has Esports Been (and Where Is It Headed)? A Conversation With Industry Icon Wim Stocks

Where Has Esports Been (and Where Is It Headed)? A Conversation With Industry Ic...

11/02/2025

A Look Back at Super Bowl LIX: Behind the Scenes of the Production in New Orleans (Photo Gallery)

Behind the Scenes at Super Bowl LIX in New Orleans The dust has settled on Super...

11/02/2025

Jared Boshnack Takes Over as YES Network's EP and VP of Production; John Filippelli Shifts to Senior Advisor Role

Jared Boshnack Takes Over as YES Network's EP and VP of Production; John Fil...

11/02/2025

Super Bowl LIX is the Most-Watched Super Bowl of All Time as FOX Sports Nets 127.7 Million Viewers

Super Bowl LIX is the Most-Watched Super Bowl of All Time as FOX Sports Nets 127...

10/02/2025

Super Bowl LIX: Tubi Leads All Streaming Platforms in Least Lag Time, According to Phenix Report

Super Bowl LIX: Tubi Leads All Streaming Platforms in Least Lag Time, According ...

10/02/2025

Live From Super Bowl LIX: Sports Broadcasting Hall of Fame Camera Operator Don Cornelli Works Final Game of His Career

Live From Super Bowl LIX: Sports Broadcasting Hall of Fame Camera Operator Don C...

09/02/2025

Live From Super Bowl LIX: FOX Sports Highlights Celebrity Fashion With Production of Tubi Red Carpet Show in 1080p HDR

Live From Super Bowl LIX: FOX Sports Highlights Celebrity Fashion With Productio...

09/02/2025

Live From Super Bowl LIX: NEP Specialty Capture Adds Key Cameras for Game Broadcast; NEP Mobile Units Support NFL, Halftime Show, Others

Live From Super Bowl LIX: NEP Specialty Capture Adds Key Cameras for Game Broadc...

09/02/2025

Live From Super Bowl LIX: Augmented-Reality Graphics Play Starring Role in FOX Sports' Broadcast

Live From Super Bowl LIX: Augmented-Reality Graphics Play Starring Role in FOX S...

09/02/2025

Live From Super Bowl LIX: Telemundo Deportes Goes All Out in Miami for Spanish-Language Telecast of Sunday's Game, Citywide Studio Shows

Live From Super Bowl LIX: Telemundo Deportes Goes All Out in Miami for Spanish-L...

09/02/2025

Live From Super Bowl LIX: FOX Sports Highlights Celebrity Fashion With Production of Sunday's Tubi Red Carpet in 1080p HDR

Live From Super Bowl LIX: FOX Sports Highlights Celebrity Fashion With Productio...

09/02/2025

Live From Super Bowl LIX: Augmented Reality Graphics Play Starring Role in FOX Sports' Broadcast

Live From Super Bowl LIX: Augmented Reality Graphics Play Starring Role in FOX S...

09/02/2025

Live From Super Bowl LIX: NFL Tech Ops Rides Years of Experience for Biggest, Most Complex Broadcast of the Season

Live From Super Bowl LIX: NFL Tech Ops Rides Years of Experience for Biggest, Mo...

08/02/2025

Live From Super Bowl LIX: Inside the SkyCam and Sony Efforts To Make 4K 240-fps Imaging on SkyCam a Reality

Live From Super Bowl LIX: Inside the SkyCam and Sony Efforts To Make 4K 240-fps ...

08/02/2025

Live From Super Bowl LIX: Inside the 10,000-Sq.-Ft. Tech Center With FOX Sports VP, Field Ops and Engineering, Kevin Callahan

Live From Super Bowl LIX: Inside the 10,000-Sq.-Ft. Tech Center With FOX Sports ...

08/02/2025

Live From Super Bowl LIX: CMSI Uses the Big Game To Push Workflows Forward

Live From Super Bowl LIX: CMSI Uses the Big Game To Push Workflows Forward The company is providing edit support for pregame, Tubi Red Carpet Show By Ken Kersc...

08/02/2025

Live From Super Bowl LIX: Inside SkyCam and Sony's Efforts to Make 4K 240 fps Imaging on SkyCam a Reality

Live From Super Bowl LIX: Inside SkyCam and Sony's Efforts to Make 4K 240 fp...

08/02/2025

Live From Super Bowl LIX: FOX Sports Digital Leans on Vizrt's TriCaster Vizion for HRP-Style Productions in New Orleans

Live From Super Bowl LIX: FOX Sports Digital Leans on Vizrt's TriCaster Vizi...

08/02/2025

Live From Super Bowl LIX: ESPN Studio Ops Spreads Across Big Easy From Fulton Street Square to Radio Row

Live From Super Bowl LIX: ESPN Studio Ops Spreads Across Big Easy From Fulton St...

08/02/2025

Live From Super Bowl LIX: Verizon's Joe Russo on How 5G Can Get to the Next Level for Broadcasters, Fans

Live From Super Bowl LIX: Verizon's Joe Russo on How 5G Can Get to the Next ...

08/02/2025

Live From Super Bowl LIX: Inside the 10,000 sq. ft. Tech Center with Fox Sports VP, Field Ops and Engineering Kevin Callahan

Live From Super Bowl LIX: Inside the 10,000 sq. ft. Tech Center with Fox Sports ...

07/02/2025

Live From Super Bowl LIX: Fox Sports' Rod Conti on How Fox Sports Will Turn Bourbon Street into a Super Bowl Pre-Game Studio

Live From Super Bowl LIX: Fox Sports' Rod Conti on How Fox Sports Will Turn ...

07/02/2025

Live From Super Bowl LIX: FOX Sports Stuffs Graphics Package With Stats From Sportradar

Live From Super Bowl LIX: FOX Sports Stuffs Graphics Package With Stats From Spo...

07/02/2025

Live From Super Bowl LIX: FOX Plans Big Sound From Around the Big Easy

Live From Super Bowl LIX: FOX Plans Big Sound From Around the Big Easy Audio for pregame, studio shows will be produced from Bourbon Street and Caesars Superdom...