Sony Pixel Power calrec Sony

Berklee Faculty Lead the AI Conversation at AES Convention

26/10/2023

Berklee Faculty Lead the AI Conversation at AES Convention Berklee educators Michele Darling and Jonathan Wyner will participate in discussions on AI at the Audio Engineering Society convention this week in New York.

By

Daniel Pesquera

October 25, 2023

Michele Darling

The annual Audio Engineers Society (AES) convention in New York City takes place at the Javits Center from October 25 to 27, and Berklee will be driving the conversation around artificial intelligence. Michele Darling, chair of electronic production and design (EPD), and Jonathan Wyner, professor of music production and engineering (MP&E), are featured in two separate presentations on AI at the event.

Darling, named EPD chair this fall, will take part in a discussion on harnessing the power of AI for instrument design, with her EPD colleague Akito van Troyer joining her on the panel. Darling is involved in many AI-focused projects, developing audio plug-ins for music production and assisting researchers on how to teach a neural network to interpret sounds. Wyner will lead a town hall on AI audio technologies, with a goal to encourage an open exchange on AI and how the AES community can help producers, artists, and other technology users. Wyner, who founded the AES Technical Committee on Machine Learning and Artificial Intelligence, is also working with several groups to plan events at Berklee focused on AI in audio.

We spoke with Darling and Wyner ahead of the convention. This interview has been edited for clarity and length.

Professor Darling, what insights will you bring to the discussion on AI's role in the future of instrument design?MD: The panelists have been meeting and talking about the current practices in AI innovation while also speculating about its future. We are looking at how AI can assist with traditional instrument design as well as the potential for completely new AI instruments. We are asking ourselves What is an instrument?' and Are we considering an AI device an instrument? We want this discussion to be open-ended and forward-looking, and to incorporate different educational and ethical perspectives. It's going to take input from programmers, designers, creators, educators, philosophers, and anthropologists to make decisions about AI and its use in music and audio.

Jonathan Wyner

Professor Wyner, what would you like to see come out of the town hall discussion on AI?JW: The thing that really motivates me is having the opportunity to bring together developers and users. When we're looking at the rapid advancement of AI technologies, the question that emerges is What can our communities do on behalf of the stakeholders involved in creating audio? The town hall is intended to be a place to surface ideas and to begin defining the work and potential goals. If this leads to us discovering interesting things artists are doing with the technology, that's awesome!

What are your personal experiences with AI audio technologies?MD: I got started with AI using artificial assistance to make plug-ins for audio tech companies. You give the AI parameters, and it will provide different settings. It becomes a dialogue between the creator and the machine where AI provides options and the user finesses it to get the desired effect. As a freelance sound designer, I have been connecting with companies who are working on new AI products, apps, and plug-ins in order to help music producers with their creative process. The most recent consulting I did was for a research project around how to teach a neural network to listen and interpret sounds that it hears.

JW: I've worked with the audio tech company iZotope and spent time with researchers looking at machine learning in audio at the Centre for Digital Music in London. One of the most exciting things that the technology provides is deep insights to the creative user within the context of their work. A great example of this is a toolkit called Tonal Balance Control. It's a way of distilling thousands and thousands of recordings to see how the signals are distributed across the audio spectrum. If you look across 10,000 recordings and notice they follow a similar pattern, you can use this as a statistical model to measure it against your own recording. This is a way AI provides information that we would never have otherwise.

What are your thoughts on AI in the context of teaching and learning, and its implications for future generations of designers and producers?JW: My way of teaching with AI is to help students understand what it is and put it in the context of its utility. It's essential that students have an understanding of the powerful technologies available and how to use them. In our creative context, AI isn't meant to be used to produce a wholly finished result. If you think about something like large language models as a tool for generating prompts and stimulating ideas, that's interesting. But if you're using ChatGPT to write your entire paper for you, there are obvious problems with that. Ultimately, AI may modulate what we do. For example, I can see AI handling tasks such as writing commercial music for advertisements, but I don't think it will ever replace human abilities in the creative process.

MD: As we start to bring AI into the DAW [digital audio workstation], it's important that critical listening skills remain essential. If you are actively and thoughtfully evaluating the sounds that you hear, you will make better decisions when it comes to applying AI. The danger is that a user may accept AI results as being the best outcome, when in fact it may not be. Teaching students to have the ability and confidence to say, I see what the AI tool did, but I don't think it's quite good enough is paramount. In the classroom at Berklee, we might make something using AI and then talk about what it gav
LINK: https://www.berklee.edu/berklee-now/news/berklee-faculty-leading-the-a...
See more stories from berklee

Most recent headlines

06/10/2025

France Tlvisions Wins Prestigious 2025 EBU Technology & Innovation Award in Groundbreaking Collaboration with Dalet

France T l visions, France's leading broadcaster, has received the 2025 EBU ...

04/09/2025

Monumental Sports & Entertainment and Dalet Win Prestigious 2025 NAB Show Project of the Year Award

Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...

07/08/2025

Tata Motors & Dolby Bring Dolby Atmos to Harrier.ev, Redefining In-Car Entertainment Experience

July 8 2025, 22:30 (PDT) Tata Motors & Dolby Bring Dolby Atmos to Harrier.ev, R...

12/07/2025

TV Station Groups Launch Texas Flood Relief Efforts

As the death toll continues to mount, with at least 120 killed and more than 170 people still missing on July 10 from devastating Texas floods, a number of broa...

12/07/2025

DirecTV Adds ViX Premium With Ads to MiEspaol Genre Pack

EL SEGUNDO, Calif., and MIAMI -DirecTV and TelevisaUnivision have signed a deal that will make the ad-supported premium subscription tier of ViX, ViX Premium wi...

11/07/2025

2025 Sundance Institute Producers Lab Fellows Announced

PARK CITY, UTAH, July 11, 2025 - The nonprofit Sundance Institute announced today the 11 producers chosen for its annual Producers Labs, returning to Ucross Fou...

11/07/2025

Superman' Filmmaker James Gunn Reveals the Playlists Inspired by Your Favorite Characters

If you've ever wondered what might be playing in Clark Kent's headphones...

11/07/2025

L3Harris Delivers First P-8A Poseidon Aircraft to US Navy

L3Harris Technologies President of Intelligence, Surveillance and Reconnaissance Jason Lambert and General Manager of L3Harris Waco facility Sean Ling held a ce...

11/07/2025

WETA Launches WETA+ Free Streaming Service

ARLINGTON, Va. WETA, the flagship public media station in the national capital area, has launched WETA+, a new streaming service tailored for the local Washingt...

11/07/2025

TV Tech's Top Regulatory Stories of 2025

The Federal Communications Commission has emerged as one of the central players in the broadcast TV landscape in 2025, with its deregulatory policies sparking h...

11/07/2025

Calrec to Feature Suite of Interconnected Audio Solutions at IBC2025

Calrec will introduce usability, customization and system enhancements across its entire range of Argo consoles during IBC2025, Sept. 12-15, at the RAI Amsterda...

11/07/2025

Encompass Supports DAZN's Coverage of 2025 FIFA Club World Cup

LONDON Encompass Digital Media said it will support live and on-demand viewing of the 2025 FIFA Club World Cup across multiple global regions for sports enterta...

11/07/2025

SBE Survey: Certified Broadcast Engineers Earn More

Two-thirds of broadcast engineers reaped the benefits of a pay raise within the last year....

11/07/2025

SmallHD Unveils Quantum 27 OLED Monitor

CARY, N.C. SmallHD has launched the Quantum 27, a new 26.5-inch Quantum-Dot OLED monitor designed to deliver postproduction image quality in a compact, set-frie...

11/07/2025

Tegna Will Pay $225K to Settle FCC Investigation

The Federal Communications Commission's Enforcement Bureau and Tegna have entered into a consent decree that will settle an investigation into the accidenta...

11/07/2025

Sens. Markey, Lujn Again Call for FCC Vote on Paramount-Skydance Merger

WASHINGTON Following news in early July that Paramount had settled President Donald Trump's lawsuit, Sens. Edward J. Markey (D-Mass.) and Ben Ray Luj n (D-N...

11/07/2025

Model/Actriz Performs Lead Single Cinderella on The Late Show with Stephen Colbert

Model/Actriz Performs Lead Single Cinderella on The Late Show with Stephen Colbe...

11/07/2025

Behind the Mic: Amazon Prime Preps for First Season of NBA Action; MSG Networks Adjusts Broadcast Booths for Rangers, Devils

Behind the Mic: Amazon Prime Preps for First Season of NBA Action; MSG Networks ...

11/07/2025

SVG New Sponsor Spotlight: Suite Studios' Craig Hering on Adapting to Clients' Needs With Scalable Cloud-Based Storage

SVG New Sponsor Spotlight: Suite Studios' Craig Hering on Adapting to Client...

11/07/2025

2025 SVG Content Management Forum Breaks Down AI's Impact, Continued Transition to the Cloud

2025 SVG Content Management Forum Breaks Down AI's Impact, Continued Transit...

11/07/2025

A Journey HOME: University of Nebraska's HuskerVision Goes IP

A Journey HOME: University of Nebraska's HuskerVision Goes IP Leaders from the HuskerVision and Lawo share their IP learnings By SVG Staff Friday, July 1...

11/07/2025

CMSI, Remote Picture Labs, Ace ESPN's Cloud-Based Editing Efforts for Wimbledon

CMSI, Remote Picture Labs, Ace ESPN's Cloud-Based Editing Efforts for Wimble...

11/07/2025

Netflix Enters the Live-Boxing-Production Ring for Round 2 With Historic Taylor-Serrano 3 Card at MSG

Netflix Enters the Live-Boxing-Production Ring for Round 2 With Historic Taylor-...

11/07/2025

'Too Hot to Handle: Italy' Is Coming on July 18 Only on Netflix

Back to All News Too Hot to Handle: Italy Is Coming on July 18 Only on Netflix Entertainment 11 July 2025 GlobalItaly Link copied to clipboard July 11, 20...

11/07/2025

Netflix Will Release 'Death Inc.' Seasons 1, 2 and 3

Back to All News Netflix Will Release Death Inc. Seasons 1, 2 and 3 Entertainment 11 July 2025 GlobalSpain Link copied to clipboard Season 1 Season 2 Se...

11/07/2025

AI and Multimedia Authenticity Standards Collaboration

AI and Multimedia Authenticity Standards Collaboration launches two papers to guide the future of AI integration, today at the AI for Good Global Summit The...

11/07/2025

A Gaming GPU Helps Crack the Code on a Thousand-Year Cultural Conversation

Ceramics - the humble mix of earth, fire and artistry - have been part of a global conversation for millennia. From Tang Dynasty trade routes to Renaissance pa...

10/07/2025

Taliban repression silences award-winning Afghan woman journalist

The current holder of the prestigious Thomson Foundation Young Journalist of the Year Award has been forced to stop reporting over fears for her safety in Afgha...

10/07/2025

A New Report Puts Aussie Artists in the Spotlight

Spotify is turning up the volume on Australian music with a multipronged initiative designed to highlight the dominance of Australian artists on the global stag...

10/07/2025

Spotify Toasts Oasis's Return With Exclusive Ways for Fans to Get Closer to the Music That Defined a Generation

This is not a drill: Oasis is back on the road-marking its first live performanc...

10/07/2025

Spotify and Youth Music Open Doors for Future Artists

The music industry depends on fresh ideas, bold voices, and emerging talent. Yet across the U.K., too many young musicians lack the space to develop their craft...

10/07/2025

Nielsen Appoints Richard Pacheco as Head of Global Partnerships

NEW YORK - July 10, 2025 - Nielsen, the global leader in audience measurement, data and analytics, today announced that it appointed Richard Pacheco as head of ...

10/07/2025

Sponsored: Robotic Deployments Are Transforming Local News

Local newscasts don't exist in a vacuum. News directors and station management constantly evaluate what's working, what isn't and perhaps most impor...

10/07/2025

Stuttgart Media University Upgrades Studio with Lawo mc56

Lawo has announced that Stuttgart Media University (Hochschule der Medien, HdM) has comprehensively modernized its central recording studio after selecting an I...

10/07/2025

SMPTE Opens Early Bird Registration for Media Technology Summit

The Society of Motion Picture and Television Engineers (SMPTE) has opened early-bird registration for the Media Technology Summit, which will take place in a ne...

10/07/2025

TNDV Television Launches Aspiration 35 to Support Cinematic Workflows

NASHVILLE, Tenn. TNDV Television has launched Aspiration 35, a new version of its 40-foot Aspiration truck reimagined for cinematic multicamera productions....

10/07/2025

Key Code Education Launches Beginner, Intermediate Training Courses

BURBANK, Calif. Key Code Education, a provider of instructor-led postproduction training, is growing its curriculum with new programs for beginner and intermedi...

10/07/2025

Actus Digital to Show Actus X Intelligent Monitoring With AI at IBC2025

HACKENSACK, N.J. Actus Digital will demonstrate how broadcasters can transform compliance monitoring from a necessary expense into a strategic revenue driver at...

10/07/2025

Comments on FCC Ownership Rules Due in August

The Federal Register has published a summary of the Federal Communications Commission's Public Notice seeking comments on its ownership rules that lists a d...

10/07/2025

Netflix Presents the Official Trailer for 'Superestar'

Back to All News Netflix Presents the Official Trailer for SuperestarPlay Video Play Video Entertainment 10 July 2025 GlobalSpain Link copied to clipboard...

10/07/2025

From Terabytes to Turnkey: AI-Powered Climate Models Go Mainstream

In the race to understand our planet's changing climate, speed and accuracy are everything. But today's most widely used climate simulators often strugg...

10/07/2025

Indonesia on Track to Achieve Sovereign AI Goals With NVIDIA, Cisco and IOH

As one of the world's largest emerging markets, Indonesia is making strides toward its Golden 2045 Vision - an initiative tapping digital technologies and...

10/07/2025

VEON and Cohen Circle Secure Investor Commitments for Kyivstar Listing

10 Jul 2025 VEON and Cohen Circle Secure Investor Commitments for Kyivstar Listing Kyiv, New York, Dubai, and Philadelphia - July 10, 2025 - VEON Ltd. (Nasdaq:...

10/07/2025

5G for All? What the DFL's Use of Easy5G, RefCam Could Mean for Events in the Future

5G for all? What the DFL's use of Easy5G and RefCam could mean for events in...

10/07/2025

Save the Date: PGA TOUR Studios Welcomes SVG Remote Production Summit on Oct 14-15

Save the Date: PGA TOUR Studios Welcomes SVG Remote Production Summit on Oct 14-...

10/07/2025

Cloud on the Road: How Remote-Production-Service Providers Are Adapting to a New Era

Cloud on the Road: How Remote-Production-Service Providers Are Adapting to a New...

10/07/2025

Seattle Kraken's Ryan Schaber on the NHL Team Taking Live Game Productions In-House

Seattle Kraken's Ryan Schaber on the NHL Team Taking Live Game Productions I...

10/07/2025

FOX Sports Reboots Small Control Room in Los Angeles as Hub for Vertical-First Production

FOX Sports Reboots Small Control Room in Los Angeles as Hub for Vertical-First P...

10/07/2025

SVG Sit-Down: MSE's Zach Leonsis, ViewLift's Rick Allen Go Deep on Joint Venture Targeting Local-Sports-Media Market

SVG Sit-Down: MSE's Zach Leonsis, ViewLift's Rick Allen Go Deep on Joint...