Sony Pixel Power calrec Sony

Berklee Faculty Lead the AI Conversation at AES Convention

26/10/2023

Berklee Faculty Lead the AI Conversation at AES Convention Berklee educators Michele Darling and Jonathan Wyner will participate in discussions on AI at the Audio Engineering Society convention this week in New York.

By

Daniel Pesquera

October 25, 2023

Michele Darling

The annual Audio Engineers Society (AES) convention in New York City takes place at the Javits Center from October 25 to 27, and Berklee will be driving the conversation around artificial intelligence. Michele Darling, chair of electronic production and design (EPD), and Jonathan Wyner, professor of music production and engineering (MP&E), are featured in two separate presentations on AI at the event.

Darling, named EPD chair this fall, will take part in a discussion on harnessing the power of AI for instrument design, with her EPD colleague Akito van Troyer joining her on the panel. Darling is involved in many AI-focused projects, developing audio plug-ins for music production and assisting researchers on how to teach a neural network to interpret sounds. Wyner will lead a town hall on AI audio technologies, with a goal to encourage an open exchange on AI and how the AES community can help producers, artists, and other technology users. Wyner, who founded the AES Technical Committee on Machine Learning and Artificial Intelligence, is also working with several groups to plan events at Berklee focused on AI in audio.

We spoke with Darling and Wyner ahead of the convention. This interview has been edited for clarity and length.

Professor Darling, what insights will you bring to the discussion on AI's role in the future of instrument design?MD: The panelists have been meeting and talking about the current practices in AI innovation while also speculating about its future. We are looking at how AI can assist with traditional instrument design as well as the potential for completely new AI instruments. We are asking ourselves What is an instrument?' and Are we considering an AI device an instrument? We want this discussion to be open-ended and forward-looking, and to incorporate different educational and ethical perspectives. It's going to take input from programmers, designers, creators, educators, philosophers, and anthropologists to make decisions about AI and its use in music and audio.

Jonathan Wyner

Professor Wyner, what would you like to see come out of the town hall discussion on AI?JW: The thing that really motivates me is having the opportunity to bring together developers and users. When we're looking at the rapid advancement of AI technologies, the question that emerges is What can our communities do on behalf of the stakeholders involved in creating audio? The town hall is intended to be a place to surface ideas and to begin defining the work and potential goals. If this leads to us discovering interesting things artists are doing with the technology, that's awesome!

What are your personal experiences with AI audio technologies?MD: I got started with AI using artificial assistance to make plug-ins for audio tech companies. You give the AI parameters, and it will provide different settings. It becomes a dialogue between the creator and the machine where AI provides options and the user finesses it to get the desired effect. As a freelance sound designer, I have been connecting with companies who are working on new AI products, apps, and plug-ins in order to help music producers with their creative process. The most recent consulting I did was for a research project around how to teach a neural network to listen and interpret sounds that it hears.

JW: I've worked with the audio tech company iZotope and spent time with researchers looking at machine learning in audio at the Centre for Digital Music in London. One of the most exciting things that the technology provides is deep insights to the creative user within the context of their work. A great example of this is a toolkit called Tonal Balance Control. It's a way of distilling thousands and thousands of recordings to see how the signals are distributed across the audio spectrum. If you look across 10,000 recordings and notice they follow a similar pattern, you can use this as a statistical model to measure it against your own recording. This is a way AI provides information that we would never have otherwise.

What are your thoughts on AI in the context of teaching and learning, and its implications for future generations of designers and producers?JW: My way of teaching with AI is to help students understand what it is and put it in the context of its utility. It's essential that students have an understanding of the powerful technologies available and how to use them. In our creative context, AI isn't meant to be used to produce a wholly finished result. If you think about something like large language models as a tool for generating prompts and stimulating ideas, that's interesting. But if you're using ChatGPT to write your entire paper for you, there are obvious problems with that. Ultimately, AI may modulate what we do. For example, I can see AI handling tasks such as writing commercial music for advertisements, but I don't think it will ever replace human abilities in the creative process.

MD: As we start to bring AI into the DAW [digital audio workstation], it's important that critical listening skills remain essential. If you are actively and thoughtfully evaluating the sounds that you hear, you will make better decisions when it comes to applying AI. The danger is that a user may accept AI results as being the best outcome, when in fact it may not be. Teaching students to have the ability and confidence to say, I see what the AI tool did, but I don't think it's quite good enough is paramount. In the classroom at Berklee, we might make something using AI and then talk about what it gav
LINK: https://www.berklee.edu/berklee-now/news/berklee-faculty-leading-the-a...
See more stories from berklee

Most recent headlines

04/09/2025

Monumental Sports & Entertainment and Dalet Win Prestigious 2025 NAB Show Project of the Year Award

Monumental Sports & Entertainment (MSE), in collaboration with Dalet, has been a...

09/05/2025

Harvard Taps Studio Technologies for Sports Telecasts

CAMBRIDGE, Mass. Studio Technologies said the Harvard University athletics department has integrated Dante-enabled equipment from the vendor into its broadcast ...

09/05/2025

ITN, Magnite Launch Programmatic Solution for Local Linear TV

NEW YORK ITN, a provider of a local linear supply side platform, and Magnite, a independent sell-side advertising company, have announced that they working toge...

09/05/2025

Nugen Audio Unveils DialogCheck Speech Intelligibility Software

LEEDS, U.K. Nugen Audio has launched a new speech intelligibility plug-in, DialogCheck and offered up quotes from technologists working at places like Netflix p...

09/05/2025

AJA I/O Gear: The Heart of Broadcast Solutions' VEGO Mobile Editing Solution

AJA I/O Gear: The Heart of Broadcast Solutions' VEGO Mobile Editing Solution Brie Clayton May 8, 2025 0 Comments When working remotely on broadcas...

09/05/2025

What do they teach in an Advanced Adobe After Effects Course?

What do they teach in an Advanced Adobe After Effects Course? Roland Kahlenberg May 8, 2025 0 Comments There aren't many advanced After Effects co...

09/05/2025

Larry Jordan Sits with Trevor Morgan of OpenDrives at NAB 2025

Larry Jordan Sits with Trevor Morgan of OpenDrives at NAB 2025 Brie Clayton May 8, 2025 0 Comments Trevor Morgan, COO of OpenDrives, shares how the co...

09/05/2025

Berklee Popular Music Institute Announces UK Festival Debut and Tour Dates

Berklee Popular Music Institute Announces UK Festival Debut and Tour Dates For the first time, BPMI will bring Berklee-affiliated artists and students to the ...

08/05/2025

What to Watch: 6 Sundance Institute-Supported Films by Filipino Directors

A sinister fairy infiltrates a desperate family in Kenneth Dagatan's In My Mother's Skin, which premiered at the 2023 Sundance Film Festival. Photo co...

08/05/2025

Expected weak market dynamics weigh on business development in the first three months 2025

As expected, continued weak demand from key sales markets and declining economic...

08/05/2025

BBC announces Agatha Christie's Endless Night, adapted by Sarah Phelps

A new three-part series is coming to BBC iPlayer and BBC One (Image: The Christie Archive Trust) The BBC has announced Agatha Christie's Endless Night, a...

08/05/2025

Managing the Mission: Teaching Technique to C3ISR Operators

For skyward-bound operators, training focuses on the unique aspects of flying ISR missions, including the management of onboard surveillance equipment and the e...

08/05/2025

Cable Industry Backs Broadcasters' Move to Software-Based EAS

The cable industry has told the Federal Communications Commission it supports the National Association of Broadcasters' proposal to allow broadcasters to us...

08/05/2025

CTA Tells FCC: Dont Mandate ATSC 3.0 Tuners

WASHINGTON The Consumer Technology Association has continued its opposition to mandates requiring that NextGen TV/ATSC 3.0 tuners be included in new TV sets, sa...

08/05/2025

TAG Video Systems Appoints Paul Maroni as Vice President...

TAG Video Systems, the leader in software-based IP end-to-end workflow monitoring, deep probing, and real time visualization, has named Paul Maroni as Vice Pres...

08/05/2025

BroadcastAsia 2025 Showcases Best of British Innovation

This year's UK Pavilion in hall 5, once again managed by Tradefair, will provide visitors with the unique opportunity to discuss and be involved in cutting ...

08/05/2025

Rohde & Schwarz to highlight innovative broadcast technol...

Rohde & Schwarz will showcase its latest energy-efficient transmitters and 5G Broadcast technologies, designed to support network operators and content provider...

08/05/2025

Nexstar Appoints Bill Nardi VP of Station Operations

IRVING, Texas Nexstar Media Group has tapped Bill Nardi as vice president of station operations, responsible for overseeing the day-to-day broadcast operations ...

08/05/2025

LumaTouch Partners With CNN Academy on Training

SEATTLE LumaTouch is partnering with CNN Academy to improve mobile storytelling techniques and support training across all of CNN Academy's training simulat...

08/05/2025

SBE Backs NAB Proposals to Change EAS Rules

WASHINGTON The Society of Broadcast Engineers has filed comments with the Federal Communications Commission that support a proposal by the National Association ...

08/05/2025

OAN to Provide News to VOA, USAGM Networks

Senior adviser to the United States Agency for Global Media Kari Lake has announced that One America News Network (OAN) will provide newsfeed services for fre...

08/05/2025

EdMon Expands as AI-Driven Post Production Workflows Gains Traction in Sweden and Beyond

EdMon Expands as AI-Driven Post Production Workflows Gains Traction in Sweden an...

08/05/2025

Using Luma Mattes in Adobe Premiere Pro

Using Luma Mattes in Adobe Premiere Pro Graham Quince May 7, 2025 0 Comments This very quick tutorial shows you how to take an RGB clip and apply its ...

08/05/2025

OpenDrives Unveils Free Your Data' Initiative with New Astraeus Cloud-Native Data Services Platform

OpenDrives Unveils Free Your Data' Initiative with New Astraeus Cloud-Nativ...

08/05/2025

Student Spotlight: Grigori Balasanyan

Student Spotlight: Grigori Balasanyan The Armenian composer, who was named Boston Conservatory at Berklees 2025 student commencement speaker, talks about his ...

08/05/2025

VEON Shareholders Re-elect Board at 2025 AGM, Founder Augie Fabela to Serve as Chairman

08 May 2025 VEON Shareholders Re-elect Board at 2025 AGM, Founder Augie Fabela ...

08/05/2025

Will Mellor & Ralf Little return to U&Dave for more Will & Ralf Should Know Better

Comedy and entertainment channel U&Dave bring back their #1 ranked programme of ...

08/05/2025

Tribeca Festival 2025 Unveils New Premieres Spanning Film and Music

May 8th, 2025 Press Materials Available Here Tribeca Festival 2025 Unveils New Premieres Spanning Film and Music Slick Rick's Victory with Idris Elba a...

08/05/2025

Tribeca Festival 2025 Announces Lineup for Inaugural Storytelling Summit

May 8th, 2025 Press Materials Available Here Tribeca Festival 2025 Announces Lineup for Inaugural Storytelling Summit 11-Day Industry Event Launches with Tal...

08/05/2025

SVG Sit-Down: Vizrt's Nicholas Jameson on AI in Workflows, Pushing Boundaries With XR/AR

SVG Sit-Down: Vizrt's Nicholas Jameson on AI in Workflows, Pushing Boundarie...

08/05/2025

Creating Alternative Brand Experiences: Live Sports in the Age of Fortnite, Meta Horizon, and Beyond

Creating Alternative Brand Experiences: Live Sports in the Age of Fortnite, Meta...

08/05/2025

PGA TOUR's David Piccolo: Advanced Graphics and Virtual Production Tools are Elevating Live Golf Coverage

PGA TOUR's David Piccolo: Advanced Graphics and Virtual Production Tools are...

08/05/2025

Tech Focus: Advancing Immersion in Sports Broadcasting with AR and Virtual Production

Tech Focus: Advancing Immersion in Sports Broadcasting with AR and Virtual Produ...

08/05/2025

Now in Production: Comedy Action Film Husbands in Action' Puts Unlikely Allies on a Rescue Mission

Back to All News Now in Production: Comedy Action Film Husbands in Action'...

08/05/2025

TenneT Relies on Arvato Systems for Market Communications

TenneT relies on Arvato Systems for market communication Energy industry: Impressive market communication know-how and system integration expertise G tersloh...

08/05/2025

2025-05-08

When Taiki Hamamoto, 22, came across a Hanafuda deck at his local game shop, he was intrigued. He had grown up playing the traditional Japanese card game with f...

08/05/2025

Joe Duffy hangs up his mic on Liveline as he confirms Retirement from RT after 37 Years

The Liveline is now open , said Joe Duffy earlier today, as he previewed this af...

08/05/2025

RT reveals first look at comedy drama The Walsh Sisters, based on novels of Marian Keyes

RT , in association with the BBC, Screen Ireland and Cineflix Rights has reveale...

08/05/2025

Wildfire Prevention: AI Startups Support Prescribed Burns, Early Alerts

Artificial intelligence is helping identify and treat diseases faster with better results for humankind. Natural disasters like wildfires are next. Fires in th...

08/05/2025

Join the Family: GeForce NOW Welcomes 2K's Acclaimed Mafia' Franchise to the Cloud

Calling all wiseguys - 2K's acclaimed Mafia franchise is available to stream...

08/05/2025

LM Studio Accelerates LLM Performance With NVIDIA GeForce RTX GPUs and CUDA 12.8

As AI use cases continue to expand - from document summarization to custom software agents - developers and enthusiasts are seeking faster, more flexible ways t...

07/05/2025

Experience a New Dimension of Music Discovery With More Controls and Enhanced Tools

Discovering music should feel effortless and fun. That's why Spotify continu...

07/05/2025

SBS and NITV mark National Reconciliation Week with compelling premieres recognising the strength and resilience of First Nations peoples

SBS and NITV mark National Reconciliation Week with compelling premieres recogni...

07/05/2025

SBS commences search for a new Western Sydney production hub location

SBS commences search for a new Western Sydney production hub location 7 May, 2025 Media releases SBS has today launched a Request for Expressions of Intere...

07/05/2025

March 2025 Less Time Spent Watching Video

Warsaw, Poland - April 28, 2025 - Nielsen, a global leader in audience measurement, data and analytics, has released its latest March All Screens Video Landscap...

07/05/2025

Studios Delay Moving Films to Streaming to Protect Box Office

LONDON Movie fans hoping to save money by waiting until their favorite new films appear on streaming services will have to wait a bit longer now, according to a...

07/05/2025

Saudi Broadcasting Authority Turns to Grass Valley for Major Tech Upgrade

MECCA, Saudi Arabia Saudi Broadcasting Authority (SBA) has selected Grass Valley to provide a major technology upgrade of its broadcast facility here....

07/05/2025

Sony and Nevion provide guidance on IP network architecture options for live production in new whitepaper

Sony and Nevion provide guidance on IP network architecture options for live pro...