Sony Pixel Power calrec Sony

Berklee Faculty Lead the AI Conversation at AES Convention

26/10/2023

Berklee Faculty Lead the AI Conversation at AES Convention Berklee educators Michele Darling and Jonathan Wyner will participate in discussions on AI at the Audio Engineering Society convention this week in New York.

By

Daniel Pesquera

October 25, 2023

Michele Darling

The annual Audio Engineers Society (AES) convention in New York City takes place at the Javits Center from October 25 to 27, and Berklee will be driving the conversation around artificial intelligence. Michele Darling, chair of electronic production and design (EPD), and Jonathan Wyner, professor of music production and engineering (MP&E), are featured in two separate presentations on AI at the event.

Darling, named EPD chair this fall, will take part in a discussion on harnessing the power of AI for instrument design, with her EPD colleague Akito van Troyer joining her on the panel. Darling is involved in many AI-focused projects, developing audio plug-ins for music production and assisting researchers on how to teach a neural network to interpret sounds. Wyner will lead a town hall on AI audio technologies, with a goal to encourage an open exchange on AI and how the AES community can help producers, artists, and other technology users. Wyner, who founded the AES Technical Committee on Machine Learning and Artificial Intelligence, is also working with several groups to plan events at Berklee focused on AI in audio.

We spoke with Darling and Wyner ahead of the convention. This interview has been edited for clarity and length.

Professor Darling, what insights will you bring to the discussion on AI's role in the future of instrument design?MD: The panelists have been meeting and talking about the current practices in AI innovation while also speculating about its future. We are looking at how AI can assist with traditional instrument design as well as the potential for completely new AI instruments. We are asking ourselves What is an instrument?' and Are we considering an AI device an instrument? We want this discussion to be open-ended and forward-looking, and to incorporate different educational and ethical perspectives. It's going to take input from programmers, designers, creators, educators, philosophers, and anthropologists to make decisions about AI and its use in music and audio.

Jonathan Wyner

Professor Wyner, what would you like to see come out of the town hall discussion on AI?JW: The thing that really motivates me is having the opportunity to bring together developers and users. When we're looking at the rapid advancement of AI technologies, the question that emerges is What can our communities do on behalf of the stakeholders involved in creating audio? The town hall is intended to be a place to surface ideas and to begin defining the work and potential goals. If this leads to us discovering interesting things artists are doing with the technology, that's awesome!

What are your personal experiences with AI audio technologies?MD: I got started with AI using artificial assistance to make plug-ins for audio tech companies. You give the AI parameters, and it will provide different settings. It becomes a dialogue between the creator and the machine where AI provides options and the user finesses it to get the desired effect. As a freelance sound designer, I have been connecting with companies who are working on new AI products, apps, and plug-ins in order to help music producers with their creative process. The most recent consulting I did was for a research project around how to teach a neural network to listen and interpret sounds that it hears.

JW: I've worked with the audio tech company iZotope and spent time with researchers looking at machine learning in audio at the Centre for Digital Music in London. One of the most exciting things that the technology provides is deep insights to the creative user within the context of their work. A great example of this is a toolkit called Tonal Balance Control. It's a way of distilling thousands and thousands of recordings to see how the signals are distributed across the audio spectrum. If you look across 10,000 recordings and notice they follow a similar pattern, you can use this as a statistical model to measure it against your own recording. This is a way AI provides information that we would never have otherwise.

What are your thoughts on AI in the context of teaching and learning, and its implications for future generations of designers and producers?JW: My way of teaching with AI is to help students understand what it is and put it in the context of its utility. It's essential that students have an understanding of the powerful technologies available and how to use them. In our creative context, AI isn't meant to be used to produce a wholly finished result. If you think about something like large language models as a tool for generating prompts and stimulating ideas, that's interesting. But if you're using ChatGPT to write your entire paper for you, there are obvious problems with that. Ultimately, AI may modulate what we do. For example, I can see AI handling tasks such as writing commercial music for advertisements, but I don't think it will ever replace human abilities in the creative process.

MD: As we start to bring AI into the DAW [digital audio workstation], it's important that critical listening skills remain essential. If you are actively and thoughtfully evaluating the sounds that you hear, you will make better decisions when it comes to applying AI. The danger is that a user may accept AI results as being the best outcome, when in fact it may not be. Teaching students to have the ability and confidence to say, I see what the AI tool did, but I don't think it's quite good enough is paramount. In the classroom at Berklee, we might make something using AI and then talk about what it gav
LINK: https://www.berklee.edu/berklee-now/news/berklee-faculty-leading-the-a...
See more stories from berklee

More from Berklee

28/02/2024

Announcing the 2024 Issue of STAGES Magazine: Future Proof

Announcing the 2024 Issue of STAGES Magazine: Future Proof This issue takes a deep dive into how a Boston Conservatory education lays the foundation for futu...

28/02/2024

40 Years Later, Thriller's Grammy Sweep Still Resonates

40 Years Later, Thriller's Grammy Sweep Still Resonates Professors Lil John Roberts and Mimi Jones, part of the team leading the upcoming Michael Jackson ...

27/02/2024

The Rubin Brothers Bring Circus Spectacle to American Idol

The Rubin Brothers Bring Circus Spectacle to American Idol Berklee alum Colescott Rubin and his brother, current student A.J., rode unicycles and sang about lov...

24/02/2024

Berklee International Hip-Hop Symposium Spotlights Local Artists, Entrepreneurs

Berklee International Hip-Hop Symposium Spotlights Local Artists, Entrepreneurs SAMMUS, DJ Troy Frost, and DJ WhySham are among featured guest speakers for th...

22/02/2024

Berklee's Signature Series Celebrates Vibraphone Master, Composer, and Educator Joel Ross

Berklee's Signature Series Celebrates Vibraphone Master, Composer, and Educa...

17/02/2024

Boston Conservatory Dance Students Perform in New Music Video by Pop Artist Piao

Boston Conservatory Dance Students Perform in New Music Video by Pop Artist Piao The video for Neopet features choreography by commercial dance major Sofia ...

17/02/2024

Berklee Awards Fenway Neighborhood Improvement Grant to Five Organizations

Berklee Awards Fenway Neighborhood Improvement Grant to Five Organizations A total of $25,000 will be distributed amongst the Boston-based nonprofits. By Co...

14/02/2024

Cecil Adderley Named President-Elect of the National Association for Music Education

Cecil Adderley Named President-Elect of the National Association for Music Educa...

14/02/2024

Cecil Adderley Named President of the National Association for Music Education

Cecil Adderley Named President of the National Association for Music Education The chair of Berklee's Music Education Department will serve as NAfME's...

14/02/2024

Berklee's Signature Series Presents Great American Songbook: Night and Day-A Celebration of Tony Bennett & Lady Gaga

Berklee's Signature Series Presents Great American Songbook: Night and Day-A...

09/02/2024

Sounds of Black History at Symphony Hall

Sounds of Black History at Symphony Hall Boston Conservatory Orchestra will showcase works by Samuel Coleridge-Taylor, Margaret Bonds, Valerie Coleman, and ot...

09/02/2024

Berklee Valencia Alumni Recognized at the Grammy Awards

Berklee Valencia Alumni Recognized at the Grammy Awards Carla Patullo, Gracie Laboy, and MT Aditya Srinivasan took home awards on musics biggest night. Febr...

09/02/2024

Lee Berk Tribute Concert Honors Legacy of Music Education Pioneer and Former Berklee President

Lee Berk Tribute Concert Honors Legacy of Music Education Pioneer and Former Ber...

07/02/2024

Berklee Abu Dhabi Music Summit Aims to Empower Aspiring Artists

Berklee Abu Dhabi Music Summit Aims to Empower Aspiring Artists The third annual event will focus on essential music business principles that enable creatives...

06/02/2024

Boston Conservatory at Berklee's New Music Festival Highlights Original Student Works

Boston Conservatory at Berklee's New Music Festival Highlights Original Stud...

05/02/2024

Berklee Alumni and Faculty Win at the 2024 Grammy Awards

Berklee Alumni and Faculty Win at the 2024 Grammy Awards Laufey, Molly Tuttle & Golden Highway, Miguel Zen n, and Carla Patullo were among the winners of musi...

02/02/2024

Vimbayi Kaziboni Wins Prestigious Ditson Conductor's Award

Vimbayi Kaziboni Wins Prestigious Ditson Conductor's Award The Boston Conservatory faculty member joins a group of legendary conductors who have received th...

01/02/2024

Dancing with the Stars: Berklee Edition Puts the Fun in Fundraiser

Dancing with the Stars: Berklee Edition Puts the Fun in Fundraiser The annual dance competition exceeded fundraising goals, fully endowing a new Dance Divisio...

01/02/2024

Vimbayi Kaziboni Wins 2024 Alice M. Ditson Fund Conductor's Award

Vimbayi Kaziboni Wins 2024 Alice M. Ditson Fund Conductor's Award The Boston Conservatory faculty member joins a group of legendary conductors who have re...

31/01/2024

Berklee Receives $1.8 Million Donation to Fund Innovative Student Success Initiative

Berklee Receives $1.8 Million Donation to Fund Innovative Student Success Initia...

27/01/2024

Pop Culture Icon Cyndi Lauper Gives Keynote at Berklee NYC Career Expo

Pop Culture Icon Cyndi Lauper Gives Keynote at Berklee NYC Career Expo The entertainment legend was joined by performing arts industry leaders from Broadway t...

27/01/2024

Berklee and the Dominican Republic's Ministry of Culture Expand Partnership

Berklee and the Dominican Republic's Ministry of Culture Expand Partnership The two organizations signed a student credit transfer agreement in January 20...

26/01/2024

Berklee Welcomes Dani and Debora Gurgel Quarteto for Signature Series Concert

Berklee Welcomes Dani and Debora Gurgel Quarteto for Signature Series Concert The virtuosic foursome will visit the college for a weeklong residency, culminat...

24/01/2024

The Berklee Global Jazz Institute Hosts 15th Anniversary Concert

The Berklee Global Jazz Institute Hosts 15th Anniversary Concert The Signature Series event will commemorate the life and artistry of the late Wayne Shorter. ...

20/01/2024

Berklee Institute for Accessible Arts Education Announces Inclusive Teaching and Learning Capsule

Berklee Institute for Accessible Arts Education Announces Inclusive Teaching and...

19/01/2024

Carla Patullo Howls and Heals on Grammy-Nominated Ambient Album

Carla Patullo Howls and Heals on Grammy-Nominated Ambient Album On So She Howls, the film composer, songwriter, and alum guides listeners through a cycle of h...

17/01/2024

Berklee Alumni Win Emmy Awards for Weird: The Al Yankovic Story and Kung Fu Panda: The Dragon Knight

Berklee Alumni Win Emmy Awards for Weird: The Al Yankovic Story and Kung Fu Pand...

12/01/2024

Alums Make Big-Screen Debut in Musical Adaptation of Mean Girls

Alums Make Big-Screen Debut in Musical Adaptation of Mean Girls Francesca Castro and Matilde Heckler bring Band Freak energy to the cinematic version of Tina ...

11/01/2024

Boston Conservatory Orchestra Celebrates Black History Month

Boston Conservatory Orchestra Celebrates Black History Month This powerful performance, featuring Anita Hill reciting the words of Martin Luther King Jr., wil...

05/01/2024

Latin Grammy Cultural Foundation Announces 2024 Sebastin Yatra Scholarship

Latin Grammy Cultural Foundation Announces 2024 Sebasti n Yatra Scholarship A four-year scholarship providing up to $200,000 in financial aid towards a bachel...

22/12/2023

The Best Music of 2023 Was Made with Berklee Artists

The Best Music of 2023 Was Made with Berklee Artists Behind the mic, at the boards, or in the band, Berklee artists made some of the year's best music in ...

21/12/2023

Berklees Top News and Stories of 2023

Berklees Top News and Stories of 2023 From AI in the classroom to music licensing 101, 50 years of hip-hop to the next great American jam band, take a look at...

19/12/2023

Student Spotlight: Yamur Soydemir

Student Spotlight: Ya mur Soydemir The Berklee graduate student discusses her greatest inspirations, her love of ultimate frisbee, and the process of reworkin...

16/12/2023

Latin Grammy Cultural Foundation Announces 2024 Sebastin Yarta Scholarship

Latin Grammy Cultural Foundation Announces 2024 Sebasti n Yarta Scholarship A four-year scholarship providing up to $200,000 in financial aid towards a bachel...

15/12/2023

Berklee Professor Releases Heartfelt Hanukkah Song

Berklee Professor Releases Heartfelt Hanukkah Song Mike Sempert recently released Hold On to the Light, a catchy track with a sincere message about what it me...

14/12/2023

Olivia Soler Espinosa Brings Cuba's National Instrument to Berklee

Olivia Soler Espinosa Brings Cuba's National Instrument to Berklee The college's first woman tres player discusses the instrument's distinctive so...

13/12/2023

Berklee Presents 2024 Spring Signature Series

Berklee Presents 2024 Spring Signature Series The series will celebrate the Berklee Global Jazz Institute, as well as pay tribute to the music of Tony Bennett...

12/12/2023

Boston Conservatory at Berklee Announces Center Stage Performances for Spring 2024

Boston Conservatory at Berklee Announces Center Stage Performances for Spring 20...

12/12/2023

Berklee and Master Tour Announce Partnership

Berklee and Master Tour Announce Partnership Master Tour will equip up-and-coming tour professionals from the Berklee Popular Music Institute with its state-o...

11/12/2023

15 of the Best Cover Songs (and Why They Work)

15 of the Best Cover Songs (and Why They Work) From Fast Car to Ring of Fire, there's no formula to making a successful cover song. But the best cover...

11/12/2023

Everything Is Music to Instrument Inventor Akito van Troyer's Ears

Everything Is Music to Instrument Inventor Akito van Troyer's Ears The Berklee professors creations collapse boundaries between digital and physical instr...

09/12/2023

Why Some of Us Cant Stand Holiday Music

Why Some of Us Cant Stand Holiday Music Songwriting Professor Kat Reinhert shares some theories. Plus: listen to a playlist of winter songs that ditch the fes...

07/12/2023

Berklee Names Sean K. Skeete as Dean of Professional Performance Division

Berklee Names Sean K. Skeete as Dean of Professional Performance Division Skeete previously served as chair of the colleges Ensemble Department from 2018 to 2...

05/12/2023

Student Spotlight: Andrea Recalde

Student Spotlight: Andrea Recalde The vocalist from Quito, Ecuador, talks about songwriting across language barriers, taking inspiration from family, and redi...

02/12/2023

Berklee Artists Collaborate on Song for Grammy-Nominated Album

Berklee Artists Collaborate on Song for Grammy-Nominated Album Marianna Matyja and V ctor Badillo B.M. '22 contributed to Lupita Infante's Amor Como E...

01/12/2023

Terri Lyne Carrington Receives Luise Vosgerchian Teaching Award from Harvard

Terri Lyne Carrington Receives Luise Vosgerchian Teaching Award from Harvard Carrington was honored with the award at a ceremony from Harvard's Office for...

30/11/2023

Berklee to Partner with Music Managers Forum-US for Boston Summit

Berklee to Partner with Music Managers Forum-US for Boston Summit The inaugural event will provide a unique opportunity for artists and managers to connect wi...

29/11/2023

Beyonc, Taylor Swift, and the Soaring Popularity of Concert Films

Beyonc , Taylor Swift, and the Soaring Popularity of Concert Films Ralph Jaccodine of Berklee's Music Business/Management Department delves into the recen...

28/11/2023

Berklee Honors TuneCore CEO at Annual Music Business Lecture

Berklee Honors TuneCore CEO at Annual Music Business Lecture Andreea Gleeson was the featured guest at the 30th Annual James G. Zafris Distinguished Lecture S...

21/11/2023

For Elena Pinderhughes, Each New Release Is a Snapshot

For Elena Pinderhughes, Each New Release Is a Snapshot The sought-after vocalist and flutist, whose collaborator credits include esperanza spalding and Herbie...