Artistry in the Algorithms: Music in the Age of AI
14/11/2023
By
Michael Blanding
November 13, 2023
A few months ago, Associate Professor Ben Camp, who teaches in Berklee's Songwriting Department, was working with a recent graduate on a tricky lyric for a new album. She wanted to convey the sense that she could create magic, and to urge listeners to get in touch with their own inner powers instead of being afraid of them, recalls Camp (they/them). And the context for this line was like the mood of the witches that open Macbeth. Later, Camp sent her a potential lyric: In the witching hour's hold / Do you hear the stories told? / Do you fear the magic yet to unfold?
I read it to her and she loved it, says Camp, who says she only changed one word- unfold to unfurl. Camp then revealed that they actually hadn't come up with the line-it was generated by ChatGPT, the large language model trained by artificial intelligence (AI). She was like, Oh my God, I hate you,' Camp says, chuckling.
The anecdote captures the ambivalence songwriters and musicians are feeling about artificial intelligence, says Camp, who has begun introducing ChatGPT and other AI tools into their classes. I've gotten everything from I need to go home and throw out my computer,' to It's okay, but it doesn't have the spirit and soul a human has,' to Thank you for making me use AI. I did a way better job than I would have without it.'
Associate Professor Ben Camp
Image by Kelly Davidson
As generative AI and machine learning get better and better at mimicking human creativity-and at making original music-the technologies have been greeted by musicians and music fans alike with mixed emotions, including a healthy dose of fear. This spring, when an anonymous composer released the song Heart on My Sleeve, claiming they used AI to generate passable versions of the voices of Drake and the Weeknd, the so-called Fake Drake alarmed musicians everywhere, who feared that their talents could simply be ripped off.
It was the second time in a matter of months that AI had crossed the line into what had been exclusively the territory of musicians and songwriters. In February, DJ David Guetta created a song using AI to generate lyrics along with the voice of Eminem. Getting ahead of the trend, in April Grimes gamely told creators they could freely use her voice in compositions without penalty. (That's easy enough when you're a multimillion-dollar artist who has children with the richest man in the world.) So far, such experiments seem little more than musical pranks. But as the technology continues to improve, it's quickly forcing musicians and songwriters, including Berklee faculty and alumni, to grapple with its implications.
These are still early days. But there are a number of startups right now in an arms race to productize AI technology for music that we'll start to see in six months to a year.
- Jonathan Bailey '08, former chief technology officer of iZotope
Democratizing or Dumbing Down? These are still early days, says Jonathan Bailey '08, former chief technology officer of iZotope, a company using machine learning in part to create software for recording, mixing, and mastering music. But there are a number of startups right now in an arms race to productize AI technology for music that we'll start to see in six months to a year. One of iZotope's big breakthroughs was using AI to remove background noise from an audio recording-a feat that is normally hard to do.
Separating out the speech content from noise is really difficult, but it's actually a pretty easy problem to solve using deep learning, Bailey says. The same principles that can label sounds as speech or noise are now being applied to identify drums, guitars, and other instruments-and will eventually be able to generate those sounds, Bailey says.
If you're a singer-songwriter, you can record your voice and guitar in your bedroom and then automatically enhance the quality to sound like you recorded it in a professional studio. Then what if you could add a bass track and drums to that? Right now, it seems in the realm of fantasy, but this could become more and more possible.
In a sense, such technologies are an extension of the democratization of music recording, continuing the trend of software such as GarageBand or Autotune that have made advanced tools more accessible to amateur musicians. It used to cost a million dollars to create an album, then $10,000, and now $1,000, Bailey says. To me, generative AI is just a point on that curve, the next evolution of enabling more people to be creative.
That democratizing trend in AI doesn't bother Mark Simos, an assistant professor in Berklee's Songwriting Department. It's part of a whole progression of technologies to help nonskilled musicians to be able to write songs, he says. That's not likely to fundamentally change the nature of the industry. On the other hand, he does see a danger in professional musicians using AI to generate songs out of whole cloth.
Assistant Professor Mark Simos
Image by Louise Bichan
Decades ago, Simos worked in software with expert systems, a precursor to AI. More recently, he's judged several AI songwriting contests, and has noticed a disturbing trend of musicians using AI as a shortcut to creativity. When you ask ChatGPT to spit out a song on a certain topic in a certain study, that's not how real songwriting works, Simos says. Much of real songwriting is nonlinear; it's not just reaching into some oracular space in your head and out pops the song.
What AI can't replicate-at least not yet-is the combination of music and lyrics that make
LINK: | https://www.berklee.edu/berklee-now/news/artistry-in-the-algorithms... |
See more stories from berklee |
Most recent headlines
04/08/2024
Dalet Appoints Santiago Solanas as CEO to Lead Next Era of Growth and Innovation
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet and Veritone Reach Agreement to Distribute, Transact and Monetize Media Archives
Dalet, a leading technology and service provider for media-rich organizations, a...
19/05/2024
TV Techs Weekly Product Wrap-Up
Missed any of our product coverage during your busy week? The TV Tech weekly product and services news wrap-up provides links to all of our coverage from May 13...
19/05/2024
The CW Shares Its 2024-2025 Lineup
LeVar Burton will host the new game show Trivial Pursuit on The CW, while Raven-Symon will host Scrabble....
19/05/2024
Biden, Trump Agree to Debates on CNN, ABC
President Joe Biden and former President Donald Trump have agreed to debates, set for June 27 on CNN and September 10 on ABC....
19/05/2024
End of the Line for Young Sheldon' on May 16
Young Sheldon signs off after seven seasons on CBS, when the series finale airs Thursday, May 18. Jim Parsons and Mayim Bialik reprise their roles as Sheldon Co...
18/05/2024
If Bundling Is Back, What's the Ideal Bundle?
PORTSMOUTH, N.H. Bundling is back in a big way, with all the major streaming companies and many pay TV operators exploring ways to simplify the consumer experie...
18/05/2024
FCC to Vote on LPTV Rules during June Open Meeting
WASHINGTON, D.C. Federal Communications Commission Chairwoman Jessica Rosenworcel has announced a tentative agenda for the June Open Commission Meeting schedule...
18/05/2024
Matthews Launches New Multipurpose Grip Rail Telescopic Grid Pipe Solution
Matthews Studio Equipment has introduced Grip Rail, which the company said offers a better way to mount equipment on location, in the studio, or on the fly....
18/05/2024
IAB Tech Labs, Google Partner on New First Party Data Solution
In a notable development in the industry-wide effort to address privacy concerns while improving efficacy of marketing efforts in a cookieless ad landscape, IAB...
18/05/2024
TV Tech Weekly Product Wrap-Up
Missed any of our product coverage during your busy week? The TV Tech weekly product and services news wrap-up provides links to all of our coverage from May 13...
18/05/2024
DHD Elevates the Art of Podcast Production
DHD Elevates the Art of Podcast Production Brie Clayton May 17, 2024 0 Comments Hero image: the DHD DX2 base and expansion modules Latest-generation ...
17/05/2024
Aerojet Rocketdyne's Camden Site Leverages Modernization Investments to Accelerate Solid Rocket Motor Production
Aerojet Rocketdyne has worked to modernize facilities at its Camden, Arkansas, l...
17/05/2024
FCC Plans to Revise LPTV Rules
The FCC has issued a Notice of Proposed Rulemaking (NPRM) that would revise rules governing low power TV stations (LPTV) in a number of areas, including online ...
17/05/2024
Demystifying Post-Production: Introducing Cinema 4D Particles Week 4
Demystifying Post-Production: Introducing Cinema 4D Particles Week 4 Brie Clayton May 17, 2024 0 Comments With the spring release of Maxon One, we...
17/05/2024
Takashi Yamazaki Film Godzilla Minus One Graded with DaVinci Resolve Studio
Takashi Yamazaki Film Godzilla Minus One Graded with DaVinci Resolve Studio Brie Clayton May 17, 2024 0 Comments Hero image credit: 2023 TOHO CO., LT...
17/05/2024
Sterling Event Group Streamlines Live Event Productions with AJA
Sterling Event Group Streamlines Live Event Productions with AJA Brie Clayton May 17, 2024 0 Comments Live event productions only happen once, which ...
17/05/2024
Meet the product manager
Muster Ngobi, product manager at LYNX Technik tells TVBEurope how the ever-evolving media industry provides a truly dynamic working environment By Matthew Corr...
17/05/2024
TV, Streaming Schedule for 2024 NFL Regular Season Is Released
NEW YORK As declines in linear TV viewing make the ongoing popularity of live sports, particularly football, central to financial success of the TV industry, th...
17/05/2024
Netflix Ad Tier Hits 40M Monthly Active Users
During Netflixs second Upfront presentation to advertisers, Amy Reinhard, Netflix's president of advertising, walked advertisers through the continued growt...
17/05/2024
Scripps Promotes Jeff Kiernan to VP, Local News
CINCINNATI The E.W. Scripps Company has added to its leadership team for news by promoting Jeff Kiernan a veteran journalist and general manager of Scripps'...
17/05/2024
Survey: New Disney-Fox-WBD Sports Streamer May Hurt Pay TV Sub Counts
Top executives from Disney, Fox and Warner Bros. Discovery have consistently insisted that their joint venture to launch the Venu Sports streaming bundle in the...
17/05/2024
Caitlin Clark's WNBA Debut Set Viewing Records
ESPN has announced that its coverage of Caitlin Clark's WNBA debut in the Indiana Fever versus the Connecticut Sun season opener was the most-watched WNBA g...
17/05/2024
ATEM Mini Extreme ISO switcher and Blackmagic Pocket Cinema Camera 4K
ATEM Mini Extreme ISO switcher and Blackmagic Pocket Cinema Camera 4K Brie Clayton May 16, 2024 0 Comments Blackmagic Design announced today that Yoic...
17/05/2024
Pixomondo's Virtual Production Academy Expands with Programs at Sony PCL, Vook, and Vancouver Film School
Pixomondo's Virtual Production Academy Expands with Programs at Sony PCL, Vo...
17/05/2024
WBD Upfront Show Offers Peeks at House of the Dragon,' White Lotus,' Biden-Trump Debate
The Warner Bros. Discovery upfront presentation took place Wednesday, May 15 at ...
17/05/2024
The Black Keys, Jelly Roll, Kate Hudson Set To Perform on The Voice' Finale
Season 25 of The Voice wraps on NBC Tuesday, May 21, with performances from The Black Keys, Jelly Roll, Kate Hudson, Lainey Wilson, Muni Long, Thomas Rhett and ...
17/05/2024
CNN Boss Mark Thompson's Plan Includes More News in More Categories on More Devices (Upfronts)
New CNN CEO Mark Thompson spelled out his plan for the struggling news network d...
17/05/2024
Netflix To Launch In-House Advertising Tech Platform
Netflix, a newcomer to the advertising business, said it plans to launch an in-house advertising technology platform....
17/05/2024
Netflix Plots TV Takeover at Upfront Presentation
Netflix shared some programming projects at an upfront presentation in New York. Those include the basketball-themed comedy series Running Point, a Mindy Kaling...
17/05/2024
Plex Geek Week Sale Offers 20% Off Plex Lifetime Pass
Plex is offering movie and music collectors a 20% discount off its Lifetime Plex Pass as part of its Geek Week sale....
17/05/2024
GroupM Names Toby Jenner as President, GroupM Clients
Giant media buyer GroupM said it named Toby Jenner as global president, Group M Clients, a new position at the company....
17/05/2024
Clients of Independent Agencies Boost Programmatic Buying
Smaller advertisers are increasingly buying connected TV programmatically, according to a new report from FreeWheel, Comcast's ad-tech unit....
17/05/2024
TCLtvPlus Adds Streaming Music Channels From Vevo
TCLtvPlus, the streaming app on smart TVs made by TCL, has added live linear channel from music-video programmer Vevo....
17/05/2024
StackAdapt Adopts Data From Samba TV for Programmatic Campaigns
StackAdapt said it made a deal to integrate data from Samba TV into its programmatic advertising platform....
17/05/2024
Tonight on Skeem Saam: Lehasa gets a rude awakening when Kgosi blackmails him
Tonight on Skeem Saam: Lehasa gets a rude awakening when Kgosi blackmails himDon't miss Friday, 17 May's riveting episode of South African soapie Skeem ...
17/05/2024
Tonight on House of Zwide: Dorothy is blown away by Ona's sketches for her wedding dress
Tonight on House of Zwide: Dorothy is blown away by Ona's sketches for her w...
17/05/2024
Tonight on Scandal: Dintle has a visit from her past that leaves her very unsettled
Tonight on Scandal: Dintle has a visit from her past that leaves her very unsett...
17/05/2024
Save Time and Money with WO Traffic v24.0
WO Traffic provides a solid foundation from which stations can manage, execute, and scale end-to-end ad trafficking and sales, both today and into the future. W...
17/05/2024
Broadcast Innovation in India: How AI and Automated Production Helps Smaller Sports Grow
Broadcast Innovation in India: How AI and Automated Production Helps Smaller Spo...
17/05/2024
SVG Sports Cloud Production Forum Gives Refresher Course on Cloud-Based Tools, Ecosystem
SVG Sports Cloud Production Forum Gives Refresher Course on Cloud-Based Tools, E...
17/05/2024
WNBA Tip-Off 2024: Scripps Sports Constructs New Studio for Second Season of WNBA Friday Night Spotlight on ION
WNBA Tip-Off 2024: Scripps Sports Constructs New Studio for Second Season of WNB...
17/05/2024
SVG College Summit 2024: Auburn's War Eagle Productions Breaks Down How They Produce Live Gymnastics Broadcasts
SVG College Summit 2024: Auburn's War Eagle Productions Breaks Down How They...
17/05/2024
Netflix & Shondaland Announce the Song List and Soundtrack for 'Bridgerton' Season 3: Part 1
Back to All News Netflix & Shondaland Announce the Song List and Soundtrack for...
17/05/2024
Skeem Saam: Thursday's episode, 16 May 2024 [video]
Skeem Saam: Thursday's episode, 16 May 2024 [video]Missed an episode of Skeem Saam? No problem! Watch the latest episode of your favourite South African soa...
17/05/2024
Prison Journalism: Letter to my mothers
Prison Journalism: Letter to my mothersThabo Mthembu was incarcerated in Pollsmoor Prison from 2014 to 2019. Read Thabo's story by Thabo Mthembu 17-05-20...
17/05/2024
Paul McCartney becomes UK's first billionaire musician
Paul McCartney becomes UK's first billionaire musicianMusic icon Paul McCartney has become the UK's first billionaire musician, according to the Sunday ...
17/05/2024
Tonight on Smoke and Mirrors: Sakhile advises Tiny against sabotaging Petunia
Tonight on Smoke and Mirrors: Sakhile advises Tiny against sabotaging PetuniaDon't miss Friday, 17 May's riveting episode of South African soapie Smoke ...
17/05/2024
RT'S Operation Transformation comes to a close after 17 seasons
RT has today announced that Operation Transformation (OT) is to end after 17 seasons. As series come to an end each year, RT undertakes an editorial review to...
17/05/2024
Studio One: Your Binaural Beats Lab
By Craig Anderton When I heard about binaural beats, I was interested-I like beats, and I'm into binaural audio. But this has nothing to do with either o...