Growing up in the Nile delta, Ahmed Elgammal dreamed of becoming an archaeologist or art historian. He never imagined he'd wind up in a concert hall in Bonn listening to the premier of Beethoven's Tenth, a symphony he helped finish with AI.
As a boy in Alexandria, I had a passion for art, but I was good at math. When it came time to pick a major in college, people said if I chose a career in art I'd have no money, so I went into computer science, said Elgammal, now a professor at Rutgers and head of its Art and Artificial Intelligence Laboratory.
I never gave up my passion for art, he said, noting his two-year-old startup, Playform, has already helped 25,000 visual artists wade into deep learning.
Getting a Classical Call About 15 years into his work in computer vision, Elgammal founded the Rutgers lab at the nexus of AI and art.
I've had the privilege to work on some amazing research over the last 10 years doing what I really like - working with art historians, artists and musicians, he said.
Hearing of Elgammal's work, the director of a music technology institute in Salzburg asked him in early 2019 to help complete two movements of Beethoven's Tenth, also known as his Unfinished Symphony, for a celebration of the composer's 250th birthday.
AI Hears a Symphony The challenge was enormous. The composer had only sketched out a few brief themes for the work before he died in 1827.
For more than two years, Elgammal worked with musicologists and composers, taking AI in new directions.
Ultimately, machine learning would add harmony to Beethoven's themes, develop them as the composer would have, bridge one theme to the next, and then help orchestrate the work, assigning parts to different instruments.
I hadn't heard all this done before. Some AIs had helped create a few minutes of a string quartet but not a full symphony, he said.
Language Models Help Beethoven Sing Given the sequential nature of music, the team adapted transformer models used for natural-language processing.
Ultimately, they created four neural networks. Two models used in language translation proved best for adding harmony and orchestration, another transformer served to develop themes and a BERT model helped bridge between themes.
Since music can be represented as mathematical symbols, the lab's servers, outfitted with a range of NVIDIA GPUs including a TITAN RTX, could easily handle the task.
To watch AI learn from a genius like Beethoven was an amazing experience, said Elgammal, whose training data included many hours of music from the German master.
Doubters and Devotees The work was released and premiered on Oct. 9 by the Bonn Beethoven Orchestra in the composer's hometown. (You can hear a recording online.)
After listening to this music for two years on my laptop, it was amazing to be in the event and hear it played live, he said.
Elgammal attended the premier and visited Beethoven's home in Bonn. Responses spanned the spectrum. Skeptics disliked the mix of art and technology, others felt inspired.
Some were very enthusiastic with tears in their eyes and goosebumps, and one friend listened to it the whole day, over and over, he recalled.
Taking Music AI Mainstream Whatever the response, it was a historic moment in what Elgammal calls computational creativity.
We imagine in the future we could offer various tools. We worked in classical music, but this could also be relevant to today's music, he said.
Early in its work, the team rendered one of Beethoven's themes in a pop style, just for fun.
Lending Artists a GAN Much of Elgammal's work these days is in visual arts. His startup Playform makes the generative adversarial networks (GANs) used in computer vision available as tools for a painter's palette.
Playform uses data augmentation so artists can train their own AI models with as few as 30 images rather than the tens of thousands that GANs typically require. The service runs on NVIDIA GPUs in a public cloud service.
Artists don't want to use pretrained models, they want their art to be unique, so they won't use someone else's GAN model, he said.
Plans for an Encore Some artists use Playform to brainstorm, exploring new concepts that inspire what they paint by hand. Others use AI as an assistant, creating digital assets they incorporate in their work.
We're adding capabilities like synchronizing music and art for events and AI models trained to make music videos, he said.
The next Beethoven might start a symphony with a digital flourish.
Most recent headlines
04/08/2024
Dalet, a leading technology and service provider for media-rich organizations, is excited to announce Santiago Solanas as its new Chief Executive Officer (CEO)....
03/06/2024
Dalet, a leading technology and service provider for media-rich organizations, a...
28/04/2024
Mediahaus delivers the first SRT live-streaming sports production over 5G with U...
25/04/2024
Sundance Institute Founder Robert Redford during a press conference at the 1996 ...
25/04/2024
alt= class=wp-image-12361 data-lazy-src=/wp-content/uploads/2024/04/NAB-booth-2024-960x540-1.jpg/> Set against a vibrant backdrop of innovation and collaboratio...
25/04/2024
alt= class=wp-image-12356 data-lazy-src=/wp-content/uploads/2024/04/NAB-mod-win-960x540-1.jpg/>NAB's Eric Trabb (right) awards SNS with two NAB Show Product...
25/04/2024
PHILADELPHIA Comcast beat earnings estimates in its Q1 2024 financial report, as streaming losses continued to decline and Peacock's paid subscribers spiked...
25/04/2024
SEATTLE The Seattle Kraken have inked new multi-year agreements with Tegna and Prime Video that will expand access to their games over broadcast stations and st...
25/04/2024
M2A Medias Matt Hughes asks, is it time for news broadcasting to shift to the cloud?
By Contributor
Published: April 25, 2024
M2A Media's Matt Hughes ...
25/04/2024
Cintel Scanner G3 HDR Restores Egypt's Cinema Treasures to Their Former Glo...
25/04/2024
Sinclair Broadcast Group said it named Kevin Coskren chief meteorologist at KTUL, its ABC affiliate in Tulsa, Oklahoma....
25/04/2024
The Business of TV News, a new one-day event featuring Martha Raddatz, Shannon Bream, Glenn Kirschner and other major figures in television news, happens at Hot...
25/04/2024
Conditions put on the proposed sale of WADL Detroit, to Mission Broadcasting have created a potential drama in the Motor City....
25/04/2024
TelevisaUnivision reported a $52 million loss in the first quarter, up from $3 m...
25/04/2024
Comcast reported flat first-quarter earnings as it reduced the red ink at Peacock but continued to lose video and broadband customers....
25/04/2024
Music-video network Vevo said it launched its app on Telly, the company offering consumers free dual-screen TVs in return for data about what they're watchi...
25/04/2024
Future Today said it has introduced a redesigned user interface for about half of its 300 streaming apps, including Fawesome, HappyKids and iFood.TV....
25/04/2024
The writer and director of a hit Czech series tell Robert Shepherd about their approach to portraying real-life Pakistani kidnappings on the small screen, while...
25/04/2024
Notorious DIT will work with the Liverpool Film Office to increase opportunities for regional talent
By Matthew Corrigan
Published: April 25, 2024
Notorio...
25/04/2024
Broadpeak , a leading provider of content delivery network (CDN) and video streaming solutions for content providers and pay-TV operators worldwide, announced t...
25/04/2024
Lightware Visual Engineering, a leading manufacturer of connectivity solutions for the professional integrated systems market and a pioneer in signal management...
25/04/2024
Net Insight has entered into a collaboration with DMC Production that positions Net Insight at the forefront of sports broadcasting in the Nordics. Net Insight ...
25/04/2024
GlobalM has announced a strategic partnership with scoopa, the specialists in broadcast-quality content distribution, offering a complementary service for live ...
25/04/2024
PlayBox Neo announces the completion of a new multichannel playout system for the DDish direct-to-home satellite television network in Mongolia. Based in the na...
25/04/2024
Canadian music producer and engineer Garth Richardson also known as Gggarth due to his stutter - has embraced immersive audio by installing a PMC monitoring s...
25/04/2024
Leading video software provider Synamedia today announced that Televisa, the Mexican telecommunications and broadcasting company, has chosen Synamedia as its pa...
25/04/2024
OTTera, a leading provider of end-to-end OTT and FAST channel solutions, proudly announces its strategic partnership with ThinkAnalytics, a global leader in adv...
25/04/2024
The American Tobacco Campus will be hopping with activity tonight and this weekend with two fun events!
Durham Night Market
At last! The Durham Night Market i...
25/04/2024
WEST CHESTER, Pa. Video commerce provider Qurate Retail Group has launched The Big Dish, a new culinary-themed FAST channel on The Roku Channel....
25/04/2024
LOS ANGELES The Hollywood Professional Association has announced that submissions for the 2024 HPA Engineering Excellence Awards are now being accepted. This re...
25/04/2024
NEW YORK The digital media measurement and analytics firm DoubleVerify has announced that it has received Media Rating Council (MRC) accreditation for Video Vie...
25/04/2024
SAN FRANCISCO Fox Corp.'s ad-supported streaming service Tubi has announced a licensing agreement with the sports platform DAZN that will see DAZN Ringside ...
25/04/2024
NEW YORK In the runup to the 2024 IAB NewFronts, the IAB has announced three key appointments to its leadership team....
25/04/2024
Epic Games releases Unreal Engine 5.4 with new Motion Design Mode, Unreal VCam f...
25/04/2024
Content Creation, Production, Distribution Is In a State of Flux
Andy Marken April 24, 2024
0 Comments
My empathy is creeping towards what I would de...
25/04/2024
The Carolina Panthers and Capitol Broadcasting Company (CBC) announced they have...
25/04/2024
Berklee Student Riko Sasaski Named 2024 Yamaha Young Performing Artist The accomplished saxophonist secured a spot among the elite winners of this year's ...
25/04/2024
Stations everywhere take pride in having a main anchor who comes from the market they represent. That applies in St. Louis, too, but it also pertains to general...
25/04/2024
Edward Moody is joining the WBTW Myrtle Beach, South Carolina, anchor crew, and will anchor the 5, 6 and 11 p.m. newscasts alongside Trish Williford. He comes f...
25/04/2024
MTV said the 2024 Video Music Awards will return to New York and take place at the new UBS Arena....
25/04/2024
Season three of comedy The Outlaws premieres on Prime Video May 31. Stephen Merchant co-created the show, and stars. There are five episodes....
25/04/2024
The E.W. Scripps Co. is evaluating offers for Bounce, its multicast channel for African-American viewers, according to a report from CNBC....
25/04/2024
Paramount Plus has ordered a second season for Dora, the animated preschool show based on Dora the Explorer. The show, featuring Dora on a rainforest adventure ...
25/04/2024
Bayanat AI PLC (ADX: BAYANAT), a leading AI-powered geospatial solutions provider, and Al Yah Satellite Communications Company P.J.S.C. (ADX: YAHSAT), the UAE&#...
25/04/2024
April 25th, 2024 Press Materials Available Here
TRIBECA FESTIVAL 2024 ANNOUNCES AUDIO STORYTELLING AND GAMES LINEUP
Audio Storytelling Program Features 10th ...
25/04/2024
NFL Draft 2024: Verizon Expands Broadband Capacity To Handle the Spike in Demand Mobile cells will help accommodate first responders, social media, sports betti...
25/04/2024
NFL Draft 2024: NFL Media Teams With The Fantasy Footballers on Hybrid, REMI Pro...
25/04/2024
NFL Draft 2024: ESPN Motors Into Detroit With Trio of Simultaneous Live Presenta...
25/04/2024
Published On: April 25th, 2024
data-orig-src=https://www.sgo.es/wp-content/upl...
Growing up in the Nile delta, Ahmed Elgammal dreamed of becoming an archaeologist or art historian. He never imagined he'd wind up in a concert hall in Bonn listening to the premier of Beethoven's Tenth, a symphony he helped finish with AI.
