Sony Pixel Power calrec Sony

Everything Is Music to Instrument Inventor Akito van Troyer's Ears

11/12/2023

Everything Is Music to Instrument Inventor Akito van Troyer's Ears The Berklee professors creations collapse boundaries between digital and physical instruments and highlight the sonic potential of everyday objects.

By

John Mirisola

December 11, 2023

Akito van Troyer holds two custom-made musical cubes built for the MM-RT, an instrument he invented in 2016. The cubes, which contain magnets, vibrate and rattle when activated by the instruments electromagnetic surface.

Image by Kelly Davidson

Akito van Troyers latest instrument is not a drum machine, exactly. More like a drumming machine.

Laid out on a table at the Electronic Production and Design (EPD) professors Cambridge workspace, van Troyers briefcase-sized prototype is surrounded by a striking mishmash of objects: containers and lids of all sizes, a box of 3D-printed plastic cups and saucers, an egg shaker, a glass ball, a styrofoam block, two decorative tin pails, a handful of playing card-sized metal plates, and a festive-looking fake pumpkin. Van Troyer has placed an object on each of the instruments eight square pads, which have mechanical actuators that will strike these objects in a programmed sequence when he presses play on the connected MIDI controller.

He hits a button and the instruments surface pings and rattles and shakes and thumps with the found-sound rhythm, which he can alter with further tweaks to buttons and sliders.

The biggest thing this instrument can do is turn everyday objects into musical materials, he says. The result is a kind of dream laboratory for anybody whos ever drummed on random objects and surfaces just to hear how they sound. He calls it the Garakutakara-a play on a Japanese term that means junk treasure. And its the latest development in a series of sonic explorations that have fascinated van Troyer for years.

Akito van Troyers latest musical creation turns everyday objects into programmable percussion sounds.

Image by Kelly Davidson

The Search for New SoundsFor as long as van Troyer has pursued music, he has sought out new sounds and new ways of making those sounds. There are all kinds of music out there, and I wanted to experience them, van Troyer explains. I want to create the most original sounds. Original sound counts when youre making new music.

As an undergraduate studying ethnomusicology at the University of Hawaii, van Troyer focused on Indonesian gamelan music. Gamelan is a rich and complex system filled with instruments, tones, and scales that have developed independently of Western musical traditions. At the same time, he began to explore computer music, and discovered that the two interests could complement each other. For his senior thesis, he used a computer to analyze the sound of each instrument in a gamelan ensemble, then he created a new electronic gamelan composition with the digital versions of those instruments.

Van Troyer took this fascination with the intersection of technology and sound design through the rest of his education, from a masters degree in music technology at Georgia Tech to a second masters and Ph.D. in media arts and sciences from the Media Lab at MIT. He continued to develop new virtual sounds and instruments while also beginning to explore how to use technological tools to make music with physical objects.

Instrument Builder

Akito van Troyer plays the MM-RT.

Image by Kelly Davidson

The first physical instrument van Troyer built was a mechanically augmented cello that took advantage of a small but significant part of the instruments construction. Cellos have a piece called a sound post, a wooden rod inside the body that has a critical influence on the instruments timbre. Knowing this, van Troyer built a robot that changes the sound post position on the fly to change the timbre of the cello as the cello player plays.

Other instruments hes built or collaborated on have included a MIDI-enabled microtonal harpsichord, a percussive geodesic dome, and a tactiloscope-a work-in-progress device that would translate sound into a touchable interface for hearing-impaired users.

Van Troyer also began building instruments with platforms that would strike or resonate materials the musician puts on top of them, like the Garakutakara. Theres another one like this on the table in his workspace that functions differently, sending out electromagnetic pulses that vibrate metal pieces inside the materials he places on the instruments surface. He calls it the MM-RT (which stands for material, magnet, rhythm, and timbre), and it won the Peoples Choice: Most Unusual award at the Guthman New Musical Instrument Competition in 2017.

Watch Akito van Troyer demonstrate his award-winning MM-RT for Atlanta Magazine:

Making ConnectionsRunning through many of van Troyers musical creations is a deep desire to create connection-between the musician and the instrument, between the performer and the audience, and between the sound and the source.

Think about a guitar, he says. When you play it, its in your face: the guitar is right here, and the sound comes from there, and the [performers] gestures directly result in the sound. So it makes sense for the audience members and its fun to watch.

By contrast, he explains, with a conventional electronic musical instrument, the gesture-say, pressing a button on a keyboard or writing a few lines of code on a computer-is separated from the sound it produces, which comes out of a speaker somewhere else. This is the problem van Troyers new instruments are confronting head-on.

Everyday Music

Image by Kelly Davidson

Image by Kelly Davidson

With instruments like the Garakutakara and the MM-RT, van Troyer is bringing the sound closer to the gesture. An audience member can see him place the tin pail on one of the pads, then hear the pail start to pound like a steampunk kick drum. Then, they can watch as he selects the festive
LINK: https://www.berklee.edu/berklee-now/news/everything-is-music-to-instru...
See more stories from berklee

Most recent headlines

05/01/2027

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be demoed at CES 2026

Worlds first 802.15.4ab-UWB chip verified by Calterah and Rohde & Schwarz to be ...

04/08/2026

Dalet Announces Commercial Availability of Dalia, Bringing Media-Aware Agentic AI to Enterprise Productions

Dalet, a leading technology and service provider for media-rich organizations, t...

04/07/2026

Detective Conan: Fallen Angel of the Highway Opens in Dolby Cinemas Across Japan, Presented in Dolby Atmos and Dolby ...

April 7 2026, 19:00 (PDT) Detective Conan: Fallen Angel of the Highway Opens in...

01/06/2026

Dolby Sets the New Standard for Premium Entertainment at CES 2026

January 6 2026, 05:30 (PST) Dolby Sets the New Standard for Premium Entertainment at CES 2026 Throughout the week, Dolby brings to life the latest innovatio...

15/05/2026

IAB Releases Campaign Data Standards 1.0 for Public Comment

Share Copy link Facebook X Linkedin Bluesky Email...

15/05/2026

ARRI Expands Management Board

Share Copy link Facebook X Linkedin Bluesky Email...

15/05/2026

Gray Media Names Joanie Vasiliadis SVP of Transformation

Share Copy link Facebook X Linkedin Bluesky Email...

15/05/2026

Study: Data and Measurement Problems Reduce CTV Ad Budgets

Share Copy link Facebook X Linkedin Bluesky Email...

15/05/2026

Upfronts: WBD Expands Advanced Ad Capabilities and AI Ad Tech

Share Copy link Facebook X Linkedin Bluesky Email...

15/05/2026

VLAST Powers PLAVEs Asia Tour Encore with AJA Gear

Delivering a live, arena-scale production of a massively popular band is no small feat. Between expansive in-arena LED walls and a global live stream fed to onl...

15/05/2026

Sun Broadcast Futureproofs Dayalbaghs Multimedia Van with...

Connection is the heartbeat of any strong community, and with live streaming becoming more accessible in the modern era, it's much easier for faith-based or...

15/05/2026

Disguise and Creative Technology Power Eurovision for the...

Powered by GX 3 media servers, optimised IP-VFC workflows and on-site engineering expertise, the production delivers high-performance visuals for one of the wor...

14/05/2026

Sweetwater and Airstream Unveil Mobile Dolby Atmos Recording Studio

Sweetwater and Airstream have announced a custom-built Dolby Atmos mobile recording studio inside an Airstream trailer, set to tour music festivals, schools, tr...

14/05/2026

American Association of Professional Baseball Expands Broadcast Distribution for 2026 Season

The American Association of Professional Baseball (AAPB) has announced a new par...

14/05/2026

ESPN to Establish Week-Long Super Bowl LXI Broadcast Center on Santa Monica Beach

ESPN has announced plans to transform Santa Monica Beach into a broadcast hub du...

14/05/2026

Amagi Announces Major Upgrade to CLOUDPORT Cloud Broadcast Platform

Amagi has announced a significant update to Amagi CLOUDPORT, its cloud-based broadcast playout platform. The update includes 250-plus features shipped in FY25-2...

14/05/2026

Clear-Com to Showcase New Products and Platform Updates at InfoComm 2026

Clear-Com will exhibit at InfoComm 2026 (Booth N7005, June 17-19, Las Vegas Convention Center), introducing a new product that builds on Arcadia Central Station...

14/05/2026

Ikegami to Exhibit at BroadcastAsia 2026 with Two New Viewfinder Premieres

Ikegami will exhibit at BroadcastAsia 2026 (Stand 5D3-1, Singapore Expo, May 20-22), introducing two new viewfinders alongside its existing camera, control, and...

14/05/2026

dB Broadcast Delivers IP-Based OB Trucks for Cloudbass Featuring Grass Valley LDX 100 Cameras

Grass Valley has announced that dB Broadcast has delivered new IP-based outside ...

14/05/2026

NAGRAVISION and WPBSA Launch Play Snooker Digital Platform

NAGRAVISION, a Kudelski Group company, has announced a partnership with the World Professional Billiards and Snooker Association (WPBSA) to launch Play Snooker,...

14/05/2026

Belden To Acquire RUCKUS Networks for Approximately $1.85 Billion

Belden Inc. has announced a definitive agreement to acquire RUCKUS Networks from Vistance Networks for approximately $1.85 billion. The transaction has been app...

14/05/2026

NVIDIA Releases Content Localization Blueprint for AI-Assisted Dubbing and Speech Translation

NVIDIA has released the Content Localization Blueprint, a modular reference arch...

14/05/2026

Disney+ To Stream Banana Bowl Championship Live This October

Disney has announced that Disney will be the exclusive U.S. streaming home of the Banana Bowl, the Banana Ball league season championship, streaming live this ...

14/05/2026

Arkona and Manifold To Exhibit on Magna Systems Stand at BroadcastAsia 2026

Arkona technologies and technology partner manifold will demonstrate their production solutions on the Magna Systems and Engineering stand (Booth 5D1-1) at Broa...

14/05/2026

Haivision Webinar: New Broadcast Contribution Products Featuring Minor League Baseball Case Study

Haivision will host a webinar on Thursday, May 21 at 10 a.m. ET / 4 p.m. CET cov...

14/05/2026

The CW Network and ESPN Announce ACC Sublicense Agreement Through 2030-31 Season

The CW Network and ESPN have announced a sublicense broadcast agreement for The CW to televise ACC football and men's and women's college basketball gam...

14/05/2026

Detroit Pistons Ink Local Media Rights Deal With Scripps Sports

The agreement marks Scripps Sports' first NBA local rights deal...

14/05/2026

Report: Broadcasting Among Hardest-Hit Industries as AI Reshapes the Workforce

A new report from education-technology company Wiingy testing post-ChatGPT predictions against three years of real-world data has identified broadcasting as one...

14/05/2026

Madonna, Shakira, and BTS to Headline First-Ever FIFA World Cup Final Halftime Show

Global Citizen and FIFA have announced that Madonna, Shakira, and BTS will headl...

14/05/2026

Sundance Institute Names 2026 Episodic Lab Fellows

LOS ANGELES, CA, May 14, 2026 - The nonprofit Sundance Institute announced today the cohort selected for the 2026 Episodic Lab program, taking place at Dunaway ...

14/05/2026

Spotify Expands Music Access for Young Listeners, Extending Managed Accounts to Free Tier

At Spotify, we're focused on making every listening experience feel intentio...

14/05/2026

Spotify Brings Nashville's Songwriting Community Together for Mental Health Summit

Spotify recently welcomed songwriters, artists, executives, and music students t...

14/05/2026

Sonuscore update Lux Orchestral Strings

New articulations, ostinatos, Motion Scoring Articulation Sets & more Sonuscore's flagship cinematic string library has just been treated to a significa...

14/05/2026

Pr Recording & Residence

World-class studio opens on T rkiye's Aegean coast P r Recording & Residence have announced their official opening, introducing a new world-class reside...

14/05/2026

Nugen Audio update DialogCheck

Now supports channel layouts up to 9.1.6 Nugen Audio have just released an update for their AI-powered dialogue intelligibility and compliance tool. Set to ...

14/05/2026

UVI release Orchestral Suite 2

New recordings & one-key chord tool UVI have just announced the release of Orchestral Suite 2, a ground-up redesign of their all-in-one symphonic orchestra ...

14/05/2026

Rob Papen launch eXplorer 11

Two new arrivals & expanded factory content Rob Papen's all-encompassing plug-in and virtual instrument collection has just been treated to another upda...

14/05/2026

FSK Audio release QRonicle

Embed QR codes into DAW sessions FSK Audio's latest plug-in doesn't process audio, but serves as an organisational tool that allows QR codes to be e...

14/05/2026

SBS Board appoints Jane Palfreyman Managing Director

SBS Board appoints Jane Palfreyman Managing Director 13 May, 2026 Media releases The Special Broadcasting Service (SBS) Board of Directors is pleased to an...

14/05/2026

Transforming bold ideas into market-ready productions: Digital Originals returns

Transforming bold ideas into market-ready productions: Digital Originals returns 14 May, 2026 Media releases SBS, NITV and Screen Australia have announced ...

14/05/2026

Australia Uncovered Returns to SBS with Bold New Season Featuring John Safran on Free Speech and Powerful Stories of Justice and Survival

Australia Uncovered Returns to SBS with Bold New Season Featuring John Safran on...

14/05/2026

Rohde & Schwarz transforms spectrum complexity into situational awareness and effective countermeasures at AOC Europe 2026

Rohde & Schwarz transforms spectrum complexity into situational awareness and ef...

14/05/2026

Rohde & Schwarz and Quantum Systems join forces to redefine EW and C-UAS-enabled uncrewed operations

Rohde & Schwarz and Quantum Systems join forces to redefine EW and C-UAS-enabled...

14/05/2026

Rohde & Schwarz showcases STANAG aligned ARDRONIS Counter UAS capability at NATO Technical Interoperability Exercise 2026

Rohde & Schwarz showcases STANAG aligned ARDRONIS Counter UAS capability at NATO...

14/05/2026

Code of Silence wins Best Drama Series at the 2026 BAFTA's!

Code of Silence has won the BAFTA for Best Drama Series at Sunday night's ceremony at the Royal Festival Hall. The series, starring Rose Ayling-Ellis and w...

14/05/2026

The Wraith Shield Advantage: Transforming L3Harris Radios into AI-Enabled Counter-UAS Sensors

Soldiers equipped with Falcon IV radios will soon gain a sense-and-protect capa...

14/05/2026

Getting into the Space Nuclear Power Game with Next-Generation Technology

Artists concept of the L3Harris Next Gen RTG in flight configuration, designed to provide 250 watts of reliable power for decades-long missions in deep space....

14/05/2026

Vivid Broadcast builds remote production network around Calrec

Vivid Broadcast was embracing remote production long before it became the industry norm. Now, with Calrec's True Control 2.0-enabled Argo M and Type R conso...

14/05/2026

Nielsen data shows NZ vehicle advertisers are shifting gears as fuel pressures make EVs and hybrids an increasingly attractive option

Car ad spend rises sharply in March as more auto buyers turn to electric, hybrid...

14/05/2026

Is This the Year for Agentic AI's Breakout in Broadcast?

Share Copy link Facebook X Linkedin Bluesky Email...