New sound AI TRIA transforms tapping or beatboxing into drum tracks

Whoever likes to tap a rhythm on the table with their hands while imagining how it would sound on a real drum set can now look forward to a new AI model that does exactly that. TRIA (The Rhythm In Anything), developed by a team of researchers from Northwestern University and Adobe Research, makes it possible to translate any percussive sounds, such as a hand-tapped rhythm, into high-quality drum recordings.

TRIA Gradio App

The TRIA team has also developed its own Gradio interface, which allows users to upload the sound timbre and rhythm audio prompts to create sound designs or convert between drum timbres. The system displays spectrograms and rhythmic feature representations of the input and output, visualizing the conversion process (as shown in the first image). The app will soon be made publicly available for free use via x.com/Gradio/status/1856320937181720770, allowing the app to be used through a browser.

TRIA could make it easy and intuitive not only for musicians but also for amateurs to turn musical ideas into realistic beats. The developers’ website provides many examples of how TRIA produces interesting sounds by combining different timbre and rhythm inputs.