riffusion

Riffusion Official Website, Generate Spectrum Graphs and Create Music

Riffusion, a new AI project, can generate spectrum graphs and produce sounds based on customized music styles. Last year, the rise of AI was astonishing: we saw AI avatars with a futuristic style in Pilot Plugins, which can help you generate new MIDI and audio files, AI covers of Dolly Parton's "Jolene," and more. An AI-sung track released earlier this year even exceeded 100 million plays.

Riffusion Official Website:https://www.riffusion.com/

Besides AI, more virtual and augmented reality technologies have also entered the music industry. Now, following the peak of AI painting, Riffusion has developed new methods for music creation using the same technology.

It works by building an indexed collection of spectrum graphs, each labeled with keywords representing the music styles captured in the graphs. Once this collection is trained, Riffusion uses the same technology as the AI for image generation, Stable Diffusion, to create songs.

The project will generate a spectrum graph that matches the user's requirements. The spectrum will have similar features. For example, if you request "Pop Piano," it will create a spectrum graph that matches the keyword and convert it into a track dominated by pop piano.