AI Music Generation

Riffusion is a free and open source real-time music and audio generation library with stable diffusion, where the user simply enters a description of the music and the AI generates music in the corresponding style. The open source project was launched by Seth Forsgren and Hayk Martiros. The principle behind Riffusion is to fine-tune spectrograms based on Stable Diffusion (a text-to image model), which is a visual representation of audio showing the amplitude of different frequencies over time, and then convert the high fidelity spectrogram image to audio. Riffu...

On August 8, ByteDance's intelligent AI assistant Doubao launched a music generation function today. Users can enter the theme or lyrics written by themselves in Doubao's "Music Generation", set the music style, mood and timbre, and quickly generate a song of about 1 minute. Currently, Doubao's music generation function provides 11 music styles such as folk, hip-hop, R&B, etc., which also covers relatively niche styles such as jazz, reggae, and electronic music. Users can choose male or female voices. The generated sound performs well in articulation clarity and fluency. At the same time, in order to make AI sound...

Udio is a revolutionary AI music creation tool developed by former Google DeepMind engineers. Through text prompts, Udio allows users to quickly generate high-quality music works that match their musical style preferences. Udio places special emphasis on the ability to capture emotions in synthetic vocals. Udio has received support from technology heavyweights including A16z and Instagram co-founder and CTO Mike Krieger. It has also attracted Common, producer Tay Keith, music industry veteran Steve…