Google develops new Text-to-Music AI called “MusicLM” by Google

Google’s AI text-to-music generation system, MusicLM is trained on datasets of 2,80,000 hours and the AI can take prompts of instruments, mood, and melody to turn any text into music. MusicLM is not just limited to text. You can also give prompts to the MusicLM AI in form of pictures and captions. Google says that the system is built on composing music and instrumental melodies based on descriptions of “coherent complexity.” While the MusicLM AI by Google does sound promising, there’s more to it. More details are below.

MusicLM by Google is an AI model that generates high-fidelity music from text descriptions. The text-to-music AI model by Google casts the “process of conditional music generation as a hierarchical sequence-to-sequence modeling task.”

Google says the MusicLM AI generates music “at 24 kHz that remains consistent over several minutes. Our experiments show that MusicLM outperforms previous systems both in audio quality and adherence to the text description. Moreover, we demonstrate that MusicLM can be conditioned on both text and a melody in that it can transform whistled and hummed melodies according to the style described in a text caption”

The MusicLM text-to-music AI by Google can produce music based on the following prompts:

• Generate music from descriptive captions.

For example: “The main soundtrack of an arcade game. It is fast-paced and upbeat, with a catchy electric guitar riff. The music is repetitive and easy to remember, but with unexpected sounds, like cymbal crashes or drum rolls.”

• Generate music from texts

For example: “Relaxing Jazz”

• Story mode, where the AI produces music based on the sequence of the prompts

For example: “time to meditate, time to wake up, time to run, time to give 100%”

• Experience level

For example: “a professional piano player”

• Photo & painting captions

This prompt can be used to instruct the AI with an image/photo/painting along with captions for the same.

• Text and Melody Conditioning

This prompt is used when you want to embed a specific melody in your prompt while also wanting the MusicLM AI to respect the text prompt

These are some of the ways to use the MusicLM AI text-to-music generation model.

The sad news is that Google is not going to be releasing this new AI at least soon. The tech giant says that due to the technical limitations, and limited training datasets as well as risks to violate the copyrights of music artists, Google will not be releasing this new AI at least until the limitations are met.

A point to note is that MusicLM isn’t the first AI that can turn text to music. OpenAI, the company that hosts the popular AI chatbot, ChatGPT also developed a text-to-music AI called “Riffusion”

AI or Artificial Intelligence is ever-growing today than before. From ChatGPT expected to bring one billion dollars by 2024 to MidJourney AI getting popularity as the machine for generating stunning images and art, we have gotten to see just what AI can potentially achieve. It won’t be wrong to say, the future is going to be of artificial intelligence, machine learning, and even augmented reality (AR)

Recent News: ChatGPT is now on Whatsapp!