Google Created AI Tool That Can Create Music Considering Text Descriptions

Google AI tool for creating music

Scholars at Google have created an AI system that can “create” high-fidelity music just based on text hints given by users.

Google’s AI tool used 280,000 hours of audio for training. The new system called MusicLM uses the AudioLM music generator. The latter is an AI-driven music creation tool that made some noise back in October.

Google AI tool for creating music

It works in the following way: a user inputs the description of music in the form of text (1); then, the system produces the corresponding audio (2). For this, the system needs to know the type, length, genre, etc. Apart from these details, users can also provide more info with MusicLM. The latter can also create music that “induces the experience of being lost in space.” Another task of the tool could be the creation of music based on a melody that the user whistles or hums.

Gizchina News of the week

MusicLM Advantages

We should also point out that MusicLM has some bugs. For instance, it might create music that “remains consistent over several minutes.” But the AI system is still the best tool in the niche. So if users provide more details with it, the system will create a better melody.

The biggest highlight of this tool is a combination of multiple neural networks. Each of them can control a separate step in the music generation workflow. Instead, MusicLM uses just one. Google uses the so-called Transformer architecture. The company released it in 2017.

As you’ve realized, it considers a variety of data points when making a decision, such as how to produce a piece of music. The advantage of this system is the improved accuracy due to a bigger impact of data on the processing outcome.

Google hasn’t made the MusicLM code public yet. At the moment, researchers published an AI training dataset. It consists of about 5,500 musical compositions. Each of them has a text description to make it simpler for neural networks to understand.

Disclaimer: We may be compensated by some of the companies whose products we talk about, but our articles and reviews are always our honest opinions. For more details, you can check out our editorial guidelines and learn about how we use affiliate links.

Source/VIA :
Read Also:  OpenAI reopens ChatGPT Plus subscription
Previous Russia Blocks CIA and FBI Websites Nationwide
Next Tesla wins "record-setting report card", but why is Musk still troubled?