At the Hot Pod Summit held in Brooklyn recently, Adobe released a prototype of a new AI music creation tool called “Project Music GenAI Control”. The tool leverages generative AI technology to help users create and edit music without professional audio production experience. Users only need to enter a text description, such as “upbeat dance” or “sad jazz,” and Project Music GenAI Control will generate music of the corresponding style. Users can also customize the generated music using integrated editing controls, adjusting repeat patterns, speed, intensity and structure. Also, the tool can remix music clips and generate audio loops, perfect for content creators creating background music and soundtracks.
Project Music GenAI Control
Adobe says Project Music GenAI Control will also be able to adjust the generated audio “based on a reference melody”. It can also extend the length of audio clips to meet the required duration, such as for fixed animations or podcast clips. At this time, the actual user interface for editing the generated audio has not been announced.
Although similar music generation tools already exist on the market, such as Google’s MusicLM and Meta’s open-source AudioCraft, these tools can only generate audio through text prompts. These tools also do not edit the generated music. This means that users either continue to generate audio until they are satisfied or manually modify it with the help of professional audio editing software.
Gizchina News of the week
Nicholas Bryan, senior research scientist at Adobe Research, said in a press release
“One of the most exciting capabilities of these new tools goes beyond just generating audio…They, like Photoshop, give creators deep control over how they can shape, adjust and edit audio just like you control images at the pixel level .”
Project Music GenAI Control was developed by Adobe in collaboration with two universities. They are the School of Computer Science at the University of California and Carnegie Mellon University. The project is still in the “early experimental” stage. It may be integrated into Adobe’s existing editing tools Audition and Premiere Pro in the future.
Conclusion
In conclusion, Adobe unveiled its innovative AI music creation tool, “Project Music GenAI Control,” in Brooklyn. This tool empowers users to generate and edit music effortlessly, leveraging generative AI technology and intuitive controls. Unlike existing tools, Project Music GenAI Control offers customization options and editing capabilities. This allows users to shape and refine their music compositions according to their preferences. Developed in collaboration with leading academic institutions, the project represents a significant advancement in audio editing technology. As Adobe explores further integration possibilities with its existing editing software, the future looks promising for creators seeking seamless and intuitive audio production tools.
