Music composition and generation

Generative AI models, such as long-lasting memory (LLMs) and image generators, can greatly inspire and enhance music composition and generation. By analyzing extensive music databases, LLMs can learn musical styles, patterns, and trends and generate unique compositions. ChatGPT, a model by OpenAI, has been utilized in creating complex music pieces, offering composers fresh material for symphonies, concertos, or simple melodies. Image generators, too, can translate visual inputs into music, creating intriguing multi-sensory experiences. For example, converting paintings into symphonies, or landscapes into soothing ambient sounds. Such models are transforming the way we conceive and experience music, providing limitless creative prospects.

This is an example application that has been constructed using a tool called Clevis. The application is titled 'Music Composition and Generation', aimed at assisting users in composing and generating music in their desired style or genre.

In the first step, users are asked to input the genre of music they are interested in. The application then leverages the power of ChatGPT, a language model developed by OpenAI, to create a short melody based on the user's input. In the subsequent step, ChatGPT is prompted again, but this time it is to suggest chord progressions that would accompany the generated melody perfectly.

To add further depth to the composition, an HTTP request is made to retrieve lyrics of a song that fits the user's chosen genre. Finally, the results of these steps are presented to the user in a friendly and easily readable format. This includes the generated melody, the suggested chord progressions, and the retrieved song lyrics.

This application is just a demonstration of what can be achieved using Clevis. This tool can be used to build multiple applications within the same domain, expanding the possibilities of AI-assisted music composition and generation.