The current state of “AI x Music”. AI can now also improvise.

【What Will Happen to the Music Industry in the Future with the Spread of AI? Predictions from “AI x Piano”】
https://realsound.jp/tech/2022/09/post-1119726.html

・Audeo,” developed by a research team at the University of Washington, is a technology that reproduces music from video footage of a piano being played. Specifically, it is an algorithm that takes video of a piano being played from above the keyboard and analyzes which keys are pressed and at what timing. In addition to piano, it can also output the sound of stringed instruments such as guitars and violins, and wind instruments such as trumpets.

・Duet with YOO” piano developed by YAMAHA. This is a technology that enables a “human and AI to play together. When a person plays the piano, the AI on the piano plays along with the person’s performance. The AI does not play along with a pattern of the person’s performance, but analyzes it in real time and plays along with the person’s performance.

・An automatic music scoring “ear copying AI” developed by a research team at Kyoto University. The accuracy of the ear-copied sheet music is amazing.https://audio2score.github.io/index-ja.html

・The AI piano, “Project Sekai Colorful Stage. feat. Hatsune Miku,” was realized through a collaboration of Yamaha’s AI technology! feat. Hatsune Miku”. When this piano starts playing a song, characters such as Hatsune Miku and Hoshino Ikka start singing along with the performance (it does not support music other than the specified score).

・AI, tools such as “Amper Music” and “AIVA”, are active in the field of music composition. Select the tune, pitch, length of the song, instruments, etc., and the AI will compose the melody almost automatically.

These are the quotes from the article

Where “AI x Music” is Now

【AI produces images that look like they were drawn by a human being. What are the differences?】
https://amimako.com/entertainment-science-cyber-ai-human-creative/

Stable Diffusion, an illustration AI software, was introduced in a recent blog. The world is talking about it as soon as possible, saying “Human painters will lose their jobs! and it has become a hot topic of conversation.

I wrote the other day that the same thing may happen with AI and music,

So, what is actually happening with “AI x music” at the moment? At what level?

The above article seemed to tell us where such “AI x music” is now.

There are a variety of amazing music AI being developed,

Personally, I thought YAMAHA’s “Duet with YOO” piano was amazing. The fact that it can improvise, analyze in real time, and play together is amazing.

Frankly, I am no longer surprised by talk of composition AI, AI singers, AI pianists, etc.

That is to say, specifically, that we should no longer be surprised that if we load the AI with the right data, train it, program it, and give it a few seconds or minutes of “time,” it will be able to play a reasonable amount of music.

However, “Duet with YOO” takes no time at all, and the music is improvised, in real time. In that sense, I was surprised.

What is the difference between human musicians and AI musicians? What is music because of human musicians?

Humanity? Storytelling? Emotion?

There are many possible elements,

I was shocked by “Duet with YOO” because I thought “improvisation” is also an element that is unique to human musicians.

Moreover, in the future, computer performance and computation speed will further improve, as in the case of quantum computers. If this happens, it is likely that the improvisation by AI will become even more amazing. (Incidentally, quantum computers are said to “solve calculations that would take 10,000 years in 3 minutes and 20 seconds” or “100 million times faster than conventional computers. It will be interesting to see which country will be the first to put quantum computers to practical use. (The world’s power structure is about to change.)

As you can see, I am constantly shocked by the evolution of AI music, but I am not shuddering at the thought of AI music.

As the author says in the article above, there will never be no more human musicians. (Just as, for example, painters did not disappear because of the widespread use of cameras.)

However, it is certain that the human musician is changing more and more with AI music.

Believing that this change is also an evolution, I would like to continue to do my best in my musical activities.

See you then.

Even at my level, I am already doing things like “reading and reproducing existing guitar tones” and “mixing work with existing music waveforms” on my PC. I believe that one of the keys to our future success will be what form “Makoto Ogata x Music x AI” takes.