Week 1 (2/28) – Picking Out Pieces

Edward W -

This week’s goal: Pick out all of the pieces that I plan to use in the resulting survey.

A few setbacks first…

So… it turns out that the MuseNet neural network I was planning to use for my senior project is on hiatus indefinitely, and there is no official MuseNet neural network that has been released by OpenAI. The research for the neural network has been on pause since December 2022, but I didn’t realize this, so I was searching on GitHub for nearly an hour until I found a post saying the neural network was no longer accessible to the public. Although it does mean that I have to pivot to using another neural network, it doesn’t affect any of my progress this week, since my objective this week was to pick out pieces to use in my survey.

But currently, I am looking at Allegro Music Transformer, which is a neural network that functions similarly to MuseNet, but has all of its code accessible on asigalov61’s GitHub page. Allegro Music Transformer also uses Jupyter Notebook, which I am very new to, so it’s a bit of foreshadowing to how next week is going to go…

Back to this week…

This week was spent combing through piece after piece by composer after composer.  I think I’ve listened to almost a good eight hours’ worth of music in the past week, and this might constitute the most boring part of the project. The good news is that I have a set of ten pieces picked out, and although I can’t specify what pieces I will be using in the final survey, I can tell you what genres and arrangements I’ve picked!

  • Baroque – solo organ, four-part fugue
  • Classical – string quartet
  • Romantic – solo piano
  • Contemporary – solo piano
  • Contemporary – solo cello
  • Jazz – jazz quartet, sax solo
  • World – vocals over lyre
  • City Pop – pop band (vocals over synth, bass guitar, and drumset)
  • Ambient – piano and synth
  • Original Composition – piano and cello duet

I picked a lot of piano and cello pieces, mostly because that is what me and my piano teacher are familiar with, but I also tried to include other ensembles that I am less familiar with, like jazz quartets, pop bands, and organ.

Although I would have liked to include more music from the modern era, the problem with pop music is that… well, it’s popular! For any pop song I pick, there is a decent chance that one of the respondents might actually know the song, and it ends up ruining the point of the survey. Now that I have these pieces, I am going to have to transcribe them into MIDI files that can be processed through MuseScore, which will be coming up on Week 4.

Below is a picture of me listening to music! (Here, it’s Mozart’s Ein musikalischer Spaß.)

Me listening to music

 

Next week’s objective

Next week is the fun part! I’ll be figuring out how both Allegro Music Transformer and Jupyter Notebook work, and I’ll be starting to actually create music using neural networks. For now, the pieces that I found will give me a good baseline for what genres I should try to get the AI to compose in.

Thanks for sticking around, and hopefully I’ll see you in next week’s blog post!

– Eddie 😛

Minor Edit (3-4-24)

I wanted to update this post, especially since I think Isabelle asked a very good question about what qualities I was looking for while I was choosing my pieces, and I wanted to take the opportunity to address it here since I should’ve but didn’t in this post last week.

I was looking for three major factors in all the pieces I was picking:

  1. Recognizability – A piece is recognizable when I can give it to someone with a lower level of musical experience, and they can go, “Oh, it’s this genre” or “Oh, it’s from this musical era”, so it was very important that these pieces are representative of their genre or era.
  2. Obscurity – A piece is obscure when it isn’t as well known in the musical community. Of course, I can never guarantee that absolutely no one has heard of a specific piece, but because of the sheer quantity of music many composers put out, there are many pieces that just never gained popularity. The last thing I would want to happen is me using a common piece like Für Elise or the Flight of the Bumblebee and have respondents to my survey be able to deduce which piece they mark as AI-generated using this sort of deduction.
  3. Arrangement Commonality – I needed to pick pieces that use common ensembles. For example, if I used one of Liszt’s piano duets (of which he has only three), a listener could potentially tell that it’s Liszt not from the content of the music, but by which instruments are used, which defeats the point of the survey.

Here are some examples of the first factor, since it might not be completely clear how music from the Romantic era may not sound “Romantic” in style, etc.:

  1. Ludwig van Beethoven’s Sonata in C-minor, No. 32, Mvt. II – Arietta – youtu.be/WGg9cE-ceso?t=955 – This section feels like it could fit in snugly with 1920s boogie-woogie, not the 1820s from whence it came!
  2. Heinrich Biber’s Battalia à 10, Mvt. II – Die liederliche Gesellschaft von allerley Humor – youtu.be/5YBOmgi-qSs?t=105 – The movement is very reminiscent of contemporary music, despite being from 1673, containing dissonances that would make Schönberg blush!
  3. Franz Liszt’s Bagatelle sans tonalité, S. 216a – youtu.be/yc_HjEa8k5k – The whole piece is filled with atonality that is reminiscent of contemporary classical music, and in a way, Liszt cleverly predicted the direction that classical music would go in in the years following his death.

This time it has working links too!

I wanted to add this because I regret not adding into my original post, but I think it’s definitely important context for readers to know!

Thanks again to Isabelle for the question!

More Posts

Comments:

All viewpoints are welcome but profane, threatening, disrespectful, or harassing comments will not be tolerated and are subject to moderation up to, and including, full deletion.

    isabelle_s
    Hey Eddie, I'm sorry about the setback. I hope the neural network you're looking into is just as good! I was wondering if there were certain qualities you were looking for while you were selecting your musical pieces.
      Edward W
      Hi Izzy! Thank you so much for your question! During selection, I really wanted to focus on three factors: 1) recognizability, 2) obscurity, and 3) arrangement commonality. 1) A piece is recognizable when I can give it to someone with a lower level of musical experience, and they can go, "Oh, it's this genre" or "Oh, it's from this musical era", so it was very important that these pieces are representative of their genre or era. 2) A piece is obscure when it isn't as well known in the musical community. Of course, I can never guarantee that absolutely no one has heard of a specific piece, but because of the sheer quantity of music many composers put out, there are many pieces that just never gained popularity. The last thing I would want to happen is me using a common piece like Für Elise or the Flight of the Bumblebee and have respondents to my survey be able to deduce which piece they mark as AI-generated using this sort of deduction. 3) I needed to pick pieces that use common instrumental arrangements. For example, if I used one of Liszt's piano duets (of which he has only three), a listener could potentially tell that it's Liszt not from the content of the music, but by which instruments are used, which defeats the point of the survey. I hope that answers your question, and thanks again for commenting!
      Edward W
      I realized I wanted to give you some examples of the first factor, so here are some pieces that you could look at if you are interested: 1) Ludwig van Beethoven's Sonata in C-minor, No. 32, Mvt. II - Arietta - youtu.be/WGg9cE-ceso?t=955 - This section feels like it could fit in snugly with 1920s boogie-woogie, not the 1820s from whence it came! 2) Heinrich Biber's Battalia à 10, Mvt. II - Die liederliche Gesellschaft von allerley Humor - youtu.be/5YBOmgi-qSs?t=105 - The movement is very reminiscent of contemporary music, despite being from 1673, containing dissonances that would make Schönberg blush! 3) Franz Liszt's Bagatelle sans tonalité, S. 216a - youtu.be/yc_HjEa8k5k - The whole piece is filled with atonality that is reminiscent of contemporary classical music, and in a way, Liszt cleverly predicted the direction that classical music would go in in the years following his death. Sorry that the links don't work; there's not much I can do... :/
    Audrin Dain Yi
    Hi Eddie! The unexpected twist with MuseNet's hiatus must have been really frustrating, but I'm so glad that you were able to find and swiftly adapt to using Allegro Music Transformer. My question for you is as you transition to using Allegro Music Transformer and Jupyter Notebook next week, what specific challenges or learning curves are you anticipating and how do you plan to tackle them? Thanks!
      Edward W
      Hi Dain! Thanks for the question! I think the biggest challenge that I face is figuring out how Jupyter Notebook works. From what I've seen, Jupyter allows you to take Python code and run sections of it incrementally in steps. Especially if each step is demanding on your computer's GPU performance, it can be helpful to have these steps so that instead of restarting the whole program, you can just restart from the last successful step instead. I think figuring out how it works hasn't been too difficult, since it is largely Python-based. Alongside this, another big problem is that Allegro Music Transformer relies on the GPU, which allows the computer to perform mathematical calculations very quickly, meaning it is very helpful in processing, manipulating, and error-correcting inputs for the neural network. Although I do have access to an Nvidia GPU, it's not necessarily optimized for neural networks, and so it can take up to half an hour to generate even five audio samples. I am very glad I started on this early, because I have spent hours upon hours waiting for more and more audio samples, so I have a few prepared for next week's blog post! So these are the main problems that I've been working on, and I should be mostly finished with Allegro Music Transformer by Tuesday night. Thank you again for your question, and I hope that answers it!
        Dr Winslow
        Five samples take a half hour? What does 5 samples mean? When I was processing 24 hours of biological signal data over 20 years ago, it would take several hours to successfully process a recording. If you needed several hours to generate one song, and you only need less than 10 songs, then that time is well worth it ;)
    Macabe Wood
    Hi Eddie, I am sorry to hear about MuseNet! Since you haven't started working with the AI music models yet, do you expect that through this project you'll be able to tell apart human and AI made music? Or do you think you will have as hard a time telling them apart as the people taking your survey?
      Edward W
      Hi Macabe! Thank you for the question! I don't think that this project will help me distinguish between original compositions and AI compositions. Although I have over a decade in musical experience, I feel like it hasn't helped me all that much in distinguishing the two. I actually set up a mini experiment with my sister just to see how I'd do on a survey similar to mine, and I got 7 out of 11 correct (n = 11, p₀ = 0.5, p̂ = 0.636, P(p̂ ≥ 7) = 0.2744), which means there is no way to conclude that I am better than a 50/50 guesser. This does go against my prediction that musical knowledge would facilitate the identification of AI, and I think it has even led to some double guessing on my part, since I'll hear an odd rhythm or melody and get tripped up on whether that was the AI messing up its musical generation or a human deliberately making that choice. Thank you again for the questions, and I hope this response helped to answer them!

Leave a Reply