Deep Learning for Music Information Retrieval

Day 1 (Monday)

• Introductions
• Python & Pytorch review

• Review:

  • Linear algebra (at least sections 1, 2, and most of 3)

• Guest speaker talk by Kelvin Walls

  • Total variation in popular rap vocals from 2009-2023

Day 2 (Tuesday)

• Reading: Automatic Identification of Instrument Classes in Polyphonic and Poly-instrument Audio
• Differential calculus review
  • Chain rule
• Softmax, gradient descent, and Feed Forward Neural Networks
• Building a musical instrument classifier

• Guest speaker talk by Brandon Carone

  • SoundSignature: What Type of Music Do You Like?

Day 3 (Wednesday)

• Convolutional Reverberation
• CNNs
• Variational Autoencoders
• Music tone generation with a pitch-conditioned VAE

• Guest speaker talk by Charis Cochran

  • Exploring Contextual Timbre Representation

Day 4 (Thursday)

• TDB

• Guest speaker talk by Richa Namballa

  • Investigating Bell Patterns in Candomblé from Historical Field Recordings

Day 5 (Friday)

• TDB

• Guest speaker talk by Hegel Pedroza

  • Leveraging Electric Guitar Tones and Effects to Improve Robustness in Guitar Tablature Transcription Modeling

Day 6 (Monday)

• TDB

• Guest speaker talk by Saksham Singh

  • Dataset distillation for audio-visual tasks

Day 7 (Tuesday)

• TDB

• Guest speaker talk by Francesca Ronchini

  • Text-to-Audio GenAI: Opportunities and Challenges in Music Production and Audio Content Generation

Day 8 (Wednesday)

• TDB

• Guest speaker talk by Klavdia Zemlianova

  • Dynamical mechanisms of how an RNN keeps a beat, uncovered with a low-dimensional reduced model

Day 9 (Thursday)

• TDB

• Guest speaker talk by Changan Chen

  • 4D Audio-Visual Learning: A Visual Perspective of Sound Propagation and Production

Day 10 (Friday)

• Workshop participant final presentations