Deep Learning for Music Information Retrieval

Day 1 (Monday)

• Clasroom introductions
• MIRdata
• Project brainstorm + literature seach

• Review:

  • Linear algebra (at least sections 1, 2, and most of 3)
  • Chain rule
• Dimensionality reduction with PCA
• MIRdata & PCA

• Guest speaker talk by Elena Georgieva

  • TOTAL VARIATION IN VOCALS OVER TIME

Day 2 (Tuesday)

• Reading: Automatic Identification of Instrument Classes in Polyphonic and Poly-instrument Audio
• Linear and logistic regression
• Softmax & gradient descent
• Cross-validation
• Evaluation metrics

• Guest speaker talk by Néstor Nápoles López

  • Augmentednet: a roman numeral analysis network with synthetic training examples and additional tonal tasks

Day 3 (Wednesday)

• Feed forward neural network
• Project work

• Guest speaker talk by Valerio Velardo:

  • The Sound of AI accelerator

Day 4 (Thursday)

• Probability review
• Variational autoencoders
• KL divergence
• Encoding variational electric guitar effects

• Guest speaker talk by Francesca Ronchini

  • Insights into Soundscape Synthesis and Energy consumption of Sound Event Detection systems

Day 5 (Friday)

• CNN
• GRU
• Attention

• Guest speaker talk by Ellie Abrams

  • Retrieving musical information from neural data: how cognitive features enrich acoustic ones

Day 6 (Monday)

• RAVE

• Guest speaker talk by Daniel Faronbi:

  • Exploring Approaches to Multi-Task Automatic Synthesizer Programming

• other relevant papers:

  • Flow Synthesizer: Universal Audio Synthesizer Control with Normalizing Flows
  • DDX7: Differentiable FM Synthesis of Musical Instrument Sounds

Day 7 (Tuesday)

• Contrastive Audio-Language Learning for Music
• Wav2CLIP
• CLIPcap

Day 8 (Wednesday)

• Sound of Pixels
• How to Listen? Rethinking Visual Sound Localization
• Flowgrad

• Guest speaker talk by Adrian S. Roman:

Day 9 (Thursday)

* *

Day 10 (Friday)

• Guest speaker talk by Giovana Morais:

  • Tempo vs. Pitch: Understanding Self-supervised Tempo Estimation
    
    

• Workshop participant final presentations