DDSP (not offered in 2024. To be updated for 2025)


drawing

Differentiable Digital Signal Processing

Day 1 (Monday): The Discrete Fourier Transform

Lecture Topics:

  • Digital audio signal
  • Discrete Fourier Transform
  • Inverse Discrete Fourier Transform
  • Short Time Fourier Transform

Lecture Notes:

Guest Speaker:

  • Julius O. Smith - Spectral Audio Signal Processing

Day 2 (Tuesday): Digital Filter Theory

CCRMA Tour

Lab Session:

Lecture Topics:

  • Convolution
  • Finite Impulse Response Filters

Day 3 (Wednesday): Torch Dataloaders and IIR Filters

Lecture Topics:

  • Infinite Impulse Response Filters
  • Z Transform

Lecture Notes:

Lab Session:

Day 4 (Thursday): Onset, Beat, and Pitch Tracking

Lecture Topics:

  • Onset Detection
  • Tempo Analysis
  • Beat Tracking

Lecture Notes:

Reading:

  • F0 Analysis of Ghanaian Pop Singing Reveals Progressive Alignment with Equal Temperament Over the Past Three Decades: A Case Study
  • Convolutional Representation for Pitch Estimation

Day 5 (Friday): Chord and Music Representations

Lecture Topics:

  • Chroma Feature
  • Chord Recognition
  • Hidden Markov Models

Lecture Notes:

Guest Speaker:

  • Hegel Pedroza, Gerardo Meza - EGFxSet: Electric Guitar Tones Processed Through Real Effects of Distortion, Modulation, Delay and Reverb

Revelant Literature

Mathematics of the discrete fourier transform (DFT) with audio applications

Spectral audio signal processing

Digital signals theory

Fundamentals of music processing

DDSP: differentiable digital signal processing

F0 analysis of Ghanaian pop singing reveals progressive alignment with equal temperament over the past three decades: a case study

EGFxSet: electric guitar tones processed through real effects of distortion, modulation, delay and reverb