Differentiable Digital Signal Processing

Day 1 (Monday): The Discrete Fourier Transform

Lecture Topics:

• Digital audio signal
• Discrete Fourier Transform
• Inverse Discrete Fourier Transform
• Short Time Fourier Transform

Lecture Notes:

• Signal sampling & DFT

Guest Speaker:

• Julius O. Smith - Spectral Audio Signal Processing

Day 2 (Tuesday): Digital Filter Theory

CCRMA Tour

Lab Session:

• Data prep for DESREO

Lecture Topics:

• Convolution
• Finite Impulse Response Filters

Day 3 (Wednesday): Torch Dataloaders and IIR Filters

Lecture Topics:

• Infinite Impulse Response Filters
• Z Transform

Lecture Notes:

• Digital filters

Lab Session:

• Data loader for DESREO

Day 4 (Thursday): Onset, Beat, and Pitch Tracking

Lecture Topics:

• Onset Detection
• Tempo Analysis
• Beat Tracking

Lecture Notes:

• Onset, tempo, and beat

Reading:

• F0 Analysis of Ghanaian Pop Singing Reveals Progressive Alignment with Equal Temperament Over the Past Three Decades: A Case Study
• Convolutional Representation for Pitch Estimation

Day 5 (Friday): Chord and Music Representations

Lecture Topics:

• Chroma Feature
• Chord Recognition
• Hidden Markov Models

Lecture Notes:

• Chroma and HMM

Guest Speaker:

• Hegel Pedroza, Gerardo Meza - EGFxSet: Electric Guitar Tones Processed Through Real Effects of Distortion, Modulation, Delay and Reverb

Revelant Literature

Mathematics of the discrete fourier transform (DFT) with audio applications

Spectral audio signal processing

Digital signals theory

Fundamentals of music processing

DDSP: differentiable digital signal processing

F0 analysis of Ghanaian pop singing reveals progressive alignment with equal temperament over the past three decades: a case study

EGFxSet: electric guitar tones processed through real effects of distortion, modulation, delay and reverb