ECE/CS 434 : Spring 2024 : M/W 3:30-4:50pm : Room 2100 Sydney Lu Mech. Eng. Building : Zoom link, password: this year, 4 digits
| Date | 🟢 Foundations and 🟡 Algorithms | Topics / Applications | Additional reading | Video | Notes | HW (individual) | MP (individual) | | --- | --- | --- | --- | --- | --- | --- | --- | | Jan 17 W | Introduction | Course content and logistics | OpenAI Codex live demo (demo starts ~ 12min) | L1_video | L1_slides.pdf | | | | Jan 22 M | 🟢 Linear algebra 1 | Vector space, linear independence, Ax = b | | L2_video | L2_pre_notes L2_post_notes | | MP1 (Jupyter) | | Jan 24 W | 🟢 Linear algebra 2 | Solve Ax=b, singular A, null space, orthogonal vectors. | Private audio paper uses Null space of channel matrix | L3_video | L3_pre_notes L3_post_notes | | | | Jan 29 M | 🟢 Linear algebra 3 | Basis, Dimension, Norm, etc. | | L4_video 🔥 on Wifi | L4_pre_notes L4_post_notes | HW1 (Lin. Alg.) | | | Jan 31 W | 🟢 Signals processing 1 | Least squares, Eigenvectors, Eigenbasis, Diagonalization | | L5_video | L5_pre_notes L5_post_notes | | | | Feb 5 M | 🟢 Signals processing 2 | DFT basics, DFT equation. IDFT. | | L6_video | L6_pre_notes L6_post_notes | | MP1 due | | Feb 7 W | 🟢 Signals processing 3 | Mag and phase, bandwidth, Example: (Cos, $e^x$, Sin) | | L7_video | L7_pre_notes L7_post_notes | | MP2 (DUET) | | Feb 12 M | 🟢 Signals processing 4 | Real FFT, freq. resolution, N-point FFT, incomplete cycle, STFT Properties of DFT (linear, symmetric, shift), Nyquist | Video on STFT | L8_video | L8_pre_notes L8_post_notes | HW1 due | | | Feb 14 W | 🟡 Source Separation basics | A. Nyquist sampling B. Source separation basics, mixing matrix, AoA | DUET algorithm video DUET paper | L9_video | L9_pre_slides L9_post_notesA L9_post_notesB | HW2 (DSP + Prob.) | | | Feb 19 M | 🟡 Source Separation algorithm: DUET 🟢 Probability and random vectors to data | DUET algorithm Random vectors, data as random vectors, correlated/independent | Online book chapters
| L10_video | L10_pre_notes L10_post_notesA L10_post_notesB | | | | Feb 21 W | 🟢 Probability and random vectors to data | Data statistics, conditional indep., | Probability tip video | L11_video | L11_post_notes | | | | Feb 26 M | 🟡 Trilateration, Signal detection (correlation) | GPS, trilateration Cross-correlation. | linearization video | L12_video | L12_post_notes | | MP2 due MP3 (PDR) | | Feb 28 W | 🟡 Frequency Modulated Carrier Wave (FMCW) | Sine sweep, mixing, FMCW | see FMCW demo video | L13_video | L13_post_notes | HW2 due | | | Mar 4 M | 🟡 3D pedestrian dead reckoning (PDR) | IMU data, 3D orientation, PDR | | L14_video | L13_post_slides | HW3 (SVD, GD, MLE) | | | Mar 6 W | 🟢 Singular Value Decomposition (SVD) | A = $U \Sigma V^T$ , collaborative filtering, eigen-users | | L15_video | L14_post_notes | | | | Mar 11 M | Spring break | | | | | | | | Mar 13 W | Spring break | | | | | | | | Mar 17 S | Spring break | | | | | | MP3 due | | Mar 18 M | 🟢 SVD proofs, PCA, Gradient Descent | Proofs in SVD, PCA, Hessian, convex functions, PSD, GD | Video on gradient descent: L16_video_2 | L16_video | L16_post_notes | | MP4 (AoA + BF) steer_notes | | Mar 20 W | 🟡 Unsupervised Localization (UnLoc) 🟢 Max. Likelihood (MLE) | UnLoc iterative algorithm Max likelihood estimator | | L17_video | L16_pre_slides
| | | | Mar 25 M | 🟡 Beamforming, AoA: Delay sum | Radiation pattern, near and far field, delay and sum, AoA. | | L18_video | L18_pre_notes L18_post_notes | HW3 due | | | Mar 27 W | 🟡 Beamforming: GCC, MUSIC 🟡 Minimum Variance Distortion-less (MVDR) | MVDR beamformer, Sub-space methods, spatial smoothing | See MUSIC intuition here 🤔 | L19_video | L19_pre_notes L19_post_notes | HW4 (Assorted, Apps) | | | Apr 1 M | 🟡 Time of Flight (ToF) estimation 🟡 DS, ADS Two way ranging (TWR) techniques | ToF from two-way ranging, clock drift, 3-way ranging, ADS-TWR | | L20_video | L19_notion_notes | | MP5 (HMM) | | Apr 3 W | 🟢 Sensor Fusion: Hidden Markov Model (HMM) | Graphical models, Markov proc., conditional indep., prediction | | L21_video | L20_notes | | MP4 due | | Apr 8 M | 🟢 Hidden Markov Models (HMM) 2 | Factorization, forward and backward, dynamic program | | L22_video | L21_pre_notes L21_post_notes | | | | Apr 10 W | 🟡 HMM applications 🟢 Kalman filters | HMM applications, Kalman problem setup, Kalman gain | Tutorial on Kalman Filter | L23_video | L23_pre_notes L23_post_notes | HW4 due | | | Apr 15 M | 🟢 Kalman filters#2 🔥 Midterm Review | Predict and update equations Review and example questions | | L24_video | | | MP5 due | | Apr 17 W | 🟡 Midterm review | | | L25_video | | | MP6 (DTW or LMS) | | Apr 22 M | 🔥 Midterm | | | | | | | | Apr 24 W | 🟡 Dynamic Time Warping (DTW) | Cost of path, Dynamic program, constraints on admissible paths | | L26_video | L26_post_notes | | | | Apr 29 M | 🟡 Expectation Maximization (EM) | Expected Likelihood, Posterior, EM | EM Tutorial by D. Lin (PDF) | L27_video | L27_pre_notes L27_post_notes | | | | May 1 W | 🎉 Videos, Demos, Wrap-up, Open discussion | Assorted topics | | L28_video | L28_slides | | MP6 due | | May 2 | Reading day | | | | | | |