ECE/CS 434 : Spring 2023 : M/W 3-4:20pm : Room 3031 CIF : Zoom link


First day information

<aside> <img src="/icons/music-artist_yellow.svg" alt="/icons/music-artist_yellow.svg" width="40px" /> What’s pending? 🔴  MP6 due … get going

</aside>


Course Calendar (subject to change)

Date 🟢 Foundations and 🟡 Algorithms Topics / Applications / Links Video Notes HW (individual) MP (individual)
Jan 18 Introduction https://youtu.be/SGUCcjHTmGY
(game demo starts ~ 12m) https://courses.grainger.illinois.edu/ece434/sp2023/videos/L1.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/L1_slides.pdf
Jan 23 🟢 Linear algebra 1 Vector space, linear independence, Ax = b https://courses.grainger.illinois.edu/ece434/sp2023/videos/L2.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L2_pre_notes.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L2_post_notes.pdf https://courses.grainger.illinois.edu/ece434/sp2023/mp/MP1_data_visualization.zip
Jan 25 🟢 Linear algebra 2 Solve Ax=b, singular A, null space, orthogonal vectors. https://courses.grainger.illinois.edu/ece434/sp2023/videos/L3.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L3_pre_notes.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L3_post_notes.pdf
Jan 30 🟢 Linear algebra 3 Basis, Dimension, Norm, etc.
Least squares, Eigenvectors. https://courses.grainger.illinois.edu/ece434/sp2023/videos/L4.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L4_pre_notes.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L4_post_notes.pdf https://courses.grainger.illinois.edu/ece434/sp2023/hw/HW1.pdf
Feb 1 🟢 Signals processing 1 Eigenbasis, Diagonalization
Discrete Fourier Transform (DFT) https://courses.grainger.illinois.edu/ece434/sp2023/videos/L5.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L5_pre_notes.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L5_post_notes.pdf
Feb 6 🟢 Signals processing 2 DFT equation. IDFT. Magnitude and phase. Example (Cos) https://courses.grainger.illinois.edu/ece434/sp2023/videos/L6.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L6_pre_notes.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L6_post_notes.pdf MP1 due
Feb 8 🟢 Signals processing 3 Examples ($e^x$, Sin), real FFT, freq. resolution, N-point FFT, incomplete cycle, STFT https://courses.grainger.illinois.edu/ece434/sp2023/videos/L7.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L7_pre_notes.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L7_post_notes.pdf
Feb 13 🟢 Signals processing 4 Properties of DFT (linear, symmetric, shift), Nyquist https://courses.grainger.illinois.edu/ece434/sp2023/videos/L8.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L8_pre_notes.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L8_post_notes.pdf HW1 due https://courses.grainger.illinois.edu/ece434/sp2023/mp/MP2_DUET.zip
Feb 15 🟡 Source Separation algorithm: DUET
Mixing matrix, underdetermined system, DUET algorithm https://courses.grainger.illinois.edu/ece434/sp2023/videos/L9.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L9_pre_slides.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L9_post_slides.pdf https://courses.grainger.illinois.edu/ece434/sp2023/hw/HW2.pdf
Feb 20 🟢 Probability and random vectors to data Random vectors, data as random vectors, correlated/independent https://courses.grainger.illinois.edu/ece434/sp2023/videos/L10.mp4
http://croy.web.engr.illinois.edu/teach_global_videos/ProbabilityTip.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L10_pre_notes.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L10_post_notes.pdf
Feb 22 🟢 Probability and random vectors to data
🟡 Trilateration, Signal detection (correlation) Data statistics, conditional indep., GPS, trilateration https://courses.grainger.illinois.edu/ece434/sp2023/videos/L11.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L11_post_notes_a.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L11_post_notes_b.pdf
Feb 27 🟡  Frequency Modulated Carrier Wave (FMCW) Cross-correlation.
Sine sweep, mixing, FMCW https://courses.grainger.illinois.edu/ece434/sp2023/videos/L12.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L12_post_notes.pdf
see demo https://youtu.be/uJkQzLjYBFI MP2 due
https://courses.grainger.illinois.edu/ece434/sp2023/mp/MP3_PDR.zip
Mar 1 🟡 3D pedestrian dead reckoning (PDR) algorithms IMU data, 3D orientation https://courses.grainger.illinois.edu/ece434/sp2023/videos/L13.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L13_post_slides.pdf HW2 due
Mar 6 🟢 Singular Value Decomposition (SVD)
🟡 Recommendation algorithm A = $U \Sigma V^T$ , collaborative filtering, eigen-users https://courses.grainger.illinois.edu/ece434/sp2023/videos/L14.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L14_post_notes.pdf https://courses.grainger.illinois.edu/ece434/sp2023/hw/HW3.pdf
Mar 8 🟢 SVD proofs, PCA, Gradient Descent Proofs in SVD, PCA, Hessian, convex functions, PSD, GD https://courses.grainger.illinois.edu/ece434/sp2023/videos/L15a.mp4
https://courses.grainger.illinois.edu/ece434/sp2023/videos/L15b.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L15_post_notes.pdf
Mar 13 Spring break
Mar 15 Spring break
Mar 20 🟡 Unsupervised Localization (UnLoc)
🟢 Max. Likelihood (MLE) UnLoc iterative algorithm
Max likelihood estimator https://courses.grainger.illinois.edu/ece434/sp2023/videos/L16.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L16-post-notes.pdf MP3 due
Mar 22 🟡 Beamforming, AoA: Delay sum, Radiation pattern, near and far field, delay and sum, AoA https://courses.grainger.illinois.edu/ece434/sp2023/videos/L17.mp4
https://courses.grainger.illinois.edu/ece434/sp2023/videos/L17_GCC.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L17_pre_notes.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L17-post-notes.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L17_GCC_notes.pdf https://courses.grainger.illinois.edu/ece434/sp2023/mp/MP4_AoA_BF.zip
Mar 27 🟡 Beamforming: GCC, MUSIC
🟡 Minimum Variance Distortion-less (MVDR) MVDR beamformer, Sub-space methods, spatial smoothing https://courses.grainger.illinois.edu/ece434/sp2023/videos/L18.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L18_pre_notes.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L18_post_notes.pdf HW3 due
Mar 29 🟡 Time of Flight (ToF) estimation
🟡 DS, ADS Two way ranging (TWR) techniques ToF from two-way ranging, clock drift, 3-way ranging, ADS-TWR https://courses.grainger.illinois.edu/ece434/sp2023/videos/L19.mp4 https://rrc-uiuc.notion.site/L19-Time-of-Flight-ToF-Estimation-b6c29fb8c70f462894d9b81d219218d5
Apr 3 🟡 Sensor Fusion: Hidden Markov Models (HMM) 1 Graphical models, Markov proc., conditional indep., prediction https://courses.grainger.illinois.edu/ece434/sp2023/videos/L20.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L20_post_notes.pdf https://courses.grainger.illinois.edu/ece434/sp2023/hw/HW4.pdf
Apr 5 🟡 Hidden Markov Models (HMM) 2 Factorization, forward and backward, dynamic program https://courses.grainger.illinois.edu/ece434/sp2023/videos/L21.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L21_pre_notes.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L21_post_notes.pdf MP4 due
https://courses.grainger.illinois.edu/ece434/sp2023/mp/MP5_HMM.zip
Apr 10 🟡 HMM applications
🟡 Kalman filters HMM applications, Kalman problem setup, Kalman gain https://courses.grainger.illinois.edu/ece434/sp2023/videos/L22.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L22_post_notes.pdf
Apr 12 🟡 Kalman filter Predict and update equations
See tutorial https://web.mit.edu/kirtley/kirtley/binlustuff/literature/control/Kalman filter.pdf https://courses.grainger.illinois.edu/ece434/sp2023/videos/L23.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L23_post_notes.pdf
Apr 17 🔥 Midterm Review Review and example questions https://illinois.zoom.us/rec/share/I1KN0biDBudplZT5YaDf0MixgLLb_3dUpyKeOzbuJJa2QK0fTTHhS3PwEnMsvVz7.AlGYqtfsWPN-HsPb
Apr 19 🔥 Review gradient descent Gradient, Hessian, Convex fns, Cauchy Schwarz, GD algo. Watch
L15_video2 See last 5 pages of
L15_post_notes HW4 due MP5 due
Apr 24 🔥 Midterm https://courses.grainger.illinois.edu/ece434/sp2023/mp/MP6_DTW.zip
Apr 26 🟡 Dynamic Time Warping (DTW) Cost of path, Dynamic program, constraints on admissible paths http://courses.grainger.illinois.edu/ece434/sp2023/videos/L26.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L26_post_notes.pdf
May 1 🟡 Independent Component Analysis (ICA)
🟡 Expectation Maximization (EM) Independent sources, KL-Div., ICA, Expected Likelihood, EM http://courses.grainger.illinois.edu/ece434/sp2023/videos/L27.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L27_post_notes_a.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L27_post_notes_b.pdf
May 3 🎉 Videos, Demos, Wrap-up, Open discussion Assorted topics http://courses.grainger.illinois.edu/ece434/sp2023/videos/L28.mp4 http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L28_video_demos.pdf
http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L29.pdf
May 4 Reading day MP6 due

Midterm

L2_pre_notes.pdf

L2_post_notes.pdf

L3_pre_notes.pdf

L3_post_notes.pdf

L4_pre_notes