ECE/CS 434 : Spring 2024 : M/W 3:30-4:50pm : Room 2100 Sydney Lu Mech. Eng. Building : Zoom link, password: this year, 4 digits
| Date | 🟢 Foundations and 🟡 Algorithms | Topics / Applications | Additional reading | Video | Notes | HW (individual) | MP (individual) | | --- | --- | --- | --- | --- | --- | --- | --- | | Jan 17 W | Introduction | Course content and logistics | https://youtu.be/SGUCcjHTmGY (demo starts ~ 12min) | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L1.mp4 | https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | | | | Jan 22 M | 🟢 Linear algebra 1 | Vector space, linear independence, Ax = b | | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L2.mp4 | http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L2_pre_notes.pdf https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | | https://courses.grainger.illinois.edu/ece434/sp2024/mp/MP1_data_visualization.zip(Jupyter) | | Jan 24 W | 🟢 Linear algebra 2 | Solve Ax=b, singular A, null space, orthogonal vectors. | Private audio https://arxiv.org/pdf/1811.07065.pdf uses Null space of channel matrix | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L3.mp4 | http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L3_pre_notes.pdf https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | | | | Jan 29 M | 🟢 Linear algebra 3 | Basis, Dimension, Norm, etc. | | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L4.mp4 🔥 on Wifi | http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L4_pre_notes.pdf https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | https://courses.grainger.illinois.edu/ece434/sp2024/hw/HW1.pdf (Lin. Alg.) | | | Jan 31 W | 🟢 Signals processing 1 | Least squares, Eigenvectors, Eigenbasis, Diagonalization | | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L5.mp4 | https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | | | | Feb 5 M | 🟢 Signals processing 2 | DFT basics, DFT equation. IDFT. | | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L6.mp4 | https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | | MP1 due | | Feb 7 W | 🟢 Signals processing 3 | Mag and phase, bandwidth, Example: (Cos, $e^x$, Sin) | | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L7.mp4 | http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L7_pre_notes.pdf https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | | https://courses.grainger.illinois.edu/ece434/sp2024/mp/MP2_DUET.zip | | Feb 12 M | 🟢 Signals processing 4 | Real FFT, freq. resolution, N-point FFT, incomplete cycle, STFT Properties of DFT (linear, symmetric, shift), Nyquist | https://youtu.be/-Yxj3yfvY-4 on STFT | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L8.mp4 | http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L8_pre_notes.pdf https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | HW1 due | | | Feb 14 W | 🟡 Source Separation basics | A. Nyquist sampling B. Source separation basics, mixing matrix, AoA | DUET algorithm https://courses.grainger.illinois.edu/ece434/sp2023/videos/L9.mp4 DUET https://ieeexplore.ieee.org/document/1306640 | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L9.mp4 | http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L9_pre_slides.pdf https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | https://courses.grainger.illinois.edu/ece434/sp2024/hw/HW2.pdf (DSP + Prob.) | | | Feb 19 M | 🟡 Source Separation algorithm: DUET 🟢 Probability and random vectors to data | DUET algorithm Random vectors, data as random vectors, correlated/independent | Online https://www.probabilitycourse.com/chapter8/8_2_0_point_estimation.php
| https://courses.grainger.illinois.edu/ece434/sp2024/videos/L10.mp4 | http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L10_pre_notes.pdf https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | | | | Feb 21 W | 🟢 Probability and random vectors to data | Data statistics, conditional indep., | Probability tip http://croy.web.engr.illinois.edu/teach_global_videos/ProbabilityTip.mp4 | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L11.mp4 | https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | | | | Feb 26 M | 🟡 Trilateration, Signal detection (correlation) | GPS, trilateration Cross-correlation. | linearization https://youtu.be/X8uIMepR2uw?list=PLGvhNIiu1ubyEOJga50LJMzVXtbUq6CPo | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L12.mp4 | https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | | MP2 due https://courses.grainger.illinois.edu/ece434/sp2024/mp/MP3_PDR.zip | | Feb 28 W | 🟡 Frequency Modulated Carrier Wave (FMCW) | Sine sweep, mixing, FMCW | see FMCW demo https://youtu.be/uJkQzLjYBFI | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L13.mp4 | http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L12_post_notes.pdf | HW2 due | | | Mar 4 M | 🟡 3D pedestrian dead reckoning (PDR) | IMU data, 3D orientation, PDR | | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L14.mp4 | http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L13_post_slides.pdf | https://courses.grainger.illinois.edu/ece434/sp2024/hw/HW3.pdf(SVD, GD, MLE) | | | Mar 6 W | 🟢 Singular Value Decomposition (SVD) | A = $U \Sigma V^T$ , collaborative filtering, eigen-users | | https://courses.grainger.illinois.edu/ece434/sp2023/videos/L14.mp4 | http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L14_post_notes.pdf | | | | Mar 11 M | Spring break | | | | | | | | Mar 13 W | Spring break | | | | | | | | Mar 17 S | Spring break | | | | | | MP3 due | | Mar 18 M | 🟢 SVD proofs, PCA, Gradient Descent | Proofs in SVD, PCA, Hessian, convex functions, PSD, GD | Video on gradient descent: https://courses.grainger.illinois.edu/ece434/sp2024/videos/L16_GD.mp4 | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L16.mp4 | http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L15_post_notes.pdf | | https://courses.grainger.illinois.edu/ece434/sp2024/mp/MP4_AoA_BF.zip https://file.notion.so/f/f/3706da0d-3602-4308-9612-515b81b58956/c4a29895-02ae-430b-a487-35585af76804/434mp4notes.pdf?id=42185fc5-4d64-4e69-ae96-cd8fe5d6645b&table=block&spaceId=3706da0d-3602-4308-9612-515b81b58956&expirationTimestamp=1712174400000&signature=_Ukb68tHGRRhGwXZHfTV-I0Oaggmfu4OkldBCm91psA&downloadName=434mp4notes.pdf | | Mar 20 W | 🟡 Unsupervised Localization (UnLoc) 🟢 Max. Likelihood (MLE) | UnLoc iterative algorithm Max likelihood estimator | | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L17.mp4 | http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L16-post-notes.pdf
| | | | Mar 25 M | 🟡 Beamforming, AoA: Delay sum | Radiation pattern, near and far field, delay and sum, AoA. | | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L18.mp4 | http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L17_pre_notes.pdf https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | HW3 due | | | Mar 27 W | 🟡 Beamforming: GCC, MUSIC 🟡 Minimum Variance Distortion-less (MVDR) | MVDR beamformer, Sub-space methods, spatial smoothing | See MUSIC intuition https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e 🤔 | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L19.mp4 | http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L18_pre_notes.pdf https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | https://courses.grainger.illinois.edu/ece434/sp2024/hw/HW4.pdf(Assorted, Apps) | | | Apr 1 M | 🟡 Time of Flight (ToF) estimation 🟡 DS, ADS Two way ranging (TWR) techniques | ToF from two-way ranging, clock drift, 3-way ranging, ADS-TWR | | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L20.mp4 | https://rrc-uiuc.notion.site/b6c29fb8c70f462894d9b81d219218d5 | | https://courses.grainger.illinois.edu/ece434/sp2024/mp/MP5_HMM.zip | | Apr 3 W | 🟢 Sensor Fusion: Hidden Markov Model (HMM) | Graphical models, Markov proc., conditional indep., prediction | | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L21.mp4 | http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L20_post_notes.pdf | | MP4 due | | Apr 8 M | 🟢 Hidden Markov Models (HMM) 2 | Factorization, forward and backward, dynamic program | | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L22.mp4 | http://courses.grainger.illinois.edu/ece434/sp2023/notes/pre_notes/L21_pre_notes.pdf https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | | | | Apr 10 W | 🟡 HMM applications 🟢 Kalman filters | HMM applications, Kalman problem setup, Kalman gain | https://web.mit.edu/kirtley/kirtley/binlustuff/literature/control/Kalman filter.pdf on Kalman Filter | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L23.mp4 | https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | HW4 due | | | Apr 15 M | 🟢 Kalman filters#2 🔥 Midterm Review | Predict and update equations Review and example questions | | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L24.mp4 | | | MP5 due | | Apr 17 W | 🟡 Midterm review | | | https://courses.grainger.illinois.edu/ece434/sp2024/videos/L25.mp4 | | | https://courses.grainger.illinois.edu/ece434/sp2024/mp/MP6_DTW.zip | | Apr 22 M | 🔥 Midterm | | | | | | | | Apr 24 W | 🟡 Dynamic Time Warping (DTW) | Cost of path, Dynamic program, constraints on admissible paths | | https://illinois.zoom.us/rec/share/YmghYphnf3T9AiOPj69eAOThHqy33QQGkeTIY5DOMmv5fpT8DYIoGSEbMjysaUbb.8kk2yfRZ_6rmWe_o | https://rrc-uiuc.notion.site/Real-World-Algorithms-for-IoT-and-Data-Science-Sp24-1b94156dae404cb3a1c3e22073618d4e | | | | Apr 29 M | 🟡 Independent Component Analysis (ICA) 🟡 Expectation Maximization (EM) | Independent sources, KL-Div., ICA, Expected Likelihood, EM | EM https://courses.csail.mit.edu/6.867/wiki/images/b/b5/Em_tutorial.pdf | L27_video | | | | | May 1 W | 🎉 Videos, Demos, Wrap-up, Open discussion | Assorted topics | | L28_video | http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L28_video_demos.pdf http://courses.grainger.illinois.edu/ece434/sp2023/notes/post_notes/L29.pdf | | MP6 due | | May 2 | Reading day | | | | | | |