Schedule

Event

Date

Description

Course Material
Lecture

07/27/2025
Sunday

(foml-00) Course logistics
[slides]
Lecture

07/28/2025
Monday

(foml-01) ML and Learning Paradigms
[slides]
Suggested Reading
- Chapter 1.0 and 1.1 from Bishop
- Chapter 1.1 to 1.4 from UML book
Lecture

07/30/2025
Wednesday

(foml-02) Probability Refresher - 1
[slides] [annotated-slides]
Suggested Reading
- Chapter 1.2.0 and 1.2.1 from Bishop
Lecture

07/31/2025
Thursday

(foml-03) Probability Refresher - 2
[slides] [annotated-slides]
Suggested Reading
- Chapter 1.2.2 and 1.2.4 from Bishop
Lecture

08/06/2025
Wednesday

(foml-04) MLE
[slides] [annotated-slides]
Suggested Reading
- Chapter 1.2.3 to 1.2.5 from Bishop
Lecture

08/07/2025
Thursday

(foml-05) MAP and Fully Bayesian Treatment
[slides] [annotated-slides]
Suggested Reading
- Chapter 1.2.5 and 1.2.6 from Bishop
Lecture

08/11/2025
Monday

(foml-06) Linear Regression with Basis functions
[slides] [annotated-slides]
Suggested Reading
- Chapter 3.1 from Bishop
- Chapter 9.2 from UML book
Lecture

08/13/2025
Wednesday

(foml-07) Geometric Interpretation for Least Squares
[slides] [annotated-slides]
Suggested Reading
- Chapter 3.1 from Bishop
- Chapter 9.2 from UML book
Lecture

08/13/2025
Wednesday

(foml-08) SGD
Suggested Reading
- earlier-slides
Lecture

08/14/2025
Thursday

(foml-09) Regularized Least Sqaures
[slides] [annotated-slides]
Suggested Reading
- Chapters 1.1, 1.3 and 3.1.4 from Bishop book
Lecture

08/21/2025
Thursday

(foml-10) Bias Variance Decomposition
[slides] [annotated-slides]
Suggested Reading
- Chapters 1.5.5, and 3.2 from Bishop book
Lecture

08/25/2025
Monday

(foml-11) Bayesian Regression
[slides] [annotated-slides]
Suggested Reading
- Chapters 2.3.3 and 3.3.1 from Bishop book
Lecture

08/25/2025
Monday

(foml-12) Decision Theory
[slides] [annotated-slides]
Suggested Reading
- Chapters 1.5 from Bishop book
Lecture

09/03/2025
Wednesday

(foml-13) Probabilistic Generative Models
[slides] [annotated-slides]
Suggested Reading
- Chapters 4.2 from Bishop book
Lecture

09/04/2025
Thursday

(foml-14) Probabilistic Generative Models - discrete features
[slides] [annotated-slides]
Suggested Reading
- Chapters 4.2.3 from Bishop book
Lecture

09/04/2025
Thursday

(foml-15) Discriminant Functions
[slides] [annotated-slides]
Suggested Reading
- Chapters 4.0, 4.1.1, and 4.1.2 from Bishop book
Lecture

09/08/2025
Monday

(foml-16) Discriminative Models - Least Squares Regression
[slides] [annotated-slides]
Suggested Reading
- Chapters 4.1.3 from Bishop book
Lecture

09/08/2025
Monday

(foml-17) Discriminative Models - The Perceptron
[slides] [annotated-slides]
Suggested Reading
- Chapters 4.1.7 from Bishop book
- Convergence proof for Perceptron
Lecture

09/15/2025
Monday

(foml-18) Classification with Basis Functions
[slides] [annotated-slides]
Suggested Reading
- Chapters 4.3.1 and 1.4 from Bishop book
Lecture

09/15/2025
Monday

(foml-19) Probabilistic Discriminative Models - Logistic Regression
[slides] [annotated-slides]
Suggested Reading
- Chapters 4.3.2 from Bishop book
Lecture

09/17/2025
Wednesday

(foml-20) Logistic Regression - SGD
[slides] [annotated-slides]
Suggested Reading
- Chapters 4.3.2 from Bishop book
Lecture

09/17/2025
Wednesday

(foml-21) Logistic Regression - Newton Raphson Optimization (IRLS)
[slides] [annotated-slides]
Suggested Reading
- Chapters 4.3.3 from Bishop book
Lecture

09/18/2025
Thursday

(foml-22) Neural Networks - I
[slides] [annotated-slides]
Suggested Reading
- Chapters 5 from Bishop book
Lecture

09/22/2025
Monday

(foml-23) Neural Networks - II
[slides] [annotated-slides]
Suggested Reading
- Chapters 5 from Bishop book
Lecture

09/24/2025
Wednesday

(foml-24) Neural Networks - III
[slides] [annotated-slides]
Suggested Reading
- Chapter 5 from Bishop book
Lecture

10/06/2025
Monday

(foml-25) Unsupervised Learning - 1
[slides]
Suggested Reading