Schedule

Suggested Readings:

• Chapter 1 of the AI textbook by Russell and Norvig

Additional References

• Know your brain
• McCulloch-Pitts Neuron, 1943
• Hebbian Learning Princile by D. Hebb, 1949
• Neocognitron by Fukushima, 1980 and an excellent Video Demo
• Backprop for training NNs by Rumelhart et al. 1986
• Backprop applied to MNIST by Lecun, 1989
• AlexNet by Krizhevsky et al. 2012
• ResNet by He et al. 2015

Suggested Readings:

• Chapter-1 of Michael Nielson’s NNDL textbook
• Convergence proof for Perceptron
• MP Neuron

Suggested Readings:

• Chapter-1 of Michael Nielson’s NNDL textbook
• Chapter-4 and 5 of Bishops’ book

Suggested Readings:

• Chapter 4 of Michael Nielson’s NNDL book
• Deep Mind Blog on Universal Approximation Theorem
• Approximation by Superposition of Sigmoid Functions
• Approximation Capabilities of Muitilayer Feedforward Networks