Deep Learning

Notes on neural networks, backpropagation, and modern architectures.

Deep Learning Fundamentals

Backpropagation from Scratch

Deriving backpropagation using the chain rule. With a working Python implementation.

Other

Multi Layer Perceptrons

Understanding Multi-Layer Perceptrons, network depth, and their theoretical capabilities as universal function approximators.

Modern Perceptron and Activations

A better way to visualize perceptron and activation units

Deep Learning History

The history of deep learning: from early cognitive models to modern neural networks.