Deep Learning

Notes on neural networks, backpropagation, and modern architectures.

Deep Learning Fundamentals

Backpropagation from Scratch

Deriving backpropagation using the chain rule. With a working Python implementation.

Other

Modern Perceptron and Activations

A better way to visualize perceptron and activation units

Deep Learning History

The history of deep learning: from early cognitive models to modern neural networks.