*Dr. Tiziana Ligorio

Hunter College of The City University of New York*

Notation

Activation functions

Losses

SGD

Backpropagation

Weight Initialization

Other activation functions

Batch normalization

Gradient clipping

Other optimizers

Regularization

The Perceptron

image by Gèron

Neural Network

Dense (Fully Connected) Layer: a layer of neurons where all neurons in one layer are connected to every neuron in the previous layer (e.g. the input neurons).

image by Gèron