Dr. Tiziana Ligorio x CSCI 493.77 - Deep Learning, Hunter College of the City University of New York
Notation
Activation functions
Losses
SGD
Backpropagation
Weight Initialization
Other activation functions
Batch normalization
Gradient clipping
Other optimizers
Regularization
The Perceptron
image by Gèron
Neural Network
Dense (Fully Connected) Layer: a layer of neurons where all neurons in one layer are connected to every neuron in the previous layer (e.g. the input neurons).
image by Gèron