Backpropagation

Backpropagation

The algorithm that makes gradient descent practical for neural networks: it calculates how much each individual parameter in the network contributed to an error, working backwards from the output layer to the input layer, so that every parameter can be adjusted by the right amount. Backpropagation, combined with gradient descent, is the standard method by which neural networks learn. (See also: Gradient descent, Neural network)