Gradient descent

The core optimisation method used to train most AI models: an algorithm that repeatedly nudges a model's parameters in the direction that reduces its errors, measured by a loss function, until performance stops improving. It is called "descent" because it can be pictured as taking small steps downhill on an error landscape towards the lowest point. (See also: Backpropagation, Loss function)