AI

Gradient Descent

Category

Machine Learning

Definition

An optimization algorithm that finds the minimum of a loss function by iteratively moving in the direction of steepest descent. Fundamental to training neural networks and machine learning models.

tl;dr
An optimization algorithm that finds the minimum of a loss function through iterative descent.