Gradient Descent
Category
•
Machine Learning
Definition
An optimization algorithm that finds the minimum of a loss function by iteratively moving in the direction of steepest descent. Fundamental to training neural networks and machine learning models.
tl;dr
An optimization algorithm that finds the minimum of a loss function through iterative descent.