What is Gradient Descent?

An optimization algorithm used to minimize the loss function by iteratively moving toward the minimum value.