Find out why backpropagation and gradient descent are key to ... If we think of the loss function as being plotted on the graph, we want to move in increments toward the minimum of a function.