Understanding Optimizers and Learning Rates in TensorFlowThe optimizer determines the mechanism of the weight updates, the learning rate controls the magnitude of these updates.