Deep Learning, Pytorch, Fine Tuning, Computer Vision, Transfer Learning.
backward pass. scaler.step(optimizer): This method updates the optimizer's parameters using the gradients calculated during the backward pass. It performs an optimizer step as usual but takes into account the gradient scaling performed by the scaler. scaler.update(): This method adjusts the scale