Deep Learning, Pytorch, Fine Tuning, Computer Vision, Transfer Learning.
computational resources available. Learning Rate, Momentum and Weight Decay While defining the optimizer we also have to set the learning rate(LR) which is a hyperparameter that determines the step size at each iteration during optimization. It controls how much the model’s parameters are updated