Hi,
I was trying to use the cosineAnnealing Learning rate but I was confused about what should be the T_max parameter be.
Whether it should be number of epochs, length of train_loader  or multiple of the two?
torch.optim.lr_scheduler. CosineAnnealingLR (optimizer , T_max , eta_min=0 , last_epoch=-1 , verbose=False )