Hi @Bassel,
I’d recommend looking at the following for the current state (“not included”) and the various ways to do it with current torch (be sure to read the later posts to match current pytorch versions):

  
    
    
    Adaptive learning rate 
  
  
    How do I change the learning rate of an optimizer during the training phase? 
thanks
  


Best regards
Thomas