Solved by ptrblck in post #4 
              
              
                If you have the optimizer instance, you should be able to get its attributes via: 
optimizer.param_groups[0]['lr']

Your approach might work, but I would rather like to avoid manipulating the internal states.