How to anneal LR of optimizer?
ritchieng
Cysu
Or you could just recreate the optimizer
apaszke
If you recreate the optimizer, would it lose its weights, it seems to be? What do you mean by recreate?
ritchieng