Hey @aswamy,
The replies from @knoriy explains your situation better and is something that you should try out first. In case you need something extra, you could look into the learning rate schedulers.


Beginner friendly article 5 on it.


PyTorch documentation 1 (Scroll to “How to adjust learning rate” header)