Thanks for the reply, I’m now using:
optimizer = optim.Adam(model.parameters(), lr=0.01)
scheduler = optim.lr_scheduler.StepLR(optimizer, step_size=1, gamma=0.1)

and for training I simply include the line:
scheduler.step()
under the for epoch in range(25): loop.
I will update once it has undergone all it’s iterations…
UPDATE:
That hasn’t had an affect on improving training accuracy unfortunately, but thanks for pointed out that bug