test = torch.autograd.Variable(torch.randn([5,5]), requires_grad=True)
optimizer = torch.optim.Adam([test], lr = 0.0001)
lr_scheduler = torch.optim.lr_scheduler.StepLR(optimizer, step_size=100, gamma=0.1)
lr_scheduler.get_lr()

This code snippet gives me a learning rate of 0.001
I want to start the optimizer with LR = 1e-4, and schedule a decay of 0.1 every 100 epochs.
It seems like the LR Scheduler starts me off at 1e-3 instead.
Can someone clarify?
This happens on Torch 0.3.1 and 0.4.0.