This code works for PyTorch 0.4.0:
optimizer = optim.SGD([torch.randn(10, requires_grad=True)], lr=1e-1)
scheduler = optim.MultiStepLR(optimizer, [5, 10], 0.1)
print(scheduler.state_dict())

Which version are you using?