So, could you tell me what is different with SGD in pytorch and caffe?
If in pytorch, I use
optimizer = optim.SGD(model.parameters(), lr=0.01, weight_decay= 0.0005, momentum =0.9)


Then it will be in caffe. Am I right?
optimizer = CaffeSGD(model.parameters(), lr=0.01, weight_decay= 0.0005, momentum =0.9)