I wanted to verify parity, so had to have the same SGD as caffe. Otherwise PyTorch’s SGD is as good.



 mrTsjolder:

to get equivalent behaviour (if I don’t mistake)


Perhaps, but that also needs a new class anyways because you cannot just pass a modified lr to get that behavior.