At the moment there is not much no. If your weights are large enough that shouldn’t be a problem.
But we are working on improving that see the work in progress (so subject to heavy change!!) optimizers: https://github.com/pytorch/pytorch/blob/master/torch/optim/_multi_tensor/sgd.py 10