I use the no_grad guard to copy the parameters from the plain conv to the grouped conv layer. The grouped conv layer will still be trainable, but the parameter copy should not be tracked by Autograd (as it’ll raise an error as you’ve already seen).