It looks like pytorch initializes weights of models by default with FloatTensors. However, I would like to have DoubleTensors. I initialize my weights with
def weight_init(self):
      for module in self.modules():
        if (isinstance(module, nn.Conv3d) or isinstance(module, nn.Linear)):
          init.orthogonal_(module.weight)

What is a proper way to initialize a model’s weights with DoubleTensors? Or is this generally not recommended?
Thanks for any help.