Solved by albanD in post #2 
              
              
                Hi, 
When you call .cuda() all the parameters and buffers of the module are moved to the gpu. 
Parameters are everything that you saved as self.foo = nn.Parameter(args). 
Buffers are any Tensor that you saved on self as self.bar = torch.rand(10). 
All this is done  in the __setattr__ functions of th…