Solved by pritamdamania87 in post #4 
              
              
                Do I also need to change this or does this “.to” work with nn.sequential (no separate forward function) as well? 

“.to” would work on nn.sequential, although you need to modify the forward function since once you have completed execution for the module on GPU0, the output will be on GPU0. Now sinc…