Solved by ptrblck in post #5 
              
              
                Try to use grid.device instead. 

Might be and you should stick to your work flow, as I was just using it as an example.  
You could also try to register self.grid as a buffer using self.register_buffer, which would move the tensor automatically using model.to().