if you mean the x in my forward passes x, then yes it is in fact on GPU 0, but i cant find any information on where self.conv1 is located (infact none of my module have any device information, only my tensors?)
No I dont use DataParallel.
I thought the problem occured in my forward pass at line 57 when calling y, z = getattr(self, key)(y_upsampled, z) since my debugger threw an error only when I passed it or when I digged deeper and ended up in the FRRU modules forward pass.