Here is the raw error message:

Original Traceback (most recent call last):
File “/opt/conda/lib/python3.6/site-packages/torch/nn/parallel/parallel_apply.py”, line 60, in _worker
output = module(*input, **kwargs)
File “/opt/conda/lib/python3.6/site-packages/torch/nn/modules/module.py”, line 541, in call
result = self.forward(*input, **kwargs)
File “/opt/conda/lib/python3.6/site-packages/apex/amp/_initialize.py”, line 197, in new_fwd
**applier(kwargs, input_caster))
File “/workspace/encoder-decoder/encoder_decoder.py”, line 29, in forward
decodeded_carrier = self.encoder_module(carrier, msg, carrier_seqlen)
File “/opt/conda/lib/python3.6/site-packages/torch/nn/modules/module.py”, line 541, in call
result = self.forward(*input, **kwargs)
File “/workspace/encoder-decoder/encoder.py”, line 44, in forward
encoded_audio = self.conv_layers(audio, lengths)
File “/opt/conda/lib/python3.6/site-packages/torch/nn/modules/module.py”, line 541, in call
result = self.forward(*input, **kwargs)
File “/workspace/encoder-decoder/mask_conv.py”, line 25, in forward
x = module(x)
File “/opt/conda/lib/python3.6/site-packages/torch/nn/modules/module.py”, line 541, in call
result = self.forward(*input, **kwargs)
File “/workspace/encoder-decoder/glu.py”, line 22, in forward
x1 = self.convx1a(padded_x)
File “/opt/conda/lib/python3.6/site-packages/torch/nn/modules/module.py”, line 541, in call
result = self.forward(*input, **kwargs)
File “/opt/conda/lib/python3.6/site-packages/torch/nn/modules/conv.py”, line 345, in forward
return self.conv2d_forward(input, self.weight)
File “/opt/conda/lib/python3.6/site-packages/torch/nn/modules/conv.py”, line 342, in conv2d_forward
self.padding, self.dilation, self.groups)
RuntimeError: Expected tensor for argument #1 ‘input’ to have the same device as tensor for argument #2 ‘weight’; but device 1 does not equal 0 (while checking arguments for cudnn_convolution)