From the trace it sounds like the hidden state of the LSTM is a CPU tensor. It should be a CUDA tensor for this to work.
In LSTMTagger,

you should make sure the hidden states are on the gpu as well by calling .cuda() on them.