I might be wrong here, but I remember running into a similar problem before. I see you are wrapping your data in the Variable. Could you try removing that and maybe pass the data to the model just as tensors and see if it changes?