Solved by rasoolfa in post #3 
              
              
                Not really, just tried to use smaller model since my sequence was very long. 
Have look at this thread: https://github.com/pytorch/pytorch/issues/2267