Two solutions/ideas come to mind to address this problem:

when computing the val loss, set volatile=True

many chatbot implementations that use Seq2Seq, coupled with the cornell movie dialog corpus, limit
the sequence length to ~20 words