HI, @colesbury, with latest pytorch master branch version,  the training still breaks down after hundreds of iterations. However if I roll back to 0.2.0 release version, the breakdown never occurs (with commit id 0b92e5c). It seems that this bug is related to pytorch version.
Since my project contains many codes, I will rewrite a simple example to reproduce this breakdown bug, and show it to you.