Thanks. Yes its the only implementation I found other than the lua package released by the authors. I was looking for a Pytorch module which I could use off the shelf without getting into too much detail but it turns out I’ll have to. Could you comment on your perplexity score, vocabulary size and the relative speedup? Just curious if its worth the trouble.