This is great, I’m happy you were able to port sketch-rnn over to pytorch.
I’d also recommend using LSTM along with Recurrent Dropout without Memory Loss 31, which involves a one-line change of code in LSTM, and also Layer Normalization 19. I found these two tricks helped a lot for LSTMs.