Thanks a lot !
Yes, using recurrent dropout and layer normalization is on my TODO list. It seems to bet not yet implemented on Pytorch’s RNN modules, I will probably have to do my own.
Today I was busy finding a way to use the network to find and draw cats into clouds (with Canny edge detection):

chat2.svg.png844×608 210 KB

Finaly, we used a Baxter 1 robot to draw a cat inferred from the head of a Nao 4 robot. And this led us to realize this creepy video:
Baxter improvising from Nao's head