Thanks for that 
It look’s like the DRAW I implemented in Torch years ago , without the VAE, and decoder/generative canvas.
I though you might like this, implementation of a GAN on Omniglot,
Code for training a GAN on the Omniglot dataset using the network described in:
Task Specific Adversarial Cost Function

  
      arxiv.org
  
  
    
1609.08661.pdf 22

2.19 MB

  
  
    
    
  
  



  
      
      GitHub
  
  
    

ToniCreswell/piGAN 36

Task Specific Adversarial Cost Function (Omniglot GAN) - ToniCreswell/piGAN