Hey 
I’m doing actually a similar thing for my bachelorthesis. My GAN has to work with CNNs and an additional context vector, which I haven’t implemented yet.
I tried to build a GAN with STGCN. That are CNNs for spatio temporal data. They use non square kernelsizes for the convolution.