Also I noticed lucidrains has a pretty awesome repo that should help so we can pull some items from it as well: DALLE-pytorch 3

Yeah, the linked discussion and the VQGAN idea is from the DALLE-pytorch repo 
Also, this just dropped GitHub - google-research/xmcgan_image_generation 18