in summary:
You cannot use the maxpool2d & unpool2d in a VAE or CVAE if you want to explore the latent space ‘z’ in the decoder module independetly of the encoder, becayuse there is no way of generating the indices tensors independently for each input into the decoder module.
This is because the indices tensors are different for each input into the encoder module.
I have to find an alternative architecture.