Solved by Topsoil in post #10 
              
              
                So, after some more testing, i came to a conclusion: 
My model (and model from dcgan pytorch tutorial i switched to) did not have enough capacity for dataset i was using. After switching to CelebA dataset, model worked as is it was suppose to. My theory is that because of high variety of images in l…