During the VAE training,
I was comparing loss between (Input pic - Reconstructed pic)
and loss between (Input pic - Input pic).
Even though picture reconstruction is not done, I found out Loss between (Input pic - Reconstructed pic) will be smaller than the loss between (Input pic - Input pic)  during the training.
Does anyone know why this happens?
As the title shows, I’m using ‘only’ CrossEntropyLoss as a loss function.
(I’m not using KLdivergence )
Thank you.