Hello,
I have this VAE model where I use BCE loss, when I use reduction=sum the loss is really big , but the results are good. When I use the default reduction, the loss is nearly 0 and the model doesn’t learn.
I don’t get how the both losses are related, I use a batch size of 64 and a dataset with 190000 images.
I wanted to compare both, but I can’t see a connection. I printed both out after the first batch, the summed loss is 2186383.5 and the element wise mean loss 0.695.