" The loss calculation for nn.BCELoss looks wrong, as this criterion expects the model outputs to be probabilities provided via a sigmoid activation, while you are applying torch.max on it" yeah this was my bad as I just copied the current at the time code without checking that it works, I updated the code so now BCE looks good, but still loss don’t do down past 0.693.