I don’t know if this helps, but when I had the zero loss problem, it was due to not normalizing the input image data before transforming it into a tensor. This may or may not be your solution.
PyTorch has the below feature to normalize input values.
](https://pytorch.org/docs/stable/_modules/torchvision/transforms/transforms.html#Normalize) 2``