The shapes of your model output and target seem to be alright for nn.CrossentropyLoss.
Did you remove the sigmoid in your model, as nn.CrossEntropyLoss expects logits, not probabilities.
If the loss is a constant zero, could you visualize some target and prediction images?
Just call pred = torch.argmax(output, 1) to get the model prediction.