Solved by vmirly1 in post #5 
              
              
                @ptrblck  Isn’t it the other way around? I thought BCELoss needs to receive the outputs of Sigmoid activation as its input, but the other-one BCEWithLogitsLoss will need the logits as inputs instead of outputs of Sigmoid, since it will apply sigmoid internally. 
Although, the example in the docs do …