Could you explain a bit about your target?
If you apply F.sigmoid, you should use BCELoss instead of BCEWithLogitsLoss.
Are your targets in the range [0, 1]? The sigmoid makes it quite hard for your model to predict values close to 0 and 1. So you could check MSELoss instead and see, if it’s better suited for your problem.