Hi @jankunze, I updated my code with more code (for clarity).
Also, I tried using depth 5 (updated) too, it doesn’t help.  Loss decreases but not doesn’t affect accuracy.
Also, as for BCEWithLogitsLoss() , it has a sigmoid internally as discussed here 9.
Thank you for the response. I’ll look for more insights.