Hi @Erhan, thank you for your reply. I was trying to use a batch size=20 (10 positive + 10 negative samples). Moreover, the input features are already normalised according to min-max and I switched to leaky relu wrt sigmoid as I’m using CrossEntropyLoss criterion with two classes rather than BCE, do you think this could be a problem?
I will try to enlarge my hidden units. Thank you, I really appreciate if you can say me more about the previous points.