Thank you for the fast reply! I tried several times the sigmoid function and nothing changed. The gradients values are very small and as a result the change of the weights and bias is neglectable, that’s why the loss function is the same during every epoch