I assume skorch applied the log internally, since you are using softmax as the last activation function.
If that’s the case, I would recommend to play around with some hyperparameters, e.g. you could lower the learning rate and change the sigmoid for relu.