good point. However, when I remove the custom weight init, the model learns (weights and biases are being updated instead of frozen), so I would assume it should independent of the loss?
Side question: Which loss should then be used with softmax in the last layer?