Sorry to bump this post - but why can’t the OP use CE Loss with a Softmax layer? For example, I’m trying to do the same thing here (but convert it to a probability across 1000 classes (Imagenet), but it’s not training with CE Loss.