yeah it’s always positive, but not necessarily above the error. For example, consider a 2-way classification problem, where the softmax output is always [0.5-eps, 0.5+eps], but the true label is always 0. Then the cross entropy loss is log 2 < 1, but the error is 1.