The logits are the output of your model (raw prediction value without a softmax applied on them).
For the sake of debugging you could apply a softmax and check, the probabilities for each predicted class.
While the number of correctly predicted samples might be higher, the actual probability might be close to random, which would still yield a high loss. However, that’s a speculation at the moment, so you would need to check it.