Could you post the shape of labels_new?
You could see an increased memory usage, if a broadcasting happens in predicted.eq(labels?new).
This would be the case, if predicted has a shape of [291600], while labels_new has [291600, 1].
The results of this operations would thus be [291600, 291600].