As long as I understand, the loss function can provide the mean loss of batch data or the loss sum of batch data.
Currently, to get the individual loss at the evaluation mode, I use the batch size of one.
Is there any way to get the loss of each data from the batch while the batch size of larger than one is employed ?
Also, why is the loss value of the same input data different at each trial ? At the evaluation mode, are not the parameters fixed ?