thank you for your reply @gphilip
Suppose the batch size if 4. Then the loss would be something like [0,443, 0,54, 0,21, 0,534]. Each loss would correspond to the respective inputs in the batch. I want to propagate the loss backward to the network for each input.
I do not know how to do that, and I do not know whether what you suggested would do that.
Does it perform the same thing ?