No, it does not solve my issue. The reduce parameter only tells that the output of loss function need not be averaged. It does nothing with the gradients. I need to have a separate gradient for every data point.
Thanks.