Solved by mailcorahul in post #2 
              
              
                The loss returned by criterion call will usually be average over all images in the batch. reduction parameter to the criterion decides whether to average or sum them.