Solved by eqy in post #2 
              
              
                I think there is an error in the accuracy calculation, as the equality comparison is done twice. 
                    pred_labels = (pred_label == labels).float()

                    batch_accuracy = (pred_labels == labels).sum().item()/input.size(0)

should probably be 
                    pred_la…