@ptrblck please check this : https://www.kaggle.com/mobassir/pytorch-transfer-learning-baseline 3
in version 1 of that notebook you can see after prediction predicted values other than 0 and 1 in submission file and  my linear layer is of shape (2048, 1).