Since, you have only two classes, better to use binary cross entropy as the loss function and change your last layer to self.fc3 = nn.Linear(84, 1) as it was initially.

BCE loss in pytorch -> torch.nn.BCELoss()