Batch size looks like normal. CrossEntropyLoss combines Softmax and NLLLoss that mean apply softmax function to last layer. Softmax uses for multiclass classification problem. So it’s appropriate to use BCE loss rather than CrossEntropyLoss for binary classification. You train your neural network longer in these configurations and try different learning rates.