Paul1:

Is this an overfitting issue?


Overfitting would be visible via a gap between the training and validation accuracy and loss. Since you’ve only reported a (low) training accuracy I don’t think you can claim it’s overftting.



 Paul1:

After some research, I found out that if I use batchnorm, I should set the bias to false, is this the case for every convolution and linear layer?


You should disable the bias of conv and linear layers which are followed by batchnorm layers, as the mean subtraction would directly eliminate the bias. This is also a recommendation in the performance guide 1.