Thanks for testing my code. I do not get any ValueErrors.
My original implementation only had linear layers (no batchnorm or ReLU) and it still failed.
Changing it to nn.BatchNorm1d(1, affine=True) did not work and throws the error:
RuntimeError: running_mean should contain 64 elements not 1
So I do believe my usage was correct initially.
I will try to train without BatchNorm but only LeakyReLU and Linear layers. Did not help.
BTW I am using BCEWithLogitsLoss, so I am running the discriminator without any final activation function. Might have a hand in the issue.