Yes, the fc is a bit strange, but the paper I’m referencing doesn’t mention any activation functions in those layers. Will definitely experiment with adding activation functions and seeing if that makes a difference.
I’m currently using nn.BCELoss for my primary GAN loss (i.e. the real vs. fake loss), and a nn.CrossEntropyLoss for an additional multi-label classification loss. LSGAN uses nn.MSELoss instead, but that’s the only meaningful difference between it and other (e.g. DC)GAN.
Hmm, I’ll investigate using nn.LogSoftmax and see the results; out of interest, why is nn.LogSoftmax usually used?
Thanks again for the help!