Could you share the code? I’ve managed to train the later stages of a network whilst freezing the first few layers. It does sound weird but don’t give up just yet 
Does the optimizer have access to the discriminator parameters?