Hi,
I am currently trying to train a GAN model in the context of machine translation.
My problem is similar to: GitHub - ngohoanhkhoa/GAN-NMT: Generative Adversarial Networks in Neural Machine Translation ; although they use TensorFlow and the data is different.
My problem is that during training the gradients of my generator are none, which basically means that the models do not train at all. The generator is based on a seq2seq (LSTM) model. The discriminator is a CNN. Both models rely on nn.embedding as a first step to encode the sequences I input into the models.
I tried to fix the problem for some time, without success. My assumption is that when I forward the generator output to the discriminator, which derives embeddings using nn.Embedding, some detachment takes place. Can this be the case?
Your help is highly appreciated. Thanks.
Best,
Robin