Machine Learning, Deep Learning, Artificial Intelligence, NLP, AI.
process unstable and convergence is very slow. The SeqGAN paper attempts to speed-up the training by pre-training both the generator and discriminator as standard language models using MLE. Also, policy gradient methods tend to converge to a local maxima, especially in cases such as ours where the