Yacine writes:

Haha actually I’ve worked on that a fair bit.
You probably want to be sampling rather than using beam search there
it works better for semi-supervised training with back-translation (got some pretty OK results on gigaword at least)