I’ve tried to scale it down, and it works. I am trying to train on only four one word examples, so I think there has to be an error in my code.
I’ve also switched to using the pytorch TransformerEncoder and TransformerDecoder. The same effect still happens.
Here is the new file. https://drive.google.com/open?id=1hiw35sL1nYZ8zh9bXNOfXjxHSIAErNL8 3
The train.from and train.to files are just text files where each line is a new example.