@smth, thanks for the kind words 
Just a quick update, I added the repeat-copy task and the results are aligned with the paper. I also added some fixes and additional plots.
Github: PyTorch NTM 84
Here’s an animated GIF that shows how the network learns to predict the targets for the repeat-copy task. Specifically, the network was evaluated in each checkpoint that was saved during training (with the same input sequence).
          
            
           6