Few videos that upgrade this code bit by bit:
_1. upgrade to use idiomatic pytorch Modules, rather than kind of inline function stuff:
pytorch seqtoseq, revised v2, idiomatic pytorch modules
_2. upgrade to use timestep batching, in the encoder:
pytorch seqtoseq, revised v2, batch timesteps
_3. upgrade to use minibatches, in both encoder and decoder:
pytorch seqtoseq, revised v3, minibatches
Links to the relevant source-code are included in the youtube descriptions, but they’re basically different commits of : https://github.com/hughperkins/pub-prototyping/blob/master/papers/attention/seq2seq_noattention_trainbyparts.py 2