kakrafoon:

the original paper combines computes alignment of the encoder hidden unit (h) with the decoder hidden unit (s) [they call it a(s_{i-1}.h_j), while the tutorial seems to do a(s_{i-1}, y_{j-1}) where y is the output


I had the same question. It looks like it is different, but I’d love some confirmation, and also reason for doing it that way (is that from a different paper/implementation).