Solved by markdaoust in post #3 
              
              
                There’s an option to use this layer by passing the memory to call instead of init: 



The way I’ve set this up, it receives the normalized inputs whereas it should be receiving the LSTM hidden layer inputs, no? 

IIUC The AttentionWrapper is implementing something similar to this decoder but wrapp…