In my case I am working with multivariate time series data, and just like you said, I want to use batchnorm layers after each layer in the multi-layer LSTM.
I’ve did some research to find how to do it, but it says it’s not possible with the normal LSTM.
The only way to do it is to modify the LSTM so that a recurrent batchnorm (Article 16) can be applied, the implementation of the modified LSTM has been given in this Github repo 50.
Do you confirm what I’ve just said or there’s a simpler way to do it ?
Thank you !