Model architecture is exactly same, after you pointed out the decoder architecture
parameter initialization also I have kept same
I removed regularization from Keras implementation
optimizer is same Adam.