I think the problem is coming from the output_padding. If there is no output_padding, it is fine. However, I need to reconstruct the same size. What is output_padding really doing? why does it create same output from different batch???