Did you change the data somehow, e.g. by removing the batch dimension?
Based on the error message e seems to contain tensors of different shapes.
Could you add a print statement before torch.cat(e, 1) and print the shapes of all tensors in e for both runs?