Yes and it depends on your use case. I.e. if you want to calculate the max in dim1 for all tensors, you should concatenate them in the same dimension.
Let me know, if that would work for your use case.