omz:

Could you give an example for a case where 1xN tensors would not be good but a size N Tensor would?


Couldn’t one argue the same with 3D tensors though?
Where would a 1x1xN tensor not be good but a 1xN or N tensor would?
This is just a difference of how the language/library works.
In PyTorch you can have 1D, 2D, 3D, ..., nD tensors and you can use whatever you find most convenient.
I dont really know matlab, but you seem to imply matlab only allows 2D,..., nD tensors.