In what ways does it not behave like a vector?
You can matrix multiply a 1D tensor with a 2D tensor:
In [2]: x = torch.randn(3, 3)

In [3]: y = torch.randn(3)

In [4]: x @ y
Out[4]:

 0.6492
-2.3366
 0.5286
[torch.FloatTensor of size 3]