ptrblck:

In order to move to the next column (e.g. from 0 to 3 , we would have to skip 3 values.
The tensor is thus non-contiguous anymore!


Apologies for being picky with the language. But

The tensor is thus non-contiguous anymore! is confusing to me.

Did you mean:

The tensor is thus non-contiguous now!?

It seems like the crux of your whole answer to there is a lot of value, in my opinion, to clarify & correct the grammar if possible.
Thanks for your help & time.