To the OP’s post and @Evan_Vogelbaum’s sln - thanks!
If you inspect the grad_fn from the output of torch.cat(), it does show backprop will still connect to original tensors (I believe), but yeah, aliasing won’t happen.
I’m wondering if there’s a way to stack a tensor s.t. that’s still “raggedly” aliases / views, similar in nature to how fn’s like Tensor.expand() 2 work. (My naive guess is nah, but still curious nonetheless.)
EDIT: Nahhhh, I ain’t seeing anything in torch.Tensor docs; will def. use flatten/unflattening.