kekgle:

I am wondering if using np.split to slice the tensor will tamper with the computational graph built by autograd


Hi,
As a general rule, any op that is not provided by pytorch will break the graph (should ideally fail to run if the Tensor requires grad).
But here you can simply use torch.split or torch.chunk and all will be differentiable