SwagJ:

After I run with CUDA_LAUNCH_BLOCKING=1, the indicated array which is out of index bound are actually in the index. Are you sure this is about the index out of bound error?


Yes, pretty sure, as this error is raised:
/pytorch/aten/src/ATen/native/cuda/IndexKernel.cu:60: lambda [](int)->auto::operator()(int)->auto: block: [1,0,0], thread: [0,0,0] Assertion `index >= -sizes[i] && index < sizes[i] && "index out of bounds"` failed.

Did you run the code on the CPU and is it working?
If so, could you print the min and max values of the index tensor as well as the shape of the tensor you are indexing?



 SwagJ:

here, input_dict[‘points’] is a list of 4 2-d tensors, the size of tensor is different size. Will this doable in training process?


You won’t be able to create a single tensor from the list of differently shaped tensors, but if you are e.g. using a loop to iterate these tensors and process them one by one, there shouldn’t be a problem.