The main goal is to avoid unnecessary computations, make algorithm memory friendly and speed up the process. Assume you have a bunch of points in 3D space and you want to operate convolution with nxnxn filter at those points but not in grid locations where there are no points.
Thanks for your reply.