Shouldn’t the CatBackward itself just be returning a few views of the grad_out?
I think that isn’t a good candidate for parallelization.
Now the further processing may be a different story, and is a much more general task.
Best regards
Thomas