Do you have an idea, why the number of calls to the convolution in the backward pass is ~3000x higher than in the forward pass?
Could the mentioned splitting of the convolution create this increase in the calls?