Thanks for your answer.
The grid size will stay the same, I just want to modify the coordinates of the feature points used.
If it helps for understanding, I did it in Caffe by modifying the im2col operation. Instead of taking a regular grid to compute the output of the function, I have just modified the position of the points depending on the location of the kernel center in the feature maps.
And if I have understood correctly the documentation, the unfold pytorch function does exactly the same operation. So it looks like the function I need to modify, isn’it?
So do you think it’s possible to modify the im2col pytorch operation, rebuild pytorch framework and directly use it for already built networks?