Yeah i have tried that but it doesn’t seem to work either 
I have shuffled with the grid_sample function and only very specific matrices seem to work on it–which led me to believe there might be any constraints to define the matrix