How would this approach work, if more than two windows fit into each spatial dimension?
If the 3x3 kernels stays constant and just the last part if smaller, you could probably add padding on the right and down border of the input.