COA:

So do you think it’s possible to modify the im2col pytorch operation, rebuild pytorch framework and directly use it for already built networks?


That could be possible, but I would rather create a new method (via a custom C++ extension) than manipulating native functions.
This tutorial 2 shows how to implement such a method.