so sounds like i spoke too fast … Using my current implementation or even the one suggested above, i end up with a weird error . So this is still WIP I’m afraid
“RuntimeError: Function ‘MaxPool2DWithIndicesBackward’ returned nan values in its 0th output.”