Hi I tried your approach,
I get the following error
RuntimeError: The size of tensor a (7) must match the size of tensor b (2048) at non-singleton dimension 3


The 7 sized tensor is probably due to the 7x7 convolution in resnet!