A lot of pretrained models will use the image size of 224x224, so you might want to use a custom architecture for smaller images (or resize them as you’ve already done).
The current resnet implementation 371 already uses an adaptive pooling layer, so your change shouldn’t make a difference regarding the performance.