Are they pre-trained or is this your own architecture you want to train?
If you are using pre-trained networks, you can still apply a pooling layer in between, or (that’s better) add a linear layer that your train by transfer learning.