This was happening to me in pretrained model, As above I had used small input size for inception_v3,
After i resize image to (229, 229)  as mention on docs . oh It didn’t worked. Help!!
Throwing same error
RuntimeError: Calculated padded input size per channel: (3 x 3). Kernel size: (5 x 5). Kernel size can't be greater than actual input size
problem was solved inception v3 calculated padded input… 554