Hi,
Why the bordel values will be much bigger? Since it is padded by 0s, you just add 0s to the result.
Also the pre-trained models follow the specifications from the papers that presented them. So If the original paper had padding, pytorch model will have padding. And I expect that Keras models will have padding as well.