Now that I realize, padding only accepts symmetric padding in width and height (a tuple of two ints – in which case, the first int is used for the height dimension, and the second int for the width dimension). Nonetheless you have many padding layers http://pytorch.org/docs/nn.html?highlight=padding#padding-layers for which you can indeed apply different paddings with 4-tuples.