Yes, weight sharing is possible and a simple approach would be to use the functional API by defining the filters and bias as nn.Parameters and apply them via F.conv2d using the different dilation rates.