It seems that you want to implement ASPP.
From Figs 2d and 5 it seems that this means running a set of convolutional layers to obtain a sense feature map, and then applying a set of different convolutions with different dilations. The results are then concatenated. This feature is a multi-scale representation of the image. (Somehow also similar to hypercolumns)