Ok for the backbone you could add a layer by using the .add_module function. For example if you wanted to add a convolution to layer 3 you could do this
main_model.backbone.body.layer3.add_module("6", nn.Sequential(nn.Conv2d(4,4,5,6)))