I just noticed a typo in the forward in  BackboneFusionLayer, where I set self.featpynet = nn.Sequential(*self.body) but it should be self.featpynet = nn.Sequential(*self.fpn).
Having changed that, I get the following error now: NotImplementedError