Solved by ptrblck in post #8 
              
              
                You don’t necessarily need to wrap it in an nn.Sequential module, as it is already a working module. 
However, since the FeaturePyramidNetwork is used internally, you will get the OrderedDict as the output as seen in this line of code. 
Which means, your previous code would work for this submodule.