In the forward pass of the RPN module (which is part of FCRNN module) there is an objectness variable that holds the objectness score but it’s not stored as part of the class. I’m not sure if those are the same scores you get when inference the model.
Maybe @ptrblck  can help  .