I’m not sure that I clearly understand your problem.
You want to get the scores of your custom bboxes from the image, right?
I think it is hard to get because inside the model, there are several modules that generate anchors and cutout the boxes which has a score under threshold and NMS…