ROIAlign interpolates the proposals, which are overlaid on the feature maps, no?
As I said, you could calculate the receptive field, if you know all conv setups.
Interpolating an activation map to the same shape as the output will not create a 1 to 1 mapping.