I had followed the tutorial but I don’t need to modified the backbone at this stage. If I cannot get decent AP with fasterRCNN as a baseline there is not point to change the backbone. I  am using Pascal Voc dataset and was expecting to get similar results to the benchmark but it seems that there is something missing.