Solved by my3bikaht in post #2 
              
              
                If I’m not mistaken, in your model’s forward pass in rcnn module self.transform trying to normalize image, but instead of image with 3 channels it gets 380