I don’t know, haven’t tried that out yet. Would help if you’d share the errors you’re getting.
A backbone for an object detector normally doesn’t utilize a fully connected layer (nor global average pooling?), but I don’t know if torchvision kinda hooks into this and fixes it