Generally a backbone refers to some “base model” of the overall architecture, which can be changed for another one.
E.g. some detection models use a resnet as the default backbone, which you could swap for e.g. a VGG model or your custom one.