I’m not sure how the training fits into this use case, since you are comparing the outputs directly in your first post. However, if you think the backbone is updated, check the .grad attributes of the parameters of model.backbone after the backward call and verify that they are set to None.