You have two options:

Keep the original model and only consider the outputs for label 2 and 3
Make a new head of your model with two outputs (for your classes 2 and 3) and then train the fully connected layers again. You can use the original pretrained FC weights as an initialization for your new FC layers.