Though you are using pretrained model, you have to like any other model like initializing optimizers with the model parameters and train model over a mini batches or dataset. Also, you can freeze the model parameters by iterating over batches using
for param in model.parameters: 
    param.requires_grad=False

and fine tune the last layers by enabling requires_grad = true or add few layers , to get better results.