the tutorial is backpropagating through the complete network. You can see it replace the last model_ft.fc layer but using all the model_ft.parameters() in  optimizer_ft.
It’s a tutorial, so its purpose is more to give a sense of pytorch functionality rather than achieve the SOA on any benchmark.