Hey. You can simply run the following block of code:
for parameter in model.parameters(): 
     print(parameter.requires_grad)

To check what the default state is for the model parameters. By default, requires_grad is True and the model is in train mode. (model.training is True)