Yes, you are right. I just loaded it with pretrained=False to give you a quick example and to skip the downloading of the weights. You should definitely set it to True.
Yes, all models are pre-trained on ImageNet.