Let me explain myself. I have to train a preTrained (on Imaganet) ResNet50 network, but instead of having one last Fc layer of 1000 I need to add 3 more FC layers (1000->128,128->64 and 64->10). I do this because i want train with a custom dataset (10 classes of my making). My code is this:
resnet50 = models.resnet50(pretrained=True)
resnet50.fc = nn.Linnear(
    nn.Linear(2048, 1000),
    nn.Linear(1000, 128),
    nn.Linear(128, 64),
    nn.Linear(64, 10)
)

But i dont know if I have to use a ReLU() after the last FC (nn.Linear(64, 10)).
Thanks for your help.