Solved by ptrblck in post #2 
              
              
                You could assign an nn.Sequential container to model.fc instead of a single linear layer via: 
model.fc = nn.Sequential(
    nn.Linear(num_ftrs, 1024),
    nn.ReLU(),
    nn.Linear(1024, 10)
)