I fixed the issue and it’s running just fine now.
model.fc = nn.Linear(num_ftrs, 2).to(device)
I created this layer after i had already put the model onto the GPU in the code above it, and this layer defaults to the CPU so that just needed overidden