I think I figured the issue.
device = torch.device("cpu") #torch.device("cuda") if torch.cuda.is_available() else torch.device("cpu")
model = DriverNet().to(device)
model = torch.load("model.pt")

I believe the saved model was on gpu. so It’s loaded on gpu. I convert the model to cpu before loading the model. so It gets back to gpu. and the input is on cpu
Now I do
device = torch.device("cpu") #torch.device("cuda") if torch.cuda.is_available() else torch.device("cpu")
model = DriverNet()
model = torch.load("model.pt")
model = model.to(device)

and it works well! Thanks @ptrblck  for your help! I appreciate it