So, the original model looks like this via debugger:
LeNet (
  (conv1): Conv2d(3, 6, kernel_size=(5, 5), stride=(1, 1))
  (conv2): Conv2d(6, 16, kernel_size=(5, 5), stride=(1, 1))
  (fc1): Linear (256 -> 120)
  (fc2): Linear (120 -> 84)
  (fc3): Linear (84 -> 10)
)

After removing the last layer and converting to sequential (the first layer is still the same and the last one is removed):
Sequential (
  (0): Conv2d(3, 6, kernel_size=(5, 5), stride=(1, 1))
  (1): Conv2d(6, 16, kernel_size=(5, 5), stride=(1, 1))
  (2): Linear (256 -> 120)
  (3): Linear (120 -> 84)

Maybe there is a better way to remove the last layer instead of converting it to sequential, but thats what I was able to find on the forums.
So should I do a .view to the input I am passing to the model or should I do something with the model itself? Thanks!