Could you check the memory usage on your GPU via nvidia-smi and make sure no other processes are using memory?
Did you change anything else besides calling model.eval(), e.g. the spatial input shapes?