DistilGPT2 Finetuning with GPU
Hi, i'm a beginner in this field and would like to finetune the model DistilGPT2 using my laptop. I have an Nvidia 1660Ti and followed the guide example 

```
export TRAIN_FILE=/path/to/dataset/wiki.train.raw
export TEST_FILE=/path/to/dataset/wiki.test.raw

python run_language_modeling.py \
    --output_dir=output \
    --model_type=gpt2 \
    --model_name_or_path=gpt2 \
    --do_train \
    --train_data_file=$TRAIN_FILE \
    --do_eval \
    --eval_data_file=$TEST_FILE
```

But during the finetuning my GPU stays at 0% and all the work is done by the CPU, is there a way to force the GPU to finetune?
It should be automatic.

What does torch.cuda.is_available say?<|||||>torch.cuda.is_available return False.
This is what my setup is by running nvidia-smi
```
Thu May 14 15:04:38 2020
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 431.87       Driver Version: 431.87       CUDA Version: 10.1     |
|-------------------------------+----------------------+----------------------+
| GPU  Name            TCC/WDDM | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX 166... WDDM  | 00000000:01:00.0 Off |                  N/A |
| N/A   57C    P8     3W /  N/A |    153MiB /  6144MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+
```<|||||>Yes just checked. torch is not able to find cuda<|||||>You should upgrade your nvidia driver.

You probably installed pytorch 1.5.0 bumped up the required version of nvidia-driver.<|||||>yes.
`pip install torch==1.4.0`
will solve the issue.