To use the pip wheels you would only need to install an appropriate NVIDIA driver on your workstation so I guess that your driver installation is either not working or your environment is not supporting GPUs (e.g. if you are launching a docker container without the --gpus all flag).