The binaries are using the CUDA11.1 runtime, so your device should be recognized.
Since you are seeing an error in the __init__ method:
UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount(). Did you run some cuda functions before calling NumCudaDevices() that might have already set an error? Error 2: out of memory (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:109.)

this points to a setup issue so your sys admin might need to debug the NVIDIA driver and CUDA toolkit installation.
Since it seems you have limited right on this machine, you could check if any CUDA samples can be compiled and executed and might be able to use a docker container as a workaround (however, which could also fail given that the driver might not be installed correctly).