Solved by ptrblck in post #2 
              
              
                print(torch.cuda.get_device_properties('cuda:0'))
> _CudaDeviceProperties(name='TITAN V', major=7, minor=0, total_memory=12034MB, multi_processor_count=80)

will give you some information about your device. 
Note that the CUDA context (ant other application) might take some memory, which will not be…