Since the answer here might not be very torch-related and instead implicate usage of e.g. nvidia specific tools I also asked here: python - How to check torch gpu compatibility without initializing CUDA? - Stack Overflow 17 | Putting in the link in case anyone stumbles upon this question later and finds the SO answers useful.