It seems like you are correct assuming:

Since the answer here might not be very torch-related and instead implicate usage of e.g. nvidia specific tools

According to this comment 1 there is a relationship between the CUDA version and the deprecated compute capabilities you won’t be able to use. You can check the CUDA 10.2 Toolkit Docs 2 where it says which compute capabilities 1 are deprecated.