I’m trying to verify that my code (CPU only) is utilizing all available computation resources. Does torch.get_num_threads give the number of threads that are potentially available or that are actually used by the current part of the code?
In the latter case, where should I print its return value for diagnosis i.e. which parts of PyTorch code should be using cpu parallelism when it is available?