I am investigating this actively.
In the meanwhile, you can install pytorch from source, and installing from source wont have this issue:

  
      
      GitHub
  
  
    

pytorch/pytorch 5

pytorch - Tensors and Dynamic neural networks in Python  with strong GPU acceleration


  
  
    
    
  
  


Sorry for the trouble, it is an issue that’s been hard to reproduce for me.