Is there any possible workaround? If I cannot used the kernel, then many recent 3D ResNets cannot be used with amp.
And what do you mean next release candidate? next release of cudnn?  Do you have a schedule for the release?
About the example code snippet of using torch.randn(), there is an old github issue that I asked a couple of month ago. I found that you answered.

  
      github.com/NVIDIA/apex
  
  
    
  
	  
  

  
    
      How to handle torch.randn while using mixed precision training
    

    
      
        opened 
        
          
        
        Sep 9, 2019
      
      


      
        
          
          kkjh0723
        
      
    
  



  My module uses torch.randn during fowrard and it induces error while using amp.
Currently, I just add x=x.half() when run the module...





  
  
    
    
  
  


Please check if you can reproduce with the modified code.